A Novel GPU-Enabled Simulator for Large Scale Spiking Neural Networks

• Autorzy: Szynkiewicz P.
• Języki publikacji: EN

Abstrakty

EN

The understanding of the structural and dynamic complexity of neural networks is greatly facilitated by computer simulations. An ongoing challenge for simulating realistic models is, however, computational speed. In this paper a framework for modeling and parallel simulation of biological-inspired large scale spiking neural networks on high-performance graphics processors is described. This tool is implemented in the OpenCL programming technology. It enables simulation study with three models: Integrate-andfire, Hodgkin-Huxley and Izhikevich neuron model. The results of extensive simulations are provided to illustrate the operation and performance of the presented software framework. The particular attention is focused on the computational speed-up factor.

Słowa kluczowe

EN

GPU computing; OpenCL programming technology; parallel simulation; spiking neural networks

• Wydawca: Instytut Łączności - Państwowy Instytut Badawczy
• Czasopismo: Journal of Telecommunications and Information Technology
• Rocznik: 2016
• Tom: nr 2
• Strony: 34--42
• Opis fizyczny: Bibliogr. 27 poz., rys., tab.

Twórcy

autor

Szynkiewicz P.

• Systems Research Institute, Polish Academy of Science, Newelska st 6, 01-447 Warsaw, Poland

Bibliografia

• [1] W.-M. W. Hwu (Ed.), GPU Computing Gems Emerald Edition, 1st ed. Morgan Kaufman, 2011.
• [2] N. Carnevale and M. Hines, The NEURON Book. Cambridge University Press, 2006.
• [3] W. Gerstner and W. Kistler, Spiking Neuron Models. Cambridge University Press, 2002.
• [4] E. M. Izhikevich, Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting. The MIT Press Cambridge, 2007.
• [5] J. Vreeken, “Spiking neural networks: An introduction", Tech. Rep., Artificial Intelligence laboratory, Intelligent Systems Group, University of Utrecht, 2003.
• [6] R. Brette et al., “Simulation of networks of spiking neurons: A review of tools and strategies", J. Computat. Neuroscience, vol. 23, no. 3, pp. 349-398, 2007.
• [7] K. D. Carlson, J. M. Nageswaran, N. Dutt, and J. L. Krichmar, “An efficient automated parameter tuning framework for spiking neural networks", Front. in Neuroscience, vol. 8, art. 10, pp. 1-16, 2014 [Online]. Available: http://dx.doi.org/10.3389/fnins.2014.00010
• [8] Z. Fountas and M. Shanahan, “GPU-based fast parameter optimization for phenomenological spiking neural models", in Proc. Int. Joint Conf. Neural Netw. IJCNN 2015, Killarney, Ireland, 2015, pp. 1-8.
• [9] E. M. Izhikevich, "Which model to use for cortical spiking neurons", IEEE Trans. Neural Netw., vol. 15, no. 5, pp. 1063-1070, 2004.
• [10] A. L. Hodgkin and A. F. Huxley, “A quantitative description of membrane current and its application to conduction and excitation in nerve", J. Physiology, vol. 117, no. 4, pp. 500-544, 1952.
• [11] E. M. Izhikevich, “Simple model of spiking neurons", IEEE Trans. Neural Netw., vo. 14, no. 6, pp. 1569-1572, 2003.
• [12] R. Brette and D. F. Goodman, “Simulating spiking neural networks on GPU", Network, vol. 23, no. 4, pp. 167-182, 2012.
• [13] M. Chessa, V. Bianchi, M. Zampetti, S. P. Sabatini, and F. Solari, “Real-time simulation of large-scale neural architectures for visual features computation based on GPU", Network, vol. 23, no. 4, pp. 272-291, 2012.
• [14] J. M. Nageswaran, N. Dutt, J. L. Krichmar, A. Nicolau, and A. V. Veidenbaum, “A configurable simulation environment for the efficient simulation of large-scale spiking neural networks on graphics processors", Neural Netw., vol. 22, no. 5-6, pp. 79-800, 2009.
• [15] R. Ananthanarayanan and D. S. Modha, “Anatomy of a cortical simulator", in Proc. of ACM/IEEE Conf. Supercomput. SC'07, Reno, NV, USA, 2007, pp. 1-12 (doi: 10.1145/1362622.1362627).
• [16] NEURON Simulator [Online]. Available: http://www.neuron.yale.edu/neuron/
• [17] NEST Simulator [Online]. Available: http://www.nest-initiative.org/
• [18] D. Goodman and R. Brette, “The Brian simulator", Front. in Neuroscience, vol. 3, no. 2, pp. 192-197, 2009.
• [19] Brian Simulator [Online]. Available: http://briansimulator.org/
• [20] Mvaspike Simulator [Online]. Available: http://mvaspike.gforge.inria.fr/
• [21] NeMo Simulator [Online]. Available: http://nemosim.sourceforge.net/
• [22] A. Fidjeland, E. Roesch, M. Shanahan, and W. Luk, “NeMo: a platform for neural modelling of spiking neurons using GPUs", in 20th IEEE Int. Conf. Application-specific Syst., Architec. & Processors ASAP 2009, Boston, MA, USA, 2009.
• [23] GeNN Simulator [Online]. Available: http:genn-team.github.io/genn/
• [24] Myriad Simulator [Online]. Available: http://cplab.net/myriad/
• [25] OpenCL - The open standard for parallel programming of heterogeneous systems [Online]. Available: http://www.khronos.org/opencl/
• [26] E. Bainville, “OpenCL multiprecision tutorial", Jan. 2010 [Online]. Available: http:// http://www.bealto.com/mp-opencl.html
• [27] R. R. D. Stewart and W. Bair, “Spiking neural network simulation: numerical integration with the Parker-Sochacki method", J. Computat. Neuroscience, vol. 27, pp. 115-133, 2009 (doi: 10.1007/S10827-008-0131-5).