Welcome to The Neuromorphic Engineer
A common language for neuronal networks in software and hardware

PDF version | Permalink

Andrew Davison, Eilif Muller, Daniel Brüderle, and Jens Kremkow

25 January 2010

A new interface allows simulations to be run without modification in multiple software simulators and neuromorphic hardware, greatly simplifying translation and cross-validation of models.

Fast information processing in the brain is performed by the exchange of brief electrical pulses (called action potentials, or spikes) between neurons that are connected in complex networks. Models of such networks may either be simulated in software1 or implemented in VLSI hardware.2 Numerical simulation in software has the advantages of flexibility and the commodity status of digital computers, with simulations being performed on systems ranging from individual desktop machines, through clusters, up to supercomputers.3 The main advantages of physical emulation in analog or mixed-signal neuromorphic hardware arise from the locally analog and massively parallel nature of the computations together with the very small spatial scale of VLSI components. The benefits are high scalability, computational speed, and low power consumption.

Typically, specification of neuronal network models—the mechanisms of individual neurons and the pattern and properties of the connections between them—is done by editing a configuration file, using a graphical interface to set parameters, or, most flexibly, writing a script in an interpreted programming language. A major problem that impedes communication between researchers, reproducibility of results, and building upon previous work, is that each software simulator or hardware system has its own configuration format, graphical interface or special-purpose programming language. This makes the translation of a model from one system to another—and especially from software to hardware—arduous, time-consuming and error-prone.

However, the availability of multiple simulators and hardware systems has many advantages, particularly in cross-checking results and in exploiting the complementary features of different systems, e.g., the flexibility of a simulator and the speed of a hardware system. A common interface for specifying models that would work across multiple systems would retain the benefits of simulator/hardware diversity while reducing or removing the translation barrier. We have developed such a common interface, PyNN (pronounced ‘pine’) that enables simulation scripts to be run on any supported system (currently four different software simulators and one neuromorphic hardware system) without modification.


Example code for a balanced network of integrate-and-fire neurons. To run the simulation with the NEST simulator instead of with NEURON, we simply change the first line to from pyNN.nest import ⋆.

PyNN4 (available from http://neuralensemble.org/PyNN), is both an application programming interface (API) for the Python programming language5 and an implementation of the interface for a number of systems (currently the NEURON,6 NEST,7 PCSIM8 and Brian9 simulators and the FACETS neuromorphic mixed-signal VLSI system).10,11 A simulation script is written in Python, with neuronal network modelling functions and classes provided by PyNN, and optionally exploiting the extensive capabilities for numerical data analysis and visualisation available in Python or in third-party extensions such as NumPy.11 It can then be run on any supported ‘back-end’ system without modification, except for a single parameter specifying which back-end to use.

PyNN takes care of translating the neuron, synapse and network models into the required form for a given simulator, consistent handling of physical units, and consistent handling of random numbers, and provides a high-level, object-oriented interface to enable structured development of large-scale, complex models. A simple example of a network of excitatory and inhibitory neurons exhibiting self-sustained activity is shown in Figures 1 and 2.


Results of running the code example given in Figure 1, with NEURON and NEST as back-end simulators. (A) Membrane potential traces for two excitatory neurons. (B) Distribution of pooled inter-spike intervals (ISIs). (C) Distribution over neurons of the coefficient of variation of the ISI (CV(ISI)). This figure illustrates the limitations of reproducibility between simulators. Even though the specification of the model is identical in every detail between the two simulators, the network is very sensitive to small perturbations due to floating point round-off, etc., which lead to a divergence of the traces of individual neurons after about 50ms (A), although the statistical properties of the networks (B,C) are practically identical. For hardware systems, with intrinsic component variability and noise, exact reproducibility is even further from being achievable.

Adding support for a new simulator or hardware back-end requires writing a Python module that implements the PyNN API for that system. However, much of the code in the current implementation is shared between back-ends, and only a small number of simulator-specific functions and classes need be defined to take advantage of the entire API and future extensions to it. It is not required that the simulator or control software have a Python interface, since code-generation can be used in this case, but obviously this makes two-way communication and interactive use more difficult. The API is defined independently of any particular implementation, and is versioned. This means that developers of an interface to a new system are not required to contribute code back to the project (although this is welcomed), but simply need to implement the published API in order to take advantage of being able to run a PyNN simulation on their system.

In summary, PyNN greatly simplifies the tasks of writing simulator-independent neuronal network models, of transferring models from software simulators to neuromorphic hardware systems, and of cross-validating simulation results between different systems. In the future, we hope to see implementations of the interface for further simulators and hardware systems (developers interested in an implementation for their own system are encouraged to contact us) and to implement inter-operability with other tools for neuroscience model description, such as NeuroML.12 We expect that increased adoption of PyNN will accelerate progress in computational neuroscience by facilitating reproducibility and cross-validation of published models and by stimulating component reuse, and that it will close the gap between computational neuroscientists and neuromorphic engineers, making neuromorphic hardware more easily exploitable by non-hardware experts.




Authors

Andrew Davison
UNIC, CNRS
http://www.unic.cnrs-gif.fr/

Dr Andrew Davison is a research scientist with the CNRS, with research interests in large-scale, data-constrained modelling of neural systems.

Eilif Muller
Laboratory of Computational Neuroscience, Ecole Polytechnique Fédérale de Lausanne

Daniel Brüderle
Kirchhoff Institute for Physics, University of Heidelberg

Jens Kremkow
Neurobiology and Biophysics, Albert-Ludwigs-University


References
  1. R. Brette, M. Rudolph, T. Carnevale, M. Hines, D. Beeman, J. Bower, M. Diesmann, A. Morrison, J. PH Goodman, F. Harris, M. Zirpe, T. Natschlager, D. Pecevski, B. Ermentrout, M. Djurfeldt, A. Lansner, O. Rochel, T. Vieville, E. Muller, A. Davison, S. E. Bo, Simulation of networks of spiking neurons: A review of tools and strategies, J. Comput. Neurosci. 23, pp. 349-98, 2007.

  2. C. A. Mead, Analog VLSI and Neural Systems, Addison Wesley, Reading, MA, USA, 1989.

  3. H. Markram, The Blue Brain Project, Nat. Rev. Neurosci. 7, pp. 153-160, 2006.

  4. A. Davison, D. Brüderle, J. Eppler, J. Kremkow, E. Muller, D. Pecevski, L. Perrinet and P. Yger, PyNN: a common interface for neuronal network simulators, Front. Neuroinf. 2:11, 2009.

  5. http://www.python.org. Python is a dynamic object-oriented programming language that can be used for many kinds of software development. Accessed 21st May 2009

  6. N. T. Carnevale and M. L. Hines, The NEURON Book, Cambridge University Press, 2006.

  7. M.-O. Gewaltig and M. Diesmann, NEST (NEural Simulation Tool), Scholarpedia 2 (4), pp. 1430, 2007.

  8. D. Pecevski, T. Natschläger and K. Schuch, PCSIM: a parallel simulation environment for neural circuits fully integrated with Python, Front. Neuroinf. 3:11, 2009.

  9. D. Goodman and R. Brette, Brian: a simulator for spiking neural networks in Python, Frontiers Neuroinf. 2:5, 2008.

  10. D. Brüderle, E. Muller, A. Davison, M. E. J. Schemmel and K. Meier, Establishing a novel modeling tool: A Python-based interface for a neuromorphic hardware system, Front. Neuroinf. 3:17, 2009.

  11. http://numpy.scipy.org/. NumPy is the fundamental package needed for scientific computing with Python. Accessed 21st May 2009

  12. P. Gleeson, S. Crook, V. Steuber, R. Silver and, Using NeuroML and neuroConstruct to build neuronal network models for multiple simulators, BMC Neuroscience 8, pp. P101, 2007.


 
DOI:  10.2417/1201001.1712




Tell us what to cover!

If you'd like to write an article or know of someone else who is doing relevant and interesting stuff, let us know. E-mail the and suggest the subject for the article and, if you're suggesting someone else's work, tell us their name, affiliation, and e-mail.