×

A Markovian event-based framework for stochastic spiking neural networks. (English) Zbl 1446.92087

Summary: In spiking neural networks, the information is conveyed by the spike times, that depend on the intrinsic dynamics of each neuron, the input they receive and on the connections between neurons. In this article we study the Markovian nature of the sequence of spike times in stochastic neural networks, and in particular the ability to deduce from a spike train the next spike time, and therefore produce a description of the network activity only based on the spike times regardless of the membrane potential process. To study this question in a rigorous manner, we introduce and study an event-based description of networks of noisy integrate-and-fire neurons, i.e. that is based on the computation of the spike times. We show that the firing times of the neurons in the networks constitute a Markov chain, whose transition probability is related to the probability distribution of the interspike interval of the neurons in the network. In the cases where the Markovian model can be developed, the transition probability is explicitly derived in such classical cases of neural networks as the linear integrate-and-fire neuron models with excitatory and inhibitory interactions, for different types of synapses, possibly featuring noisy synaptic integration, transmission delays and absolute and relative refractory period. This covers most of the cases that have been investigated in the event-based description of spiking deterministic neural networks.

MSC:

92B20 Neural networks for/in biological studies, artificial life and related topics
60J20 Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.)
PDFBibTeX XMLCite
Full Text: arXiv

References:

[1] Ricciardi, L., & Smith, C. (1977). Diffusion processes and related topics in biology. New York: Springer. · Zbl 0356.60023
[2] Holden, A. (1976). Models of the stochastic activity of neurones. Lecture Notes in Biomathematics, 12, 1-368. · Zbl 0353.92001
[3] Marian, I., Reilly, R., & Mackey, D. (2002). Efficient event-driven simulation of spiking neural networks. In Proceedings of the 3rd WSEAS international conference on neural networks and applications.
[4] Asmussen, S., & Turova, T. S. (1998). Stationarity properties of neural networks. Journal of Applied Probabilities, 35, 783-794. · Zbl 0933.60097
[5] Tuckwell, H. C. (1988). Introduction to theoretical neurobiology. Cambridge: Cambridge University Press. · Zbl 0647.92009
[6] Watts, L.
[7] Turova, T. S. (1996). Analysis of a biological plausible neural network via an hourglass model. Markov Processes and Related Fields, 2, 487-510. · Zbl 0902.60084
[8] Turova, T. (2000). Neural networks through the hourglass. BioSystems, 58, 159-165.
[9] Touboul, J., & Faugeras, O. (2008). First hitting time of double integral processes to curved boundaries. Advances in Applied Probability, 40(2), 501-528. · Zbl 1147.60027
[10] Touboul, J., & Faugeras, O. (2007). The spikes trains probability distributions: A stochastic calculus approach. Journal of Physiology, Paris, 101(1-3), 78-98.
[11] Touboul, J. (2008). Nonlinear and stochastic models in neuroscience. PhD thesis, Ecole Polytechnique. · Zbl 1185.92027
[12] Tonnelier, A., Belmabrouk, H., & Martinez, D. (2007). Event-driven simulations of nonlinear integrate-and-fire neurons. Neural Computation, 19(12), 3226-3238. · Zbl 1144.68049
[13] Thorpe, S., Delorme, A., & VanRullen, R. (2001). Spike based strategies for rapid processing. Neural Networks, 14, 715-726.
[14] Softky, W. R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random epsps. Journal of Neuroscience, 13, 334-350.
[15] Shadlen, M. N., & Newsome, W. T. (1994). Noise, neural codes and cortical organization. Current Opinion in Neurobiology, 4(4), 569-579.
[16] Rudolph, M., & Destexhe, A. (2006). Analytical integrate-and-fire neuron models with conductance-based dynamics for event-driven simulation strategies. Neural Computation, 18, 2146-2210. · Zbl 1099.68698
[17] Roxin, A., Brunel, N., & Hansel, D. (2005). Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. Physical Review Letters, 94(23), 238103.
[18] Rolls, E., & Deco, G. (2010). The noisy brain: Stochastic dynamics as a principle of brain function. London: Oxford University Press. · Zbl 1286.92019
[19] Plesser, H. E. (1999). Aspects of signal processing in noisy neurons. PhD thesis, Georg-August-Universität.
[20] McKean, H. P. (1963). A winding problem for a resonator driven by a white noise. Journal of Mathematics of Kyoto University, 2, 227-235. · Zbl 0119.34701
[21] Makino, T. (2003). A discrete-event neural network simulator for general neuron models. Neural Computing & Applications, 11, 210-223. · Zbl 1040.68101
[22] Lachal, A. (1996). Sur la distribution de certaines fonctionnelles de l’int’egrale du mouvement Brownien avec d’erives parabolique et cubique. Communications on Pure and Applied Mathematics, 49, 1299-1338. · Zbl 0867.60050
[23] Lachal, A. (1991). Sur le premier instant de passage de l’intégrale du mouvement brownien. Annales de l’IHP, Section B, 27, 385-405. · Zbl 0747.60075
[24] Kloeden, P., & Platen, E. (1992). Numerical solution of stochastic differential equations. New York: Springer. · Zbl 0752.60043
[25] Karatzas, I., & Shreve, S. (1987). Brownian motion and stochatic calculus. New York: Springer.
[26] Kandel, E., Schwartz, J., & Jessel, T. (2000). Principles of neural science (4th ed.). New York: McGraw-Hill.
[27] Izhikevich, E. M., & Edelman, G. M. (2008). Large-scale model of mammalian thalamocortical systems. Proceedings of the National Academy of Sciences of the United States of America, 105(9), 3593-3598.
[28] Gromoll, H., Robert, P., & Zwart, B. (2008). Fluid limits for processor sharing queues with impatience. Mathematics of Operations Research, 33(2), 375-402. · Zbl 1213.60148
[29] Goldman, M. (1971). On the first passage of the integrated Wiener process. Annals of Mathematical Statistics, 42, 2150-2155. · Zbl 0271.60049
[30] Gobet, E. (2000). Weak approximation of killed diffusion using Euler schemes. Stochastic Processes and their Applications, 87(2), 167-197. · Zbl 1045.60082
[31] Gerstner, W., & Kistler, W. M. (2002b). Mathematical formulations of hebbian learning. Biological Cybernetics, 87, 404-415. · Zbl 1105.92313
[32] Gerstner, W., & Kistler, W. (2002a). Spiking neuron models. Cambridge: Cambridge University Press. · Zbl 1100.92501
[33] Fricker, C., Robert, P., Saada, E., & Tibi, D. (1994). Analysis of some networks with interaction. Annals of Applied Probability, 4, 1112-1128. · Zbl 0812.60094
[34] Fabre-Thorpe, M., Richard, G., & Thorpe, S. (1998). Rapid categorization of natural images by rhesus monkeys. Neuroreport, 9(2), 303-308.
[35] Delorme, A., & Thorpe, S. (2003). 57 spikenet: An event-driven simulation package for modelling large networks of spiking neurons. Network, 14(4), 613-627.
[36] Delorme, A., & Thorpe, S. (2001). Face processing using one spike per neuron: resistance to image degradation. Neural Networks, 14, 795-804.
[37] Davis, M. (1984). Piecewise-deterministic markov processes: A general class of non-diffusion stochastic models. Journal of the Royal Society, Series B (Methodological), 46, 353-388. · Zbl 0565.60070
[38] Cottrell, M., & Turova, T. (2000). Use of an hourglass model in neuronal coding. Journal of applied probability, 37, 168-186. · Zbl 0958.60089
[39] Cottrell, M. (1992). Mathematical analysis of a neural network with inhibitory coupling. Stochastic Processes and their Applications, 40, 103-127. · Zbl 0749.92003
[40] Claverol, E., Brown, A., & Chad, J. (2002). Discrete simulation of large aggregates of neurons. Neurocomputing, 47, 277-297. · Zbl 1006.68732
[41] Cessac, B. (2010). A discrete time neural network model with spiking neurons: II: Dynamics with noise. Journal of Mathematical Biology, 1-38. doi:10.1007/s00285-010-0358-4.
[42] Cessac, B. (2008). A discrete time neural network model with spiking neurons. Journal of Mathematical Biology, 56(3), 311-345. doi:10.1007/s00285-007-0117-3. · Zbl 1145.37342
[43] Brunel, N., & Hakim, V. (1999). Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Computation, 11, 1621-1671.
[44] Brette, R., Rudolph, M., Carnevale, T., Hines, M., Beeman, D., Bower, J. M., et al. (2007). Simulation of networks of spiking neurons: A review of tools and strategies. Journal of Computational Neuroscience, 23(3), 349-398.
[45] Brette, R. (2007). Exact simulation of integrate-and-fire models with exponential currents. Neural Computation, 19(10), 2604-2609. · Zbl 1143.68521
[46] Brette, R. (2006). Exact simulation of integrate-and-fire models with synaptic conductances. Neural Computation, 18(8), 2004-2027. · Zbl 1121.92012
[47] Arbib (1998). The handbook of brain theory and neural networks. Cambridge: MIT Press.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.