Phenomenological models of synaptic plasticity based on spike timing.

*(English)*Zbl 1145.92306Summary: Synaptic plasticity is considered to be the biological substrate of learning and memory. We review phenomenological models of short-term and long-term synaptic plasticity, in particular spike-timing dependent plasticity (STDP). The aim is to provide a framework for classifying and evaluating different models of plasticity. We focus on phenomenological synaptic models that are compatible with integrate-and-fire type neuron models where each neuron is described by a small number of variables. This implies that synaptic update rules for short-term or long-term plasticity can only depend on spike timing and, potentially, on the membrane potential, as well as on the value of the synaptic weight, or on low-pass filtered (temporally averaged) versions of the above variables. We examine the ability of the models to account for experimental data and to fulfill expectations derived from theoretical considerations. We further discuss their relations to teacher-based rules (supervised learning) and reward-based rules (reinforcement learning). All models discussed in this paper are suitable for large-scale network simulations.

##### Keywords:

spike-timing dependent plasticity; short term plasticity; simulations; learning; ordinary differential equations##### Software:

NEST
PDF
BibTeX
XML
Cite

\textit{A. Morrison} et al., Biol. Cybern. 98, No. 6, 459--478 (2008; Zbl 1145.92306)

Full Text:
DOI

##### References:

[1] | Abarbanel H, Huerta R, Rabinovich M (2002) Dynamical model of long-term synaptic plasticity. Proc Natl Acad Sci USA 99(15): 10132–0137 |

[2] | Abbott LF, Nelson SB (2000) Synaptic plasticity: taming the beast. Nat Neurosci 3(Suppl): 1178–183 |

[3] | Abbott LF, Varela JA, Sen K, Nelson SB (1997) Synaptic depression and cortical gain control. Science 275: 220–23 |

[4] | Appleby P, Elliott T (2005) Synaptic and temporal ensemble interpretation of spike-timing-dependent plasticity. Neural Comput 17(11): 2316–336 · Zbl 1072.92008 |

[5] | Artola A, Bröcher S, Singer W (1990) Different voltage dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex. Nature 347: 69–2 |

[6] | Artola A, Singer W (1993) Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation. Trends Neurosci 16(11): 480–87 |

[7] | Badoual M, Zou Q, Davison AP, Rudolph M, Bal T, Fregnac Y, Destexhe A (2006) Biophysical and phenomenological models of multiple spike interactions in spike-timing dependent plasticity. Int J Neural Systems 16: 79–7 · Zbl 05153407 |

[8] | Bell C, Han V, Sugawara Y, Grant K (1997) Synaptic plasticity in a cerebellum-like structure depends on temporal order. Nature 387: 278–81 |

[9] | Bi G-q, Poo M (2001) Synaptic modification by correlated activity: Hebb’s postulate revisited. Annu Rev Neurosci 24: 139–66 |

[10] | Bi G-q, Wang H (2002) Temporal asymmetry in spike timing-dependent synaptic plasticity. Physiol Behav 77: 551–55 |

[11] | Bi G-q, Poo M-m (1998) Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18: 10464–0472 |

[12] | Bienenstock EL, Cooper LN, Munro PW (1982) Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J Neurosci 2(1): 32–8 |

[13] | Billings G, van Rossum M (2008) Memory retention and spike timing dependent plasticity (preprint) |

[14] | Bliss TVP, Collingridge GL (1993) A synaptic model of memory: long-term potentiation in the hippocampus. Nature 361: 31–9 |

[15] | Bliss TVP, Lomo T (1973) Long-lasting potentation of synaptic transmission in the dendate area of anaesthetized rabbit following stimulation of the perforant path. J Physiol 232: 331–56 |

[16] | Brader JM, Senn W, Fusi S (2007) Learning real world stimuli in a neural network with spike-driven synaptic dynamics. Neural Comput 19(11): 2881–912 · Zbl 1129.92002 |

[17] | Burkitt AN, Gilson M, van Hemmen JL (2007) Spike-timing-dependent plasticity for neurons with recurrent connections. Biol Cybern 96(5): 533–46 · Zbl 1122.92002 |

[18] | Burkitt AN, Meffin H, Grayden DB (2004) Spike-timing-dependent plasticity: the relationship to rate-based learning for models with weight dynamics determined by a stable fixed point. Neural Comput 16: 885–40 · Zbl 1054.92007 |

[19] | Cooper L, Intrator N, Blais B, Shouval HZ (2004) Theory of cortical plasticity. World Scientific, Singapore · Zbl 1141.92309 |

[20] | Dayan P, Abbott LF (2001) Theoretical neuroscience. MIT Press, Cambridge · Zbl 1051.92010 |

[21] | Debanne D, Gähwiler BH, Thompson SM (1998) Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. J Physiol (Lond) 507: 237–47 |

[22] | Dudek SM, Bear MF (1992) Homosynaptic long-term depression in area CA1 of hippocampus and effects of n-methyl-d-aspartate receptor blockade. Proc Natl Acad Sci USA 89: 4363–367 |

[23] | Florian RV (2007) Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Comput 19: 1468–502 · Zbl 1115.68473 |

[24] | Fregnac Y, Schulz DE (2006) Activity-dependent regulation of receptive field properties of cat area 17 by supervised Hebbian learning. J Neurobio 41: 69–2 |

[25] | Frey U, Morris R (1997) Synaptic tagging and long-term potentiation. Nature 385: 533–36 |

[26] | Froemke R, Tsay I, Raad M, Long J, Dan Y (2006) Contribution of individual spikes in burst-induced long-term synaptic modification. J Neurophysiol 95: 1620–629 |

[27] | Froemke RC, Dan Y (2002) Spike-timing-dependent synaptic modification induced by natural spike trains. Nature 416(6879): 433–38 |

[28] | Fusi S, Annunziato M, Badoni D, Salamon A, Amit DJ (2000) Spike-driven synaptic plasticity: Theory, simulation, VLSI implementation. Neural Comput 12(10): 2227–258 |

[29] | Fusi S, Drew PJ, Abbott LF (2005) Cascade models of synaptically stored memories. Neuron 45(4): 599–11 |

[30] | Gerstner W, Kempter R, van Hemmen JL, Wagner H (1996) A neuronal learning rule for sub-millisecond temporal coding. Nature 383: 76–8 |

[31] | Gerstner W, Kistler W (2002) Spiking neuron models: single neurons, populations, plasticity. Cambridge University Press, Cambridge · Zbl 1100.92501 |

[32] | Gerstner W, Ritz R, van Hemmen JL (1993) Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns. Biol Cybern 69(5–): 503–15 · Zbl 0783.92005 |

[33] | Gewaltig M-O, Diesmann M (2007) NEST (neural simulation tool). Scholarpedia 2(4): 1430 |

[34] | Graupner M, Brunel N (2007) STDP in a bistable synapse model based on CaMKII and associated signaling pathways. Public Library Sci Comput Biol 3(11): e221 |

[35] | Grossberg S (1987) The adaptive brain I. Elsevier, Amsterdam |

[36] | Gupta A, Wang Y, Markram H (2000) Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. Science 287: 273–78 |

[37] | Gustafsson B, Wigstrom H, Abraham WC, Huang Y-Y (1987) Long-term potentiation in the hippocampus using depolarizing current pulses as the conditioning stimulus to single volley synaptic potentials. J Neurosci 7: 774–80 |

[38] | Gütig R, Aharonov R, Rotter S, Sompolinsky H (2003) Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. J Neurosci 23(9): 3697–714 |

[39] | Hebb DO (1949) The organization of behavior: a neuropsychological theory. Wiley, New York |

[40] | Iglesias J, Eriksson J, Grize F, Tomassini M, Villa A (2005) Dynamics of pruning in simulated large-scale spiking neural networks. Biosystems 79: 11–0 |

[41] | Izhikevich EM (2007) Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb Cortex 17(10): 2443–452 |

[42] | Izhikevich EM, Desai NS (2003) Relating STDP to BCM. Neural Comput 15: 1511–523 · Zbl 1109.92307 |

[43] | Izhikevich EM, Gally JA, Edelman GM (2004) Spike-timing dynamics of neuronal groups. Cereb Cortex 14: 933–44 |

[44] | James W (1890) Psychology (briefer course). Holt, New York |

[45] | Kampa BM, Letzkus JJ, Stuart GJ (2007) Dendritic mechanisms controlling spike-timing-dependent synaptic plasticity. Trends Neurosci 30(9): 456–63 |

[46] | Kandel ER, Schwartz JH, Jessel TM (2000) Principles of neural science, 4th edn. McGraw-Hill, New York. ISBN 978-0838577011 |

[47] | Kelso SR, Ganong AH, Brown TH (1986) Hebbian synapses in hippocampus. Proc Natl Acad Sci USA 83: 5326–330 |

[48] | Kempter R, Gerstner W, van Hemmen JL (1999) Hebbian learning and spiking neurons. Phys Rev E 59: 4498–514 |

[49] | Kempter R, Gerstner W, van Hemmen JL (2001) Intrinsic stabilization of output rates by spike-based Hebbian learning. Neural Comput 12: 2709–742 · Zbl 0996.92001 |

[50] | Kistler WM, van Hemmen JL (2000) Modeling synaptic plasticity in conjunction with the timing of pre- and postsynaptic action potentials. Neural Comput 12: 385–05 |

[51] | Kriener B, Tetzlaff T, Aertsen A, Diesmann M, Rotter S (2008) Correlations and population dynamics in recurrent cortical networks. Neural Comput (in press) · Zbl 1140.92005 |

[52] | Larson J, Lynch G (1986) Induction of synaptic potentiation in hippocampus by patterned stimulation involves two events. Science 232: 985–88 |

[53] | Legenstein R, Naeger C, Maass W (2005) What can a neuron learn with spike-timing-dependent plasticity? Neural Comput 17(11): 2337–382 · Zbl 1075.68635 |

[54] | Levy WB, Steward D (1983) Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus. Neuroscience 8: 791–97 |

[55] | Lisman J (1989) A mechanism for Hebb and anti-Hebb processes underlying learning and memory. Proc Natl Acad Sci USA 86: 9574–578 |

[56] | Lisman JE, Zhabotinsky AM (2001) A model of synaptic memory: A CaMKII/PP1 switch that potentiates transmission by organizing an AMPA receptor anchoring assembly. Neuron 31: 191–01 |

[57] | Lu J, Li C, Zhao JP, Poo M-m, Zhang X (2007) Spike-timing-dependent plasticity of neocortical excitatory synapses on inhibitory interneurons depends on target cell type. J Neurosci 27: 9711–720 |

[58] | Malenka RC, Kauer J, Zucker R, Nicoll RA (1988) Postsynaptic calcium is sufficient for potentiation of hippocampal synaptic transmission. Science 242: 81–4 |

[59] | Malenka RC, Nicoll RA (1993) NMDA-receptor-dependent plasticity: multiple forms and mechanisms. Trends Neurosci 16: 480–87 |

[60] | Markram H, Lübke J, Frotscher M, Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275: 213–15 |

[61] | Markram H, Sakmann B (1995) Action potentials propagating back into dendrites trigger changes in efficacy of single-axon synapses between layer V pyramidal neurons. Soc Neurosci Abstr 21(3): 2007 |

[62] | Markram H, Wang Y, Tsodyks M (1998) Differential signaling via the same axon of neocortical pyramidal neurons. Proc Natl Acad Sci USA 95(9): 5323–328 |

[63] | Miller K, Keller JB, Stryker MP (1989) Ocular dominance column development: analysis and simulation. Science 245: 605–15 |

[64] | Morrison A, Aertsen A, Diesmann M (2007) Spike-timing dependent plasticity in balanced random networks. Neural Comput 19: 1437–467 · Zbl 1115.92011 |

[65] | Morrison A, Straube S, Plesser HE, Diesmann M (2007) Exact subthreshold integration with continuous spike times in discrete time neural network simulations. Neural Comput 19(1): 47–9 · Zbl 1116.92016 |

[66] | Ngezahayo A, Schachner M, Artola A (2000) Synaptic activity modulates the induction of bidirectional synaptic changes in adult mouse hippocampus. J Neurosci 20(7): 2451–458 |

[67] | Nishiyama M, Hong K, Mikoshiba K, Poo M, Kato K (2000) Calcium stores regulate the polarity and input specificity of synaptic modification. Nature 408(6812): 584–88 |

[68] | O’Connor D, Wittenberg G, Wang S-H (2005) Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc Natl Acad Sci USA 102: 9679–684 |

[69] | Oja E (1982) A simplified neuron model as a principal component analyzer. J Math Biol 15: 267–73 · Zbl 0488.92012 |

[70] | Pacelli GJ, Sue W, Keslo SR (1989) Activity-induced depression of synaptic inhibition during LTP-inducing patterned stimulation. Brain Res 486: 26–2 |

[71] | Petersen C, Malenka R, Nicoll R, Hopfield J (1998) All-or-none potentiation of CA3-CA1 synapses. Proc Natl Acad Sci USA 95: 4732–737 |

[72] | Pfister J-P, Gerstner W (2006) Triplets of spikes in a model of spike timing-dependent plasticity. J Neurosci 26: 9673–682 |

[73] | Pfister J-P, Toyoizumi T, Barber D, Gerstner W (2006) Optimal spike-timing dependent plasticity for precise action potential firing in supervised learning. Neural Comput 18: 1309–339 · Zbl 1092.92008 |

[74] | Radpour S, Thomson AM (1991) Coactivation of local circuit NMDA receptor mediated EPSPs induces lasting enhancement of minimal schaffer collateral epsps in slices of rat hippocampus. Eur J Neurosci 3: 602–13 |

[75] | Roberts PD (1999) Computational consequences of temporally asymmetric learning rules: I. Differential Hebbian learning. J Comput Neurosci 7: 235–46 · Zbl 0955.92009 |

[76] | Rotter S, Diesmann M (1999) Exact digital simulation of time-invariant linear systems with applications to neuronal modeling. Biol Cybern 81(5/6): 381–02 · Zbl 0958.92004 |

[77] | Rubin J, Lee D, Sompolinsky H (2001) Equilibrium properties of temporally asymmetric Hebbian plasticity. Phys Rev Lett 86: 364–67 |

[78] | Rubin JE, Gerkin RC, Bi G-q, Chow CC (2005) Calcium time course as a signal for spike-timing-dependent plasticity. J Neurophysiol 93: 2600–613 |

[79] | Saudargiene A, Porr B, Wörgötter F (2003) How the shape of pre- and postsynaptic signals can influence STDP: a biophysical model. Neural Comput 16: 595–26 · Zbl 1050.92012 |

[80] | Schemmel J, Gruebl A, Meier K, Mueller E (2006) Implementing synaptic plasticity in a VLSI spiking neural network model. In: Proceedings of the 2006 international joint conference on neural networks. IEEE Press, pp 1– |

[81] | Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275: 1593–599 |

[82] | Senn W (2002) Beyond spike timing: the role of nonlinear plasticity and unreliable synapses. Biol Cybern 87: 344–55 · Zbl 1105.92328 |

[83] | Senn W, Markram H, Tsodyks M (2000) An algorithm for modifying neurotransmitter release probability based on pre- and postsynaptic spike timing. Neural Comput 13: 35–7 · Zbl 1047.92014 |

[84] | Senn W, Schneider M, Ruf B (2002) Activity-dependent development of axonal and dendritic delays, or, why synaptic transmission should be unreliable. Neural Comput 14(3): 583–19 · Zbl 0987.92010 |

[85] | Seung HS (2003) Learning spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40: 1063–073 |

[86] | Shouval HZ, Bear MF, Cooper LN (2002) A unified model of NMDA receptor dependent bidirectional synaptic plasticity. Proc Natl Acad Sci USA 99: 10831–0836 |

[87] | Sjostrom P, Turrigiano G, Nelson S (2001) Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron 32: 1149–164 |

[88] | Sjostrom PJ, Turrigiano GG, Nelson SB (2004) Endocannabinoid-dependent neocortical layer-5 LTD in the absence of postsynaptic spiking. J Neurophysiol 92(6): 3338–343 |

[89] | Song S, Miller KD, Abbott LF (2000) Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci 3(9): 919–26 |

[90] | Song S, Per S, Reigl M, Nelson S, Chklovskii D (2005) Highly nonrandom features of synaptic connectivity in local cortical circuits. Public Library Sci Biol 3(3): 0507–519 |

[91] | Standage D, Jalil S, Trappenberg T (2007) Computational consequences of experimentally derived spike-time and weight dependent plasticity rules. Biol Cybern 96(6): 615–23 · Zbl 1122.92016 |

[92] | Steele PM, Mauk MD (1999) Inhibitory control of LTP and LTD: stability of synapse strength. J Neurophysiol 81: 1559–566 |

[93] | Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. Adaptive Computation and Machine Learning. The MIT Press |

[94] | Thomson AM, Deuchars J, West DC (1993) Large, deep layer pyramid-pyramid single axon EPSPs in slices of rat motor cortex display paired pulse and freuquency-dependent depression, mediated presynaptically and self-facilitation mediated postsynaptically. J Neurophysiol 70(6): 2354–369 |

[95] | Thomson AM, Lamy C (2007) Functional maps of neocortical local circuitry. Front Neurosci 1: 19–2 |

[96] | Togashi K, Kitajima T, Aihara T, Hong K, Poo M, Nishiyama M (2003) Gating of activity-dependent long-term depression by GABAergic activity in the hippocampus. In: SocNeurosciAbstr, pp 123.4 |

[97] | Toyoizumi T, Pfister J, Aihara K, Gerstner W (2007) Optimality model of unsupervised spike-timing-dependent plasticity: synaptic memory and weight distribution. Neural Comput 19(3): 639–71 · Zbl 1117.92015 |

[98] | Toyoizumi T, Pfister JP, Aihara K, Gerstner W (2005) Generalized Bienenstock-Cooper-Munro rule for spiking neurons that maximizes information transmission. Proc Natl Acad Sci USA 102(14): 5239–244 |

[99] | Triesch J (2007) Synergies between intrinsic and synaptic plasticity mechanisms. Neural Comput 19(4): 885–09 · Zbl 1118.68128 |

[100] | Tsodyks M, Pawelzik K, Markram H (1998) Neural networks with dynamic synapses. Neural Comput 10: 821–35 |

[101] | Tsodyks M, Uziel A, Markram H (2000) Synchrony generation in recurrent networks with frequency-dependent synapses. J Neurosci 20, RC1 (1–) |

[102] | Tsodyks MV, Markram H (1997) The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proc Natl Acad Sci USA 94: 719–23 |

[103] | Turrigiano G, Abbott LF, Marder E (1994) Activity-dependent changes in the intrinsic properties of pyramidal neurons. Science 264: 974–77 |

[104] | Turrigiano GG, Leslie KR, Desai NS, Rutherford LC, Nelson SB (1998) Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature 391: 892–96 |

[105] | Turrigiano GG, Nelson SB (2004) Homeostatic plasticity in the developing nervous system. Nat Rev Neurosci 5: 97–07 |

[106] | van Rossum MCW, Bi G-q, Turrigiano GG (2000) Stable Hebbian learning from spike timing-dependent plasticity. J Neurosci 20(23): 8812–821 |

[107] | Wang H-X, Gerkin RC, Nauen DW, Bi G-q (2005) Coactivation and timing-dependent integration of synaptic potentiation and depression. Nat Neurosci 8(2): 187–93 |

[108] | Zou Q, Destexhe A (2007) Kinetic models of spike-timing dependent plasticity and their functional consequences in detecting correlations. Biol Cybern 97(1): 81–7 · Zbl 1125.92019 |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.