Fastest learning in small-world neural networks. (English) Zbl 1136.68504

Simard, D.; Nadeau, L.; Kröger, H.

Phys. Lett., A 336, No. 1, 8-15 (2005).

Summary: We investigate supervised learning in neural networks. We consider a multi-layered feed-forward network with back propagation. We find that the network of small-world connectivity reduces the learning error and learning time when compared to the networks of regular or random connectivity. Our study has potential applications in the domain of data-mining, image processing, speech recognition, and pattern recognition.

MSC:

68T05	Learning and adaptive systems in artificial intelligence
92B20	Neural networks for/in biological studies, artificial life and related topics

References:

[1]	Watts, D.J.; Strogatz, S.H., Nature, 393, 440, (1998)
[2]	Albert, R.; Jeong, H.; Barabási, A.L., Nature, 401, 130, (1999)
[3]	Barabási, A.L.; Albert, R., Science, 286, 509, (1999)
[4]	Albert, R.; Jeong, H.; Barabási, A.L., Nature, 406, 378, (2000)
[5]	Jeong, H.; Tombor, B.; Albert, R.; Oltvai, Z.N.; Barabási, A.L., Nature, 407, 651, (2000)
[6]	Huberman, B.A.; Adamic, L.A., Nature, 401, 131, (1999)
[7]	Kleinberg, J.M., Nature, 406, 845, (2000)
[8]	Strogatz, S.H., Nature, 410, 268, (2001)
[9]	Watts, D.J.; Dodds, P.S.; Newman, M.E.J., Science, 296, 1302, (2002)
[10]	Faloutsos, M.; Faloutsos, P.; Faloutsos, C., Comput. commun. rev., 29, 251, (1999)
[11]	Wagner, A., Proc. R. soc. London B, 268, 1803, (2001)
[12]	Corbacho, H.R.; Lago-Fernández, F.; Sigüenza, L.F.; Sigüenza, J.A., Phys. rev. lett., 84, 2758, (2000)
[13]	Bohland, J.W.; Minai, A.A., Neurocomputing, 38-40, 489, (2001)
[14]	Labiouse, C.L.; Salah, A.A.; Starikova, I., The impact of connectivity on the memory capacity and the retrieval dynamics of Hopfield-type networks, (), 77-84
[15]	Rosin, A.; Riecke, H.; Solla, S.A., Phys. rev. lett., 92, 19, (2004)
[16]	Netoff, T.I.; Clewley, R.; Arno, S.; Keck, T.; White, J.A., J. neurosci., 24, 8075, (2004)
[17]	Sporns, O.; Tononi, G.; Edelman, G.M., Cerebral cortex, 10, 127, (2000)
[18]	Chialvo, D.R., Physica A, 340, 756, (2004)
[19]	Laughlin, S.B.; Sejnowski, T.J., Science, 301, 1870, (2003)
[20]	Rosenblatt, F., Principles of neurodynamics, (1962), Spartan New York · Zbl 0143.43504
[21]	LeCun, Y.; Bottou, L.; Bengio, Y.; Haffner, P., Proc. IEEE, 86, 2278, (1998)
[22]	Rummelhart, D.E.; Hinton, G.E.; Williams, R.J., Nature, 323, 533, (1986)
[23]	Latora, V.; Marchiori, M., Phys. rev. lett., 87, 198701, (2001)
[24]	Marchiori, M.; Latora, V., Physica A, 285, 539, (2000)