Abstract
A model neural network with stochastic elements in its millisecond dynamics is investigated. The network consists of neuronal units which are modelled in close analogy to physiological neurons. Dynamical variables of the network are the cellular potentials, axonic currents and synaptic efficacies. The dynamics of the synapses obeys a modified Hebbian rule and, as proposed by v. d. Malsburg (1981, 1985), develop on a time scale of a tenth of a second. In a previous publication (Buhmann and Schulten 1986) we have confirmed that the resulting noiseless autoassociative network is capable of the well-known computational tasks of formal associative networks (Cooper 1973; Kohonen et al. 1984, 1981; Hopfield 1982). In the present paper we demonstrate that random fluctuations of the membrane potential improve the performance of the network. In comparison to a deterministic network a noisy neural network can learn at lower input frequencies and with lower average neural firing rates. The electrical activity of a noisy network is very reminiscent of that observed by physiological recordings. We demonstrate furthermore that associative storage reduces the effective dimension of the phase space in which the electrical activity of the network develops.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abeles M (1982) Local cortical circuits. Springer, Berlin Heidelberg New York
Amit, DJ, Gutfreund H, Sompolinsky H (1985a) Spin glass models of neural networks. Phys Rev A 32:1007
Amit DJ, Gutfreund H, Sompolinsky H (1985b) Storing infinite numbers of patterns in a spin glas model of neural networks. Phys Rev Lett 55:1530
Amit DJ, Gutfreund H, Sompolinsky H (1987) Statistical mechanics of neural networks near saturation. Ann Phys 173:30–67
Babloyantz A (1985) Strange attractors in the dynamics of brain activity. In: Haken H (ed) Complex Systems-operational approaches. Springer, Berlin Heidelberg New York, pp 116–122
Babloyantz A, Destexhe A (1986) Low-dimensional chaos in an instance of epilepsy. Proc Natl Acad Sci USA 83:3513–3517
Bienenstock E (1984) Dynamics of central nervous system. In: Beckmann M, Krelle W (eds) Dynamics of macrosystems. Springer, Berlin Heidelberg New York, pp 3–20
Buhmann J (1987) Thesis, Technical University of Munich (in preparation)
Buhmann J, Schulten K (1986) Associative recognition and storage in a model network of physiological neurons. Biol Cybern 54:319–335
Changeux JP, Heidmann T, Patte P (1984) Learning by selection. In: Marler T, Terrace HS (eds) The biology of learning. Springer, Heidelberg Berlin New York, pp 115–133
Cooper LN (1973) Proceedings of the Nobel Symposium on collective properties of physical systems. Academic Press, New York, pp 252–264
Dvorak I, Siska J (1986) On some problems encountered in the estimation of the correlation dimension of the EEG. Phys Lett A 118:63–66
Ebeling W, Feistl R (1986) Physik der Selbstorganisation und Evolution. Akademie Verlag, Berlin
Freeman WJ (1977) Spatial properties of an EEG Event in the ollactory bulb and cortex. Electrenc Clin Neurophys 44:586–605
Goel NS, Richter-Dyn N (1974) Stochastic models in biology. Academic Press, New York San Francisco London
Goelet P, Castellucci VF, Schacher S, Kandel ER (1986) The long and the short of long-term memory—a molecular framework. Nature 322:419–422
Grassberger P, Procaccia I (1983) Measuring the strangeness of strange attractors. Physica 9D:189–208
Grossberg S (1972) Pattern learning by functional-differential neural networks with arbitrary path weights. In: Schmitt K (ed) Delay and functional differential equations and their applications. Academic Press, New York, pp 121–159
Hebb DO (1949) Organisation of behavior. Wiley, New York
Hinton GE, Sejnowski TJ, Ackley DH (1984) Boltzmann machines: constraint satisfaction networks that learn. Tech Rep No CMU-CS-84-119. Pittsburgh, PA: Carnegie-Mellon Univ
Holden AV (1976) Models of the stochastic activity of neurones. Springer, Berlin Heidelberg New York
Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 79:2554–2558
Hopfield JJ (1984) Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci USA 81:3088–3092
Kandel ER, Schwartz JR (1982) Molecular biology of learning: modulation of transmitter release. Science 218:433–443
Kelso SR, Ganong AH, Brown TH (1986) Hebbian synapses inHippocampus. Proc Natl Acad Sci USA 83:5326–5330
Kinzel W (1985) Learning and pattern recognition in spin glass models. Z Phys B — Condensed Matter 60:205–213
Koch C, Marroquin J, Yuille A (1986) Analog “neuronal” networks in early vision. Proc Natl Acad Sci USA 83:4263–4267
Kohonen T (1984) Selforganization and associative memory. Springer, Berlin Heidelberg New York
Kohonen T, Oja E, Lehtiö P (1981) Storage and processing of information in distributed associative memory systems. In: Hinton G, Anderson JA (eds) Parallel models of associative memory. Lawrence Erlbaum Associatives, Hillsdale, New Jersey
Little WA (1974) The existence of persistent States in the brain. Math Biosci 19:101–120
Little WA, Shaw GL (1975) A statistical theory of short and long term memory. Behav Biol 14:115–133
Malsburg Cvd (1981) The correlation theory of brain function. Internal report 81/2, Dept. Neurobiologie, MPI f. Biophysikalische Chemie, Göttingen
Malsburg Cvd (1985) Nervous structures with dynamical links. Ber Bunsenges Phys Chemie 6:703–710
Malsburg Cvd, Bienenstock E (1985) Statistical coding and short-term synaptic plasticity: a scheme for knowledge representation in the brain. In: Bienenstock E, Fogelman Soulié F, Weisbuch G (eds) Disordered systems and biological organization. Springer, Berlin Heidelberg New York, pp 247–272
Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323:533–536
Sampath G, Srinivasan SK (1977) Stochastic models for spike trains of single neurons. Springer, Berlin Heidelberg New York
Schulten K, Schulten Z, Szabo A (1981) Dynamics of reactions involving diffusive barrier crossing. J Chem Phys 74:4426–4432
Shaw G, Vasudevan R (1974) Persistent states of neural networks and the random nature of synaptic transmission. Math Biosci 21:207
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Buhmann, J., Schulten, K. Influence of noise on the function of a “physiological” neural network. Biol. Cybernetics 56, 313–327 (1987). https://doi.org/10.1007/BF00319512
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00319512