Symmetric functional differential equations and neural networks with memory

Wu, Jianhong

doi:10.1090/S0002-9947-98-02083-2

Symmetric functional differential equations and neural networks with memory
HTML articles powered by AMS MathViewer

by Jianhong Wu PDF

Trans. Amer. Math. Soc. 350 (1998), 4799-4838 Request permission

Abstract:

We establish an analytic local Hopf bifurcation theorem and a topological global Hopf bifurcation theorem to detect the existence and to describe the spatial-temporal pattern, the asymptotic form and the global continuation of bifurcations of periodic wave solutions for functional differential equations in the presence of symmetry. We apply these general results to obtain the coexistence of multiple large-amplitude wave solutions for the delayed Hopfield-Cohen-Grossberg model of neural networks with a symmetric circulant connection matrix.

References

J. C. Alexander, Bifurcation of zeroes of parametrized functions, J. Functional Analysis 29 (1978), no. 1, 37–53. MR 499933, DOI 10.1016/0022-1236(78)90045-9
J. C. Alexander and J. F. G. Auchmuty, Global bifurcation of waves, Manuscripta Math. 27 (1979), no. 2, 159–166. MR 526825, DOI 10.1007/BF01299293
J. C. Alexander and Giles Auchmuty, Global bifurcations of phase-locked oscillators, Arch. Rational Mech. Anal. 93 (1986), no. 3, 253–270. MR 827082, DOI 10.1007/BF00281500
J. C. Alexander and P. M. Fitzpatrick, The homotopy of certain spaces of nonlinear operators, and its relation to global bifurcation of the fixed points of parametrized condensing operators, J. Functional Analysis 34 (1979), no. 1, 87–106. MR 551112, DOI 10.1016/0022-1236(79)90027-2
J. C. Alexander and James A. Yorke, Global bifurcations of periodic orbits, Amer. J. Math. 100 (1978), no. 2, 263–292. MR 474406, DOI 10.2307/2373851
Jacques Bélair, Stability in a model of a delayed neural network, J. Dynam. Differential Equations 5 (1993), no. 4, 607–623. MR 1250263, DOI 10.1007/BF01049141
R. D. Braddock and P. van den Driessche, On the stability of differential-difference equations, J. Austral. Math. Soc. Ser. B 19 (1975/76), no. 3, 358–370. MR 447748, DOI 10.1017/S0334270000001211
Shui Nee Chow and John Mallet-Paret, The Fuller index and global Hopf bifurcation, J. Differential Equations 29 (1978), no. 1, 66–85. MR 492560, DOI 10.1016/0022-0396(78)90041-4
Shui Nee Chow, John Mallet-Paret, and James A. Yorke, Global Hopf bifurcation from a multiple eigenvalue, Nonlinear Anal. 2 (1978), no. 6, 753–763. MR 512165, DOI 10.1016/0362-546X(78)90017-2
Michael A. Cohen and Stephen Grossberg, Absolute stability of global pattern formation and parallel memory storage by competitive neural networks, IEEE Trans. Systems Man Cybernet. 13 (1983), no. 5, 815–826. MR 730500, DOI 10.1016/S0166-4115(08)60913-9
E. N. Dancer, Boundary-value problems for ordinary differential equations on infinite intervals, Proc. London Math. Soc. (3) 30 (1975), 76–94. MR 379963, DOI 10.1112/plms/s3-30.1.76
Grzegorz Dylawerski, Kazimierz Gęba, Jerzy Jodel, and Wacław Marzantowicz, An $S^1$-equivariant degree and the Fuller index, Ann. Polon. Math. 52 (1991), no. 3, 243–280. MR 1100987, DOI 10.4064/ap-52-3-243-280
L. H. Erbe, W. Krawcewicz, K. Gęba, and J. Wu, $S^1$-degree and global Hopf bifurcation theory of functional-differential equations, J. Differential Equations 98 (1992), no. 2, 277–298. MR 1170472, DOI 10.1016/0022-0396(92)90094-4
Christian Fenske, Analytische Theorie des Abbildungsgrades für Abbildungen in Banachräumen, Math. Nachr. 48 (1971), 279–290 (German). MR 343113, DOI 10.1002/mana.19710480121
Bernold Fiedler, An index for global Hopf bifurcation in parabolic systems, J. Reine Angew. Math. 359 (1985), 1–36. MR 794797, DOI 10.1515/crll.1985.359.1
Bernold Fiedler, Global bifurcation of periodic solutions with symmetry, Lecture Notes in Mathematics, vol. 1309, Springer-Verlag, Berlin, 1988. MR 947144, DOI 10.1007/BFb0082943
P. M. Fitzpatrick, Homotopy, linearization, and bifurcation, Nonlinear Anal. 12 (1988), no. 2, 171–184. MR 926211, DOI 10.1016/0362-546X(88)90033-8
A. Frumkin and E. Moses, Physicality of the Little model, Physical Review (A), 34 (1986), 714–716.
F. Brock Fuller, An index of fixed point type for periodic orbits, Amer. J. Math. 89 (1967), 133–148. MR 209600, DOI 10.2307/2373103
Kazimierz Gęba, Wiesław Krawcewicz, and Jian Hong Wu, An equivariant degree with applications to symmetric bifurcation problems. I. Construction of the degree, Proc. London Math. Soc. (3) 69 (1994), no. 2, 377–398. MR 1281970, DOI 10.1112/plms/s3-69.2.377
Kazimierz Gęba and Wacław Marzantowicz, Global bifurcation of periodic solutions, Topol. Methods Nonlinear Anal. 1 (1993), no. 1, 67–93. MR 1215259, DOI 10.12775/TMNA.1993.008
Eric Goles Chacc, Françoise Fogelman-Soulié, and Didier Pellegrin, Decreasing energy functions as a tool for studying threshold networks, Discrete Appl. Math. 12 (1985), no. 3, 261–277. MR 813974, DOI 10.1016/0166-218X(85)90029-0
E. Goles and G. Y. Vichniac, Lyapunov functions for parallel neural networks, in “Neural Networks for Computing (J. S. Denber ed.)”, Amer. Inst. Phy., New York (1986), pp. 165–181.
Martin Golubitsky and Ian Stewart, Hopf bifurcation in the presence of symmetry, Arch. Rational Mech. Anal. 87 (1985), no. 2, 107–165. MR 765596, DOI 10.1007/BF00280698
Martin Golubitsky, Ian Stewart, and David G. Schaeffer, Singularities and groups in bifurcation theory. Vol. II, Applied Mathematical Sciences, vol. 69, Springer-Verlag, New York, 1988. MR 950168, DOI 10.1007/978-1-4612-4574-2
G. Grinstein, C. Jayaprakash, and Yu He, Statistical mechanics of probabilistic cellular automata, Phys. Rev. Lett. 55 (1985), no. 23, 2527–2530. MR 819681, DOI 10.1103/PhysRevLett.55.2527
Jack Hale, Theory of functional differential equations, 2nd ed., Applied Mathematical Sciences, Vol. 3, Springer-Verlag, New York-Heidelberg, 1977. MR 0508721
Jack K. Hale, Nonlinear oscillations in equations with delays, Nonlinear oscillations in biology (Proc. Tenth Summer Sem. Appl. Math., Univ. Utah, Salt Lake City, Utah, 1978) Lectures in Appl. Math., vol. 17, Amer. Math. Soc., Providence, R.I., 1979, pp. 157–185. MR 564916
Brian D. Hassard, Nicholas D. Kazarinoff, and Yieh Hei Wan, Theory and applications of Hopf bifurcation, London Mathematical Society Lecture Note Series, vol. 41, Cambridge University Press, Cambridge-New York, 1981. MR 603442
A. Herz, B. Salzer, R. Kühn and J. L. van Hemmen, Hebbian learning reconsidered: representation of static and dynamic objects in associative neural nets, Biol. Cybern. 60 (1989), 457–467.
Georg Hetzer and Volker Stallbohm, Global behavior of bifurcation branches and the essential spectrum, Math. Nachr. 86 (1978), 347–360. MR 532791, DOI 10.1002/mana.19780860125
Morris W. Hirsch, Stability and convergence in strongly monotone dynamical systems, J. Reine Angew. Math. 383 (1988), 1–53. MR 921986, DOI 10.1515/crll.1988.383.1
J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Nat. Acad. Sci. U.S.A. 79 (1982), no. 8, 2554–2558. MR 652033, DOI 10.1073/pnas.79.8.2554
J. J. Hopfield, Neurons with graded response have collective computational properties like those of two-stage neurons, Proc. Nat. Acad. Sci. 81 (1984), 3088–3092.
Jorge Ize, Bifurcation theory for Fredholm operators, Mem. Amer. Math. Soc. 7 (1976), no. 174, viii+128. MR 425696, DOI 10.1090/memo/0174
—, Obstruction theory and multiparameter Hopf bifurcation, Trans. Amer. Math. Soc. 209 (1985), 757–792.
J. Ize, I. Massabò, and A. Vignoli, Degree theory for equivariant maps. I, Trans. Amer. Math. Soc. 315 (1989), no. 2, 433–510. MR 935940, DOI 10.1090/S0002-9947-1989-0935940-8
Jorge Ize, Ivar Massabò, and Alfonso Vignoli, Degree theory for equivariant maps, the general $S^1$-action, Mem. Amer. Math. Soc. 100 (1992), no. 481, x+179. MR 1126179, DOI 10.1090/memo/0481
W. Krawcewicz, P. Vivi and J. Wu, Computation formulae of an equivalent degree with applications to symmetric bifurcations, Nonlinear Studies 4 (1997), 89–120.
W. Krawcewicz and J. Wu, Theory and applications of Hopf bifurcations in symmetric functional differential equations, Nonlinear Analysis, in press.
W. Krawcewicz, J. Wu, and H. Xia, Global Hopf bifurcation theory for condensing fields and neutral equations with applications to lossless transmission problems, Canad. Appl. Math. Quart. 1 (1993), no. 2, 167–220. MR 1226773
B. W. Levinger, A folk theorem in functional differential equations, J. Differential Equations 4 (1968), 612–619. MR 231009, DOI 10.1016/0022-0396(68)90011-9
W. A. Little, Existence of persistent states in the brain, Math. Biosci. 19 (1974), 101–120.
W. A. Little and G. L. Shaw, Analytic study of the memory storage capacity of a neural network, Math. Biosci. 39 (1978), 281–290.
John Mallet-Paret and Roger D. Nussbaum, Global continuation and asymptotic behaviour for periodic solutions of a differential-delay equation, Ann. Mat. Pura Appl. (4) 145 (1986), 33–128. MR 886709, DOI 10.1007/BF01790539
Rudolph E. Langer, The boundary problem of an ordinary linear differential system in the complex domain, Trans. Amer. Math. Soc. 46 (1939), 151–190 and Correction, 467 (1939). MR 84, DOI 10.1090/S0002-9947-1939-0000084-7
C. M. Marcus and R. M. Westervelt, Stability of analog neural networks with delay, Phys. Rev. A (3) 39 (1989), no. 1, 347–359. MR 978323, DOI 10.1103/PhysRevA.39.347
Roger D. Nussbaum, A global bifurcation theorem with applications to functional differential equations, J. Functional Analysis 19 (1975), no. 4, 319–338. MR 0385656, DOI 10.1016/0022-1236(75)90061-0
Roger D. Nussbaum, A Hopf global bifurcation theorem for retarded functional differential equations, Trans. Amer. Math. Soc. 238 (1978), 139–164. MR 482913, DOI 10.1090/S0002-9947-1978-0482913-0
Roger D. Nussbaum, Circulant matrices and differential-delay equations, J. Differential Equations 60 (1985), no. 2, 201–217. MR 810552, DOI 10.1016/0022-0396(85)90113-5
Paul H. Rabinowitz, Some global results for nonlinear eigenvalue problems, J. Functional Analysis 7 (1971), 487–513. MR 0301587, DOI 10.1016/0022-1236(71)90030-9
Hal Smith, Monotone semiflows generated by functional-differential equations, J. Differential Equations 66 (1987), no. 3, 420–442. MR 876806, DOI 10.1016/0022-0396(87)90027-1
C. A. Stuart, Some bifurcation theory for $k$-set contractions, Proc. London Math. Soc. (3) 27 (1973), 531–550. MR 333856, DOI 10.1112/plms/s3-27.3.531
A. Vanderbauwhede, Local bifurcation and symmetry, Research Notes in Mathematics, vol. 75, Pitman (Advanced Publishing Program), Boston, MA, 1982. MR 697724
J. Wu and W. Krawcewicz, Discrete waves and phase-locked oscillations in the growth of a single-species population over a patchy environment, Open Systems and Information Dynamics 1 (1992), 127–147.