The neural network as a renormalizer of information
Author:
Willard L. Miranker
Journal:
Quart. Appl. Math. 66 (2008), 379-394
MSC (2000):
Primary 91E30, 46N60
DOI:
https://doi.org/10.1090/S0033-569X-08-01073-4
Published electronically:
February 8, 2008
MathSciNet review:
2416779
Full-text PDF Free Access
Abstract |
References |
Similar Articles |
Additional Information
Abstract: We characterize the behavior of information in neural processing as the neuronal circuitry itself agglomerates into assemblies of increasing size and complexity. The basic synaptic stage of this processing is interpreted as the observer feature of a measurement process, a quality that extends up the assembly hierarchy. Renormalization techniques are employed, and they supply features of emergence to the information. Renormalization also supplies each observer feature with a measurable physical quantity called a token, the latter supplying quantitative aspects to the entire development. This development is used to frame an analytic theory of phenomenal consciousness, featuring emergent aspects. The tokens furnish the means for the various predictions and explanations of that theory to be subjected to measurement and experimental verification.
References
- Daniel J. Amit, Modeling brain function, Cambridge University Press, Cambridge, 1989. The world of attractor neural networks. MR 1025121
- Amit, D., Gutfreund, H., Sompolinsky, H. (1987), Statistical Mechanics of Neural Networks near Saturation, Annals of Physics 173, 30-67.
- Beckermann, M. (1997), Adaptive Cooperative Systems, Wiley, New York.
- Chalmers, D. (1996), The Conscious Mind: In Search of a Fundamental Theory, Oxford Univ. Press.
- Churchland, P. M. (1984), Matter and Consciousness, MIT Press, Cambridge.
- Damasio, A. (1994), Descartes Error, Grosset/Putnam, New York.
- Dennett, D. (1996), Kinds of Minds, Toward an Understanding of Consciousness, Basic Books, New York.
- Descartes, R. (1637), Discours sur la Méthode.
- Edelman, G., Tononi, G. (2001), A Universe of Consciousness: How Matter Becomes Imagination, Basic Books, New York.
- Einstein, A., Podolsky, B., Rosen, N. (1935), Can Quantum-Mechanical Description of Physical Reality be Considered Complete?, Phys. Rev. 47, 777-780.
- Fransen, E., Lansner, A. (1995), Low spiking rates in a population of mutually exciting pyramidal cells, Network 6, 271-288.
- ---(1998), A model of cortical associative memory based on a horizontal network of connected columns, Network 9, 235-264.
- Freeman, A., Ed. (2001), The Emergence of Consciousness, J. Consc. Studies 8, 9-10.
- Goldenfeld, N. (1992), Lectures on Phase Transitions and the Renormalization Group, Addison-Wesley, Reading, MA.
- Hermann Haken, Synergetic computers and cognition, 2nd ed., Springer Series in Synergetics, vol. 50, Springer-Verlag, Berlin, 2004. A top-down approach to neural nets. MR 2081217
- Haykin, S. (1999), Neural Networks, A Comprehensive Foundation, Prentice Hall, Upper Saddle River, NJ.
- Hebb, D. (1939), Intelligence in man after large removals of cerebral tissue: Report of four left frontal lobe cases, J. Gen. Psychol., 73-87.
- ---(1946), On the nature of fear, Physiol. Rev. 53, 259-276.
- ---(1949), Organization of Behavior: A Neurophysiological Theory, Wiley, NY.
- ---(1980a), The structure of thought, in The Nature of Thought, P.Jusczyk and R.Klein, Eds., Lawrence Erlbaum Associates, Hillsdale, NJ.
- ---(1980b), Essay on Mind, Lawrence Erlbaum Associates, Hillsdale, NJ.
- John Hertz, Anders Krogh, and Richard G. Palmer, Introduction to the theory of neural computation, Santa Fe Institute Studies in the Sciences of Complexity. Lecture Notes, I, Addison-Wesley Publishing Company, Advanced Book Program, Redwood City, CA, 1991. With forewords by Jack Cowan and Christof Koch. MR 1096298
- J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Nat. Acad. Sci. U.S.A. 79 (1982), no. 8, 2554–2558. MR 652033, DOI https://doi.org/10.1073/pnas.79.8.2554
- Johnston, V. (1999), Why We Feel, The Science of Human Emotion, Perseus, Cambridge, MA.
- Kadanoff, L. (1966), Scaling laws for Ising models near $Tc$, Physics, vol. 2, pp. 263-272.
- Kandel, E.R., Schwartz, J.H., Jessel, T.M. (2000), Principles of Neural Science, 4th ed., McGraw-Hill/Appleton & Lange, New York.
- Libet, B. (2003), Neurophysiology of Consciousness: Selected Papers and New Essays by Benjamin Libet, Birkhäuser, Boston.
- Llinas, R. (2001), i of the Vortex, MIT Press, Cambridge.
- Henry Margenau, The Nature of Physical Reality. A Philosophy of Modern Physics, McGraw-Hill Book Co., Inc., New York, N. Y., 1950. MR 0035258
- Henry Margenau, Physics and philosophy: selected essays, Episteme, vol. 6, D. Reidel Publishing Co., Dordrecht-Boston, Mass., 1978. MR 529767
- Warren S. McCulloch and Walter Pitts, A logical calculus of the ideas immanent in nervous activity, Bull. Math. Biophys. 5 (1943), 115–133. MR 10388, DOI https://doi.org/10.1007/bf02478259
- McDermott, D. (2001), Mind and Mechanism, MIT Press, Cambridge.
- Marc Mézard, Giorgio Parisi, and Miguel Angel Virasoro, Spin glass theory and beyond, World Scientific Lecture Notes in Physics, vol. 9, World Scientific Publishing Co., Inc., Teaneck, NJ, 1987. MR 1026102
- Milner, P. (1957), The cell assembly: Mark II, Psychol. Rev. 64, 242-252.
- Miranker, W.L. (2000), Consciousness is an information state, J. Neural Parallel and Scientific Computation 8, 83-104.
- ---(2001), The Renormalization of Information, Yale Univ. DCS/TR-1215.
- ---(2005), Consciousness, A Darwinian Process, Yale Univ. DCS/TR-1344.
- O’Donnell, P., Greene, J., Pabello, N., Lewis, B., Grace, A. (1999), Modulation of cell firing in the nucleus accumbens, Annals of the NY Academy of Sciences 877, 157-175.
- Roger Penrose, Shadows of the mind, Oxford University Press, Oxford, 1994. A search for the missing science of consciousness. MR 1865778
- Mitja Peruš, Multi-level synergetic computation in brain, Nonlinear Phenom. Complex Syst. 4 (2001), no. 2, 157–193. MR 1886860
- Rakovi, D., Dugi, M. (2005), Quantum-holographic classical Hopfield-like associative nets: Implications for modeling two cognitive modes of consciousness, Opticheski J. 75, 13-18 (Special issue on Topical Meeting on Optoinformatics ‘Optics Meets —’ Saint Petersburg (2004); also www.iasc-bg.org.yu.
- Rolls, E., Treves, A. (1999), Neural Networks and Brain Function, Oxford Univ. Press, Oxford.
- Searle, J. (1994), The Rediscovery of the Mind, MIT Press, Cambridge.
- Sheets-Johnstone, M. (1998), Consciousness; a natural history, J. Consc. Studies 3, 260-294.
- Stapp, H. (1998), The Hard problem: a quantum approach, J. Consc. Studies 3, 194-210.
- Thompson, M., Varela, F. (2001), Radical embodiments: neural dynamics and consciousness experiences, Trends in Cognitive Sciences 5, 418-425.
- Velmans, M. (2000), Understanding Consciousness, Routledge, London.
- Wilson, K. (1971), Renormalization group and critical phenomena I & II, Phys. Rev. B4, 3174-3183 and 3184-3205.
References
- Amit, D. (1989), Modeling Brain Function, The World of Attractor Neural Networks, Cambridge Univ. Press. MR 1025121 (90k:92003)
- Amit, D., Gutfreund, H., Sompolinsky, H. (1987), Statistical Mechanics of Neural Networks near Saturation, Annals of Physics 173, 30-67.
- Beckermann, M. (1997), Adaptive Cooperative Systems, Wiley, New York.
- Chalmers, D. (1996), The Conscious Mind: In Search of a Fundamental Theory, Oxford Univ. Press.
- Churchland, P. M. (1984), Matter and Consciousness, MIT Press, Cambridge.
- Damasio, A. (1994), Descartes Error, Grosset/Putnam, New York.
- Dennett, D. (1996), Kinds of Minds, Toward an Understanding of Consciousness, Basic Books, New York.
- Descartes, R. (1637), Discours sur la Méthode.
- Edelman, G., Tononi, G. (2001), A Universe of Consciousness: How Matter Becomes Imagination, Basic Books, New York.
- Einstein, A., Podolsky, B., Rosen, N. (1935), Can Quantum-Mechanical Description of Physical Reality be Considered Complete?, Phys. Rev. 47, 777-780.
- Fransen, E., Lansner, A. (1995), Low spiking rates in a population of mutually exciting pyramidal cells, Network 6, 271-288.
- ---(1998), A model of cortical associative memory based on a horizontal network of connected columns, Network 9, 235-264.
- Freeman, A., Ed. (2001), The Emergence of Consciousness, J. Consc. Studies 8, 9-10.
- Goldenfeld, N. (1992), Lectures on Phase Transitions and the Renormalization Group, Addison-Wesley, Reading, MA.
- Haken, H. (2004), Synergetic Computers and Cognition, Springer, New York. MR 2081217 (2005e:68207)
- Haykin, S. (1999), Neural Networks, A Comprehensive Foundation, Prentice Hall, Upper Saddle River, NJ.
- Hebb, D. (1939), Intelligence in man after large removals of cerebral tissue: Report of four left frontal lobe cases, J. Gen. Psychol., 73-87.
- ---(1946), On the nature of fear, Physiol. Rev. 53, 259-276.
- ---(1949), Organization of Behavior: A Neurophysiological Theory, Wiley, NY.
- ---(1980a), The structure of thought, in The Nature of Thought, P.Jusczyk and R.Klein, Eds., Lawrence Erlbaum Associates, Hillsdale, NJ.
- ---(1980b), Essay on Mind, Lawrence Erlbaum Associates, Hillsdale, NJ.
- Hertz, J., Krogh, A., Palmer, R. (1991), Introduction to the Theory of Neural Computation, Addison-Wesley, Redwood City, CA. MR 1096298 (92f:82044)
- Hopfield, J. (1982), Neural networks and physical systems with emergent collective computation abilities, PNAS, USA 79, 2254-2258. MR 652033 (83g:92024)
- Johnston, V. (1999), Why We Feel, The Science of Human Emotion, Perseus, Cambridge, MA.
- Kadanoff, L. (1966), Scaling laws for Ising models near $Tc$, Physics, vol. 2, pp. 263-272.
- Kandel, E.R., Schwartz, J.H., Jessel, T.M. (2000), Principles of Neural Science, 4th ed., McGraw-Hill/Appleton & Lange, New York.
- Libet, B. (2003), Neurophysiology of Consciousness: Selected Papers and New Essays by Benjamin Libet, Birkhäuser, Boston.
- Llinas, R. (2001), i of the Vortex, MIT Press, Cambridge.
- Margenau, H. (1950), The Nature of Physical Reality: A Philosophy of Modern Physics, McGraw-Hill, New York. MR 0035258 (11:709h)
- ---(1978), Physics and Philosophy: Selected Essays , Dordrecht, Boston. MR 0529767 (80c:01020)
- McCullough, W., Pitts, W. (1943), A logical calculus of the ideas immanent in nervous activity, Bull. Math. Biophysics 5, 115-133. MR 0010388 (6:12a)
- McDermott, D. (2001), Mind and Mechanism, MIT Press, Cambridge.
- Mezard, M., Parisi, G., Virasoro, M. (1987), Spin Glass Theory and Beyond, Singapore, World Scientific. MR 1026102 (91k:82066)
- Milner, P. (1957), The cell assembly: Mark II, Psychol. Rev. 64, 242-252.
- Miranker, W.L. (2000), Consciousness is an information state, J. Neural Parallel and Scientific Computation 8, 83-104.
- ---(2001), The Renormalization of Information, Yale Univ. DCS/TR-1215.
- ---(2005), Consciousness, A Darwinian Process, Yale Univ. DCS/TR-1344.
- O’Donnell, P., Greene, J., Pabello, N., Lewis, B., Grace, A. (1999), Modulation of cell firing in the nucleus accumbens, Annals of the NY Academy of Sciences 877, 157-175.
- Penrose, R. (1994), Shadows of the Mind, Oxford University Press, Oxford. MR 1865778 (2002g:00003)
- Perus, M. (2001), Multi-level synergetic computation in brain, Nonlinear Phenomena in Complex Systems 4, 157-193; cf. also www.iasc-bg.org.yu. MR 1886860 (2003e:92003)
- Rakovi, D., Dugi, M. (2005), Quantum-holographic classical Hopfield-like associative nets: Implications for modeling two cognitive modes of consciousness, Opticheski J. 75, 13-18 (Special issue on Topical Meeting on Optoinformatics ‘Optics Meets —’ Saint Petersburg (2004); also www.iasc-bg.org.yu.
- Rolls, E., Treves, A. (1999), Neural Networks and Brain Function, Oxford Univ. Press, Oxford.
- Searle, J. (1994), The Rediscovery of the Mind, MIT Press, Cambridge.
- Sheets-Johnstone, M. (1998), Consciousness; a natural history, J. Consc. Studies 3, 260-294.
- Stapp, H. (1998), The Hard problem: a quantum approach, J. Consc. Studies 3, 194-210.
- Thompson, M., Varela, F. (2001), Radical embodiments: neural dynamics and consciousness experiences, Trends in Cognitive Sciences 5, 418-425.
- Velmans, M. (2000), Understanding Consciousness, Routledge, London.
- Wilson, K. (1971), Renormalization group and critical phenomena I & II, Phys. Rev. B4, 3174-3183 and 3184-3205.
Similar Articles
Retrieve articles in Quarterly of Applied Mathematics
with MSC (2000):
91E30,
46N60
Retrieve articles in all journals
with MSC (2000):
91E30,
46N60
Additional Information
Willard L. Miranker
Affiliation:
Department of Computer Science, Yale University, New Haven, CT
Keywords:
Consciousness,
dualist construct,
emergence,
Hebbian dynamics,
measurement,
neural networks,
phase change,
renormalization
Received by editor(s):
January 4, 2007
Published electronically:
February 8, 2008
Article copyright:
© Copyright 2008
Brown University
The copyright for this article reverts to public domain 28 years after publication.
