An extended Čencov characterization of the information metric
HTML articles powered by AMS MathViewer
- by L. L. Campbell PDF
- Proc. Amer. Math. Soc. 98 (1986), 135-141 Request permission
Abstract:
Čencov has shown that Riemannian metrics which are derived from the Fisher information matrix are the only metrics which preserve inner products under certain probabilistically important mappings. In Čencov’s theorem, the underlying differentiable manifold is the probability simplex $\Sigma _1^n{x_i} = 1, x_i > 0$. For some purposes of using geometry to obtain insights about probability, it is more convenient to regard the simplex as a hypersurface in the positive cone. In the present paper Čencov’s result is extended to the positive cone. The proof uses standard techniques of differential geometry but does not use the language of category theory.References
- J. Aczél and Z. Daróczy, On measures of information and their characterizations, Mathematics in Science and Engineering, Vol. 115, Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1975. MR 0689178
- Shun-ichi Amari, Differential geometry of curved exponential families—curvatures and information loss, Ann. Statist. 10 (1982), no. 2, 357–385. MR 653513
- L. L. Campbell, The relation between information theory and the differential geometry approach to statistics, Inform. Sci. 35 (1985), no. 3, 199–210. MR 811107, DOI 10.1016/0020-0255(85)90050-7 N. N. Čencov, Statistical decision rules and optimal inference, Transl. Math. Monographs, vol. 53, Amer. Math. Soc., Providence, R. I., 1981.
- David C. Hamilton, Donald G. Watts, and Douglas M. Bates, Accounting for intrinsic nonlinearity in nonlinear regression parameter inference regions, Ann. Statist. 10 (1982), no. 2, 386–393. MR 653514
- Noel J. Hicks, Notes on differential geometry, Van Nostrand Mathematical Studies, No. 3, D. Van Nostrand Co., Inc., Princeton, N.J.-Toronto-London, 1965. MR 0179691
- Roman S. Ingarden, Yoshiharu Sato, Kazuaki Sugawa, and Michiaki Kawaguchi, Information thermodynamics and differential geometry, Tensor (N.S.) 33 (1979), no. 3, 347–353. MR 577590
- A. I. Khinchin, Mathematical foundations of information theory, Dover Publications, Inc., New York, N.Y., 1957. Translated by R. A. Silverman and M. D. Friedman. MR 0092709
- S. Shahshahani, A new mathematical framework for the study of linkage and selection, Mem. Amer. Math. Soc. 17 (1979), no. 211, ix+34. MR 512476, DOI 10.1090/memo/0211
Additional Information
- © Copyright 1986 American Mathematical Society
- Journal: Proc. Amer. Math. Soc. 98 (1986), 135-141
- MSC: Primary 62B10; Secondary 53B99
- DOI: https://doi.org/10.1090/S0002-9939-1986-0848890-5
- MathSciNet review: 848890