Asymptotics of empirical Bayes risk in the classification of a mixture of two components with varying concentrations
Author:
Yu. O. Ivan’ko
Translated by:
Oleg Klesov
Journal:
Theor. Probability and Math. Statist. 70 (2005), 53-60
MSC (2000):
Primary 62H30; Secondary 62C10, 62C12
DOI:
https://doi.org/10.1090/S0094-9000-05-00630-7
Published electronically:
August 26, 2005
MathSciNet review:
2109822
Full-text PDF Free Access
Abstract |
References |
Similar Articles |
Additional Information
Abstract: We consider the problem of classification for a sample from a mixture of several components. For the problem of classification of a two-component mixture with the space of characteristics $\Re =[a,b] \subset \mathbf R$ and smooth distribution densities, we find the precise rate of convergence for the error $L_N$ of the empirical Bayes classifier $g_N$ to the error $L^\ast$ of the Bayes classifier, namely we prove that \[ N^{4 / 5}(L_N-L^\ast ) \Rightarrow [A+B\varsigma ]^2 \] where $\varsigma$ is a standard normal random variable, and the empirical Bayes classifier $g_N$ is constructed from the kernel estimator of the density of a mixture with varying concentrations. We prove that the kernel estimator with the Epanechnikov kernel is optimal for the empirical Bayes classifier.
References
- O. V. Sugakova, Asymptotics of a kernel estimate for the density of a distribution constructed from observations of a mixture with varying concentration, Teor. Ĭmovīr. Mat. Stat. 59 (1998), 156–166 (Ukrainian, with Ukrainian summary); English transl., Theory Probab. Math. Statist. 59 (1999), 161–171 (2000). MR 1793776
- R. Ē. Maĭboroda, Estimation of the distributions of the components of mixtures having varying concentrations, Ukraïn. Mat. Zh. 48 (1996), no. 4, 558–562 (Ukrainian, with English and Ukrainian summaries); English transl., Ukrainian Math. J. 48 (1996), no. 4, 618–622 (1997). MR 1417019, DOI https://doi.org/10.1007/BF02390622
- Luc Devroye and László Györfi, Nonparametric density estimation, Wiley Series in Probability and Mathematical Statistics: Tracts on Probability and Statistics, John Wiley & Sons, Inc., New York, 1985. The $L_1$ view. MR 780746
- Yu. O. Īvan′ko and R. Ē. Maĭboroda, Exponential estimates for the empirical Bayes risk in the classification of a mixture with varying concentrations, Ukraïn. Mat. Zh. 54 (2002), no. 10, 1421–1428 (Ukrainian, with English and Ukrainian summaries); English transl., Ukrainian Math. J. 54 (2002), no. 10, 1722–1731. MR 2015493, DOI https://doi.org/10.1023/A%3A1023792522291
- Yu. O. Ivan’ko, Asymptotic behavior of kernel estimators of densities and their derivatives constructed from samples with varying concentrations, Visnyk Kyiv. Univer. 9 (2003), 29–35. (Ukrainian)
- R. E. Maĭboroda, Statistical Analysis of Mixtures, Kyiv University, Kyiv, 2003. (Ukrainian)
- A. A. Borovkov, Teoriya veroyatnosteĭ, 2nd ed., “Nauka”, Moscow, 1986 (Russian). MR 891184
- V. V. Anisimov and A. V. Seilhamer, Asymptotic properties of extreme sets of random fields, Teor. Ĭmovīr. Mat. Stat. 51 (1994), 30–38 (Ukrainian, with Ukrainian summary); English transl., Theory Probab. Math. Statist. 51 (1995), 29–38 (1996). MR 1445049
References
- O. V. Sugakova, Asymptotics of a kernel estimate for distribution density constructed from observations of a mixture with varying concentrations, Teor. Imovirnost. ta Matem. Statist. 59 (1998), 156–166; English transl. in Theor. Probability Math. Statist. 59 (1999), 161–171. MR 1793776
- R. E. Maĭboroda, Estimators of components of a mixture with varying concentrations, Ukrain. Mat. Zh. 48 (1996), no. 4, 562–566; English transl. in Ukrainian Math. J. 48 (1996) no. 4, 618–622. MR 1417019 (97j:62055)
- L. Devroye and L. Györfi, Nonparametric Density Estimation. The $L_1$-View, Wiley, New York, 1985. MR 0780746 (86i:62065)
- Yu. O. Ivan’ko and R. E. Maĭboroda, Exponential estimates for the empirical Bayes risk in the classification of a mixture with varying concentrations, Ukrain. Mat. Zh. 54 (2002), no. 10, 1421–1428; English transl. in Ukrainian Math. J. 54 (2002), no. 10, 1722–1731. MR 2015493 (2004g:62022)
- Yu. O. Ivan’ko, Asymptotic behavior of kernel estimators of densities and their derivatives constructed from samples with varying concentrations, Visnyk Kyiv. Univer. 9 (2003), 29–35. (Ukrainian)
- R. E. Maĭboroda, Statistical Analysis of Mixtures, Kyiv University, Kyiv, 2003. (Ukrainian)
- A. A. Borovkov, Probability Theory, “Nauka”, Moscow, 1986; English transl., Gordon and Breach, Amsterdam, 1998. MR 0891184 (88c:60001); MR 1711261 (2000f:60001)
- V. V. Anisimov and A. V. Seilhamer, Asymptotic properties of extreme sets of random fields, Teor. Imovirnost. ta Matem. Statist. 51 (1994), pp. 30–38; English transl. in Theor. Probability Math. Statist. 51 (1995), 29–38. MR 1445049 (97m:60070)
Similar Articles
Retrieve articles in Theory of Probability and Mathematical Statistics
with MSC (2000):
62H30,
62C10,
62C12
Retrieve articles in all journals
with MSC (2000):
62H30,
62C10,
62C12
Additional Information
Yu. O. Ivan’ko
Affiliation:
Department of Probability Theory and Mathematical Statistics, Kyiv National Taras Shevchenko University, Academician Glushkov Avenue 6, Kyiv 03127, Ukraine
Email:
ivanko@lemma-insur.com.ua
Received by editor(s):
April 4, 2003
Published electronically:
August 26, 2005
Article copyright:
© Copyright 2005
American Mathematical Society