Available in electronic format
Available in print format
Theory of Probability and Mathematical Statistics
Theory of Probability and Mathematical Statistics
ISSN: 1547-7363(e) 0094-9000(p)
     

The asymptotic behavior of threshold-based classification rules constructed from a sample from a mixture with varying concentrations

Author(s): Yu. Ivan'ko; R. Maiboroda
Translated by: Oleg Klesov
Original publication: Teoriya Imovirnostei ta Matematichna Statistika, vipusk 74 (2006).
Journal: Theor. Probability and Math. Statist. No. 74 (2007), 37-47.
MSC (2000): Primary 62H30; Secondary 62G07
Posted: June 25, 2007
Retrieve article in: PDF DVI PostScript

Abstract | References | Similar articles | Additional information

Abstract: We consider a problem on finding the best threshold-based classification rule constructed from a sample from a mixture with varying concentrations. We show that the rate of convergence of the minimal empirical risk estimators to the optimal threshold is of order $ N^{-1/3}$ for smooth distributions, while the rate of convergence of the Bayes empirical estimators is of order $ N^{-2/5}$ where $ N$ is the size of a sample.


References:

1.
P. Billingsley, Convergence of Probability Measures, John Wiley & Sons, Inc., New York, 1968. MR 0233396 (38:1718)

2.
V. N. Vapnik, Inductive principles for the search for empirical laws, Pattern Recognition. Classification. Prediction, vol. 1, ``Nauka'', Moscow, 1989, pp. 17-81. (Russian) MR 1074215 (92e:68170)

3.
L. Devroye and L. Gyorfi, Nonparametric Density Estimation. The $ L_1$ View, John Wiley & Sons, Inc., New York, 1985. MR 780746 (86i:62065)

4.
R. E. Ma{\u{\i\/}}\kern.15emboroda, Statistical Analysis of Mixtures. A course of lectures, ``Kyiv University'', Kyiv, 2003. (Ukrainian)

5.
Yu. O. Ivan'ko and R. E. Ma{\u{\i\/}}\kern.15emboroda, Exponential estimates for the empirical Bayes risk in the classification of a mixture with varying concentrations, Ukrain. Mat. Zh. 54 (2002), no. 10, 1421-1428; English transl. in Ukrainian Math. J. 54 (2002), no. 10, 1722-1731. MR 2015493 (2004g:62022)

6.
Yu. O. Ivan'ko, The asymptotic behavior of kernel estimators and their derivatives constructed from observations from a mixture with varying concentrations, Visnyk KNU, Ser. Matematika. Mekhanika (2003), no. 9-10, 29-35.

7.
O. V. Sugakova, Asymptotics of a kernel estimate for distribution density constructed from observations of a mixture with varying concentrations, Teor. Imovirnost. Matem. Statist. 59 (1998), 156-166; English transl. in Theor. Probability Math. Statist. 59 (1999), 161-171. MR 1793776

8.
H. Chernoff, Estimation of the mode, Ann. Inst. Statist. Math. 16 (1964), 31-41. MR 0172382 (30:2601)

9.
L. Mohammadi and S. van de Geer, On threshold-based classification rules, Lecture Notes Monograph Series, Mathematical Statistics and Applications: Festschrift for Constance van Eeden, vol. 42, Institute of Mathematical Statistics, 2003, pp. 261-280. MR 2138297 (2006b:62106)

10.
J. Kim and D. Pollard, Cube root asymptotics, Ann. Stat. 18 (1990), no. 1, 191-219. MR 1041391 (91f:62059)

11.
V. N. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, 1996. MR 1719582 (2001c:68110)


Similar Articles:

Retrieve articles in Theory of Probability and Mathematical Statistics with MSC (2000): 62H30, 62G07

Retrieve articles in all Journals with MSC (2000): 62H30, 62G07


Additional Information:

Yu. Ivan'ko
Affiliation: SK Lemma-Vite, Brats'ka Street, Kyiv, 6, 04070 Ukraine
Email: ivanko@lemma-insur.com.ua

R. Maiboroda
Affiliation: Department of Probability Theory and Mathematical Statistics, Faculty for Mathematics and Mechanics, National Taras Shevchenko University, Glushkov Avenue, 6, Kyiv, 03127, Ukraine
Email: mre@univ.kiev.ua

DOI: 10.1090/S0094-9000-07-00696-5
PII: S 0094-9000(07)00696-5
Keywords: Minimization of the empirical risk, kernel estimators of densities, Bayes empirical classification rule, estimates of components of a mixture, mixtures with varying concentrations
Received by editor(s): 20/DEC/2004
Posted: June 25, 2007
Copyright of article: Copyright 2007, American Mathematical Society


  AMS Website Logo Small Comments: webmaster@ams.org
© Copyright 2008, American Mathematical Society
Privacy Statement
Search the AMSPowered by Google