Interpolation of stationary sequences observed with a noise
Authors:
M. P. Moklyachuk and M. I. Sidei
Translated by:
S. Kvasko
Journal:
Theor. Probability and Math. Statist. 93 (2016), 153-167
MSC (2010):
Primary 60G10, 60G25, 60G35; Secondary 62M20, 93E10, 93E11
DOI:
https://doi.org/10.1090/tpms/1000
Published electronically:
February 7, 2017
MathSciNet review:
3553447
Full-text PDF Free Access
Abstract |
References |
Similar Articles |
Additional Information
Abstract: The problem of optimal linear estimation of the functional \[ A_s\xi =\sum _{l=0}^{s-1}\sum _{j=M_l}^{M_l+N_{l+1}}a(j)\xi (j), \qquad M_l=\sum _{k=0}^l (N_k+K_k), \qquad N_0=K_0=0, \] which depends on unknown values of a stochastic stationary sequence $\xi (j)$ with the help of observations of the sequence $\xi (j)+\eta (j)$ at points $j\in \mathbb {Z}\setminus S$, where $S=\bigcup _{l=0}^{s-1}\{ M_{l}, \dots , M_{l}+N_{l+1} \}$, is considered under the assumption that the sequences $\{\xi (j)\}$ and $\{\eta (j)\}$ are mutually uncorrelated. Formulas for calculating the mean-square error and spectral characteristic of the optimal linear estimator of the functional are proposed under the condition of spectral certainty, where both spectral densities of the sequences $\xi (j)$ and $\eta (j)$ are known. The minimax (robust) method of estimation is applied in the case where the spectral densities of the sequences $\xi (j)$ and $\eta (j)$ are not known exactly, but the sets of admissible spectral densities are given. Formulas that determine the least favorable spectral densities and minimax spectral characteristics are proposed for some special sets of admissible densities.
References
- Pascal Bondon, Influence of missing values on the prediction of a stationary time series, J. Time Ser. Anal. 26 (2005), no. 4, 519–525. MR 2188831, DOI 10.1111/j.1467-9892.2005.00433.x
- Pascal Bondon, Prediction with incomplete past of a stationary process, Stochastic Process. Appl. 98 (2002), no. 1, 67–76. MR 1884924, DOI 10.1016/S0304-4149(01)00116-8
- R. Cheng, A. G. Miamee, and M. Pourahmadi, Some extremal problems in $L^p(w)$, Proc. Amer. Math. Soc. 126 (1998), no. 8, 2333–2340. MR 1443377, DOI 10.1090/S0002-9939-98-04275-0
- Ī. Ī. Dubovets′ka, O. Yu. Masyutka, and M. P. Moklyachuk, Interpolation of periodically correlated stochastic sequences, Teor. Ĭmovīr. Mat. Stat. 84 (2011), 43–56 (Ukrainian, with English, Russian and Ukrainian summaries); English transl., Theory Probab. Math. Statist. 84 (2012), 43–56. MR 2857415, DOI 10.1090/S0094-9000-2012-00862-4
- Jürgen Franke, Minimax-robust prediction of discrete time series, Z. Wahrsch. Verw. Gebiete 68 (1985), no. 3, 337–364. MR 771471, DOI 10.1007/BF00532645
- Jürgen Franke and H. Vincent Poor, Minimax-robust filtering and finite-length robust predictors, Robust and nonlinear time series analysis (Heidelberg, 1983) Lect. Notes Stat., vol. 26, Springer, New York, 1984, pp. 87–126. MR 786305, DOI 10.1007/978-1-4615-7821-5_{6}
- Iosif I. Gikhman and Anatoli V. Skorokhod, The theory of stochastic processes. I, Classics in Mathematics, Springer-Verlag, Berlin, 2004. Translated from the Russian by S. Kotz; Reprint of the 1974 edition. MR 2058259
- I. I. Golichenko and M. P. Moklyachuk, Estimates of Functionals of Periodically Correlated Processes, “Interservis”, Kyiv, 2014. (Ukrainian)
- Ulf Grenander, A prediction problem in game theory, Ark. Mat. 3 (1957), 371–379. MR 90486, DOI 10.1007/BF02589429
- E. J. Hannan, Multiple time series, John Wiley and Sons, Inc., New York-London-Sydney, 1970. MR 0279952
- A. D. Ioffe and V. M. Tikhomirov, Teoriya èkstremal′nykh zadach, Seriya “Nelineĭ nyĭ Analiz i ego Prilozheniya”. [Series in Nonlinear Analysis and its Applications], Izdat. “Nauka”, Moscow, 1974 (Russian). MR 0410502
- Kari Karhunen, Über lineare Methoden in der Wahrscheinlichkeitsrechnung, Ann. Acad. Sci. Fennicae Ser. A. I. Math.-Phys. 1947 (1947), no. 37, 79 (German). MR 23013
- Yukio Kasahara, Mohsen Pourahmadi, and Akihiko Inoue, Duals of random vectors and processes with applications to prediction problems with missing values, Statist. Probab. Lett. 79 (2009), no. 14, 1637–1646. MR 2547424, DOI 10.1016/j.spl.2009.04.005
- S. A. Kassam and H. V. Poor, Robust techniques for signal processing: A survey, Proc. IEEE 73 (1985), no. 3, 433–481.
- A. N. Kolmogorov, Selected works. Vol. II, Mathematics and its Applications (Soviet Series), vol. 26, Kluwer Academic Publishers Group, Dordrecht, 1992. Probability theory and mathematical statistics; With a preface by P. S. Aleksandrov; Translated from the Russian by G. Lindquist; Translation edited by A. N. Shiryayev [A. N. Shiryaev]. MR 1153022
- M. G. Kreĭn and A. A. Nudel′man, The Markov moment problem and extremal problems, Translations of Mathematical Monographs, Vol. 50, American Mathematical Society, Providence, R.I., 1977. Ideas and problems of P. L. Čebyšev and A. A. Markov and their further development; Translated from the Russian by D. Louvish. MR 0458081
- M. M. Luz and M. P. Moklyachuk, Interpolation of functionals of stochastic sequences with stationary increments, Theory Probab. Math. Statist. 87 (2013), 117–133. Translation of Teor. Ǐmovīr. Mat. Stat. No. 87 (2012), 105–119. MR 3241450, DOI 10.1090/S0094-9000-2014-00908-4
- M. P. Moklyachuk, Robust procedures in time series analysis, Theory Stoch. Process. 6 (2000), no. 3–4, 127–147.
- M. P. Moklyachuk, Robust Estimators of Functionals of Stochastic Processes, “Kyiv University”, Kyiv, 2008.
- M. Moklyachuk and O. Masyutka, Minimax-Robust Estimation Technique for Stationary Stochastic Processes, LAP LAMBERT Academic Publishing, 2012.
- Mikhail Moklyachuk and Maria Sidei, Interpolation problem for stationary sequences with missing observations, Stat. Optim. Inf. Comput. 3 (2015), no. 3, 259–275. MR 3393307, DOI 10.19139/149
- Takahiko Nakazi, Two problems in prediction theory, Studia Math. 78 (1984), no. 1, 7–14. MR 766702, DOI 10.4064/sm-78-1-7-14
- Mohsen Pourahmadi, Akihiko Inoue, and Yukio Kasahara, A prediction problem in $L^2(w)$, Proc. Amer. Math. Soc. 135 (2007), no. 4, 1233–1239. MR 2262930, DOI 10.1090/S0002-9939-06-08575-3
- B. N. Pshenichnyĭ, Neobkhodimye usloviya èkstremuma, Optimizatsiya i Issledovanie Operatsiĭ. [Optimization and Operations Research], “Nauka”, Moscow, 1982 (Russian). MR 686452
- Yu. A. Rozanov, Statsionarnye sluchaĭ nye protsessy, 2nd ed., Teoriya Veroyatnosteĭ i Matematicheskaya Statistika [Probability Theory and Mathematical Statistics], vol. 42, “Nauka”, Moscow, 1990 (Russian). MR 1090826
- R. Tyrrell Rockafellar, Convex analysis, Princeton Landmarks in Mathematics, Princeton University Press, Princeton, NJ, 1997. Reprint of the 1970 original; Princeton Paperbacks. MR 1451876
- H. Salehi, Algorithms for linear interpolator and interpolation error for minimal stationary stochastic processes, Ann. Probab. 7 (1979), no. 5, 840–846. MR 542133
- K. S. Vastola and H. V. Poor, An analysis of the effects of spectral uncertainty on Wiener filtering, Automatica 28 (1983), 289–293.
- Norbert Wiener, Extrapolation, Interpolation, and Smoothing of Stationary Time Series. With Engineering Applications, The Technology Press of the Massachusetts Institute of Technology, Cambridge, Mass; John Wiley & Sons, Inc., New York, N. Y.; Chapman & Hall, Ltd., London, 1949. MR 0031213
- A. M. Yaglom, Correlation theory of stationary and related random functions. Vol. I, Springer Series in Statistics, Springer-Verlag, New York, 1987. Basic results. MR 893393
- A. M. Yaglom, Correlation theory of stationary and related random functions. Vol. II, Springer Series in Statistics, Springer-Verlag, New York, 1987. Supplementary notes and references. MR 915557
References
- P. Bondon, Influence of missing values on the prediction of a stationary time series, J. Time Ser. Anal. 26 (2005), no. 4, 519–525. MR 2188831
- P. Bondon, Prediction with incomplete past of a stationary process, Stoch. Process. Appl. 98 (2002), 67–76. MR 1884924
- R. Cheng, A. G. Miamee, and M. Pourahmadi, Some extremal problems in $L^ p (w)$, Proc. Amer. Math. Soc. 126 (1998), no. 8, 2333–2340. MR 1443377
- I. I. Dubovets’ka, O. Yu. Masyutka, and M. P. Moklyachuk, Interpolation of periodically correlated stochastic sequences, Teor. Ĭmov$\bar {\text {\i }}$r. Mat. Stat. 84 (2011), 43–56; English transl. in Theory Probab. Math. Stat. 84 (2011), 43–56. MR 2857415
- J. Franke, Minimax robust prediction of discrete time series, Z. Wahrsch. Verw. Gebiete 68 (1985), 337–364. MR 771471
- J. Franke and H. V. Poor, Minimax-robust filtering and finite-length robust predictors, Robust and Nonlinear Time Series Analysis, Lecture Notes in Statistics, vol. 26, Springer-Verlag, 1984, pp. 87–126. MR 786305
- I. I. Gikhman and A. V. Skorokhod, The Theory of Stochastic Processes. I, “Nauka”, Moscow, 1971; English transl., Springer-Verlag, New York–Heidelberg, 1974. MR 2058259
- I. I. Golichenko and M. P. Moklyachuk, Estimates of Functionals of Periodically Correlated Processes, “Interservis”, Kyiv, 2014. (Ukrainian)
- U. Grenander, A prediction problem in game theory, Ark. Mat. 3 (1957), 371–379. MR 0090486
- E. J. Hannan, Multivariate Time Series, John Wiley & Sons, Inc., New York, 1970. MR 0279952
- A. D. Ioffe and V. M. Tihomirov, Theory of Extremal Problems, “Nauka”, Moscow, 1974; English transl., North-Holland Publishing Co., Amsterdam–New York, 1979. MR 0410502
- K. Karhunen, Über lineare Methoden in der Wahrscheinlichkeitsrechnung, Ann. Acad. Sci. Fenn., Ser. A I, no. 37, 1947. MR 0023013
- Y. Kasahara, M. Pourahmadi, and A. Inoue, Duals of random vectors and processes with applications to prediction problems with missing values, Stat. Probab. Lett. 79 (2009), no. 14, 1637–1646. MR 2547424
- S. A. Kassam and H. V. Poor, Robust techniques for signal processing: A survey, Proc. IEEE 73 (1985), no. 3, 433–481.
- A. N. Kolmogorov, Selected works by A. N. Kolmogorov. Vol. II: Probability theory and mathematical statistics (A. N. Shiryayev, ed.), Mathematics and Its Applications. Soviet Series., vol. 26, Kluwer Academic Publishers, Dordrecht, 1992. MR 1153022
- M. G. Kreĭn and A. A. Nudel’man, The Markov Moment Problem and Extremal Problems, “Nauka”, Moscow, 1973; English transl., American Mathematical Society, Providence, R.I., 1977. MR 0458081
- M. M. Luz and M. P. Moklyachuk, Interpolation of functionals of stochastic squashes with stationary increments, 87 (2012), 105–119; English transl. in Theory Probab. Math. Stat. 87 (2013), 117–133. MR 3241450
- M. P. Moklyachuk, Robust procedures in time series analysis, Theory Stoch. Process. 6 (2000), no. 3–4, 127–147.
- M. P. Moklyachuk, Robust Estimators of Functionals of Stochastic Processes, “Kyiv University”, Kyiv, 2008.
- M. Moklyachuk and O. Masyutka, Minimax-Robust Estimation Technique for Stationary Stochastic Processes, LAP LAMBERT Academic Publishing, 2012.
- M. Moklyachuk and M. Sidei, Interpolation problem for stationary sequences with missing observations, Stat. Optim. Inf. Comput. 3 (3) (2015), 259–275. MR 3393307
- T. Nakazi, Two problems in prediction theory, Studia Math. 78 (1984), 7–14. MR 766702
- M. Pourahmadi, A. Inoue, and Y. Kasahara, A prediction problem in $L^2(w)$, Proc. Amer. Math. Soc. 135 (2007), no. 4, 1233–1239. MR 2262930
- B. N. Pshenichnyĭ, Necessary Conditions for an Extremum, “Nauka“, Moscow, 1982; English transl. of the 1st Russian edition by Marcel Dekker, Inc., New York 1971. MR 686452
- Yu. A. Rozanov, Stationary Random Processes, second edition, “Nauka”, Moscow, 1990; English transl. of the 1st Russian edition by Holden-Day, Inc., San Francisco, Calif.–London–Amsterdam, 1967. MR 1090826
- R. T. Rockafellar, Convex Analysis, Princeton University Press, 1997. MR 1451876
- H. Salehi, Algorithms for linear interpolator and interpolation error for minimal stationary stochastic processes, Ann. Probab. 7 (1979), no. 5, 840–846. MR 542133
- K. S. Vastola and H. V. Poor, An analysis of the effects of spectral uncertainty on Wiener filtering, Automatica 28 (1983), 289–293.
- N. Wiener, Extrapolation, Interpolation and Smoothing of Stationary Time Series. With Engineering Applications, The M. I. T. Press, Massachusetts Institute of Technology, Cambridge, Mass., 1966. MR 0031213
- A. M. Yaglom, Correlation theory of stationary and related random functions. Vol. 1: Basic results, Springer Series in Statistics, Springer-Verlag, New York, 1987. MR 0893393
- A. M. Yaglom, Correlation theory of stationary and related random functions. Vol. 2: Supplementary notes and references, Springer Series in Statistics, Springer-Verlag, New York, 1987. MR 915557
Similar Articles
Retrieve articles in Theory of Probability and Mathematical Statistics
with MSC (2010):
60G10,
60G25,
60G35,
62M20,
93E10,
93E11
Retrieve articles in all journals
with MSC (2010):
60G10,
60G25,
60G35,
62M20,
93E10,
93E11
Additional Information
M. P. Moklyachuk
Affiliation:
Department of Probability Theory, Statistics, and Actuarial Mathematics, Faculty for Mechanics and Mathematics, National Taras Shevchenko University, Academician Glushkov Avenue, 6, Kyiv 03127, Ukraine
Email:
mmp@univ.kiev.ua
M. I. Sidei
Affiliation:
Department of Probability Theory, Statistics, and Actuarial Mathematics, Faculty for Mechanics and Mathematics, National Taras Shevchenko University, Academician Glushkov Avenue, 6, Kyiv 03127, Ukraine
Email:
marysidei4@gmail.com
Keywords:
Stationary sequence,
robust estimator,
mean square error,
least favorable spectral density,
minimax spectral characteristics
Received by editor(s):
October 28, 2015
Published electronically:
February 7, 2017
Additional Notes:
This paper was prepared following the talk at the International conference “Probability, Reliability and Stochastic Optimization (PRESTO-2015)” held in Kyiv, Ukraine, April 7–10, 2015
Article copyright:
© Copyright 2017
American Mathematical Society