Predictive analyses for nonhomogeneous Poisson processes with power law using Bayesian approach

https://doi.org/10.1016/j.csda.2006.05.010Get rights and content

Abstract

Nonhomogeneous Poisson process (NHPP) also known as Weibull process with power law, has been widely used in modeling hardware reliability growth and detecting software failures. Although statistical inferences on the Weibull process have been studied extensively by various authors, relevant discussions on predictive analysis are scattered in the literature. It is well known that the predictive analysis is very useful for determining when to terminate the development testing process. This paper presents some results about predictive analyses for Weibull processes. Motivated by the demand on developing complex high-cost and high-reliability systems (e.g., weapon systems, aircraft generators, jet engines), we address several issues in single-sample and two-sample prediction associated closely with development testing program. Bayesian approaches based on noninformative prior are adopted to develop explicit solutions to these problems. We will apply our methodologies to two real examples from a radar system development and an electronics system development.

Introduction

Several reliability models have been proposed in the literature for estimating system reliability during development testing and evaluating software reliability. Amongst, nonhomogeneous Poisson process (NHPP) with intensity functionλt=^λ(t)=(β/α)(t/α)β-1,α,β>0,is perhaps the most widely used model among governments and industries. In the literature, this NHPP possesses different names such as Weibull process, power-law process and Duane model (Duane, 1964).

Applications of the Weibull process on assessing hardware reliability growth and detecting software failures were investigated extensively by various authors. For instance, classical (or frequentist) estimations on unknown parameters, mean time between failures and the current system reliability were studied by Crow, 1974, Crow, 1982, Bain (1978), Engelhardt and Bain (1978), Lee and Lee (1978), Bain and Engelhardt (1980), Joe (1989) and Huang et al. (2003) while those based on traditional Bayesian inferences were investigated by Kyparisis and Singpurwalla (1985), Guida et al. (1989), Bar-Lev et al. (1992) and Kuo and Yang (1995). Using Gibbs sampling, Kuo and Yang (1996) presented a unified approach for analyzing more general NHPPs which include several models as special cases (e.g., the Weibull process, the Cox–Lewis (1966) model with intensity λ(t)=eα+βt, the Goel–Okumoto (1979) model with λ(t)=αβe-βt, the delayed S-shaped model (Yamada et al., 1983) with λ(t)=αβ2te-βt, and the Musa–Okumoto (1984) model with λ(t)=α/(t+β)). By using Markov chain Monte Carlo method, Ryan (2003) presented Bayesian inferences for NHPPs with a variety of more flexible families of intensities built on the notion of switching in time between two simple constituent intensities. For more detailed discussions, one can refer to Xie (1991), Lyu (1996), Singpurwalla and Wilson (1999) and Verma and Kapur (2006).

As noted by Meth (1992, p. 339), “reliability growth models can potentially provide the basis for (i) planning reliability growth tests, (ii) monitoring progress and estimating current reliability, and (iii) forecasting future reliability improvements.” In other words, reliability growth model is a powerful tool for forecasting and prediction (see, e.g., Aitchison and Dunsmore, 1975, West and Harrison, 1989, Geisser, 1993). In particular, predictive analyses are useful for determining when to terminate a development process. Usually, a prediction interval is constructed to indicate the time frame when the kth (k>0) future observation will occur with pre-determined confidence level. However, literature for predictive inference on Weibull process is relatively scattered. For instance, Lee and Lee (1978) proposed a numerical integration method for constructing prediction limits for the kth (k>0) future observation in frequentist settings. Engelhardt and Bain (1978) derived a comparable result which does not involve numerical integration. Alternatively, Tian (1992) presented a closed-form Bayesian prediction interval for more general observed data. In addition, Pulcini (2001) studied the Bayesian prediction of the future failure times and the number of failures in a future time interval for a repairable system subject to minimal repairs and periodic overhauls. Sen (2002) investigated Bayesian prediction of the Weibull intensity. Pfefferman and Cernuschi-Frias (2002) provided a nonparametric prediction procedure and Pievatolo et al. (2003) presented an application of predicting the expected number of failures in underground trains during a given period.

This article focuses on single-sample and two-sample predictive inferences for the Weibull process via Bayesian approach. Driven by the demand in developing complex high-cost and high-reliability systems (e.g., weapon systems, aircraft generators, jet engines), we first identify four issues in single-sample prediction and three issues in two-sample prediction associated closely with development testing program and derive the corresponding predictive distributions in Section 2. The main results for single- and two-sample predictions are presented in Sections 3 and 4, respectively. Two real examples from a radar system development and an electronics system development are used to illustrate the proposed methodologies in Section 5. We conclude with a discussion in Section 6 and put the mathematical proofs in the Appendix.

Section snippets

Predictive issues and Bayesian strategy

During development testing of certain product/system, engineers and statisticians are especially interested in certain prediction problems whose solutions are believed to be helpful in modifying the development testing program. In this section, we first present four issues in single-sample prediction and three issues in two-sample prediction associated closely with development testing program. We then derive the predictive distributions using Bayesian method.

For these purpose, we assume that a

Main results for single-sample prediction

In this section, we address the four single-sample prediction issues raised in Section 2.1 using Bayesian approach. The main results are presented in the following propositions with proofs being given in Appendix A. Below, we use χ2(n;γ) to represent the γ percentage point of the chi-square distribution with n degrees of freedom such that Prχ2(n)χ2(n;γ)=γ, and define Poisson(h|θ)=θhe-θ/h! and gamma(x|n,λ)=λnxn-1e-λx/Γ(n). Besides, the prior is assumed to be (2.4) or (2.8) in all subsequent

Main results for the two-sample prediction

In this section, we answer the three two-sample prediction issues raised in Section 2.2. The proofs of the following propositions are presented in Appendix B. Below, we use F(m,n;γ) to represent the γ percentage point of the F-distribution with m and n degrees of freedom, and F(x|m,n) and χ2(x|n) to denote the cdf of F(m,n) and the density of χ2(n), respectively. Let Ix(a,b)=[B(a,b)]-10xta-1(1-t)b-1dt andβ^=ni=1nlnT/xi=n/z.Again, the prior is taken as (2.4) or (2.8).

Proposition 5 Issue A2

The Bayesian UPL of yr (

Real examples

In this section, two real examples from a radar system development and an electronics system development are used to illustrate the proposed methodologies.

Discussion

During the development of complex high-cost and high-reliability systems, several problems in prediction arise when the Weibull process is used to model the reliability growth process. In this paper, using Bayesian approach with noninformative priors, we address these problems and obtain explicit solutions, which should be helpful for the modification of the development testing program and for the decision of the termination of a development process. One advantage of the adoption of Bayesian

Acknowledgments

The research of GL Tian was supported in part by US NCI Grants CA119758. The research of ML Tang was fully supported by a grant (CUHK4371/04M) from the Research Grant Council of the Hong Kong Special Administrative Region.

References (44)

  • J. Aitchison et al.

    Statistical Prediction Analysis

    (1975)
  • L.J. Bain

    Statistical Analysis of Reliability and Life-Testing Models

    (1978)
  • L.J. Bain et al.

    Inference on the parameters and current system reliability for a time-truncated Weibull process

    Technometrics

    (1980)
  • S.K. Bar-Lev et al.

    Bayesian inference for the power law process

    Ann. Inst. Statist. Math.

    (1992)
  • G.E.P. Box et al.

    Bayesian Inference in Statistical Analysis

    (1973)
  • R. Calabria et al.

    Bayes estimation of prediction intervals for a power law process

    Comm. Statist. Theory Methods

    (1990)
  • Y.P. Chang

    Estimation of parameters for nonhomogeneous Poisson process: Software reliability with change-point model

    Comm. Statist. Simulation Comput.

    (2001)
  • Chen, Z., 2004. Bayes approaches to power law process and microarray analysis. Ph.D. Dissertation, Department of...
  • D.R. Cox et al.

    Statistical Analysis of Series of Events

    (1966)
  • L.H. Crow

    Reliability analysis for complex repairable systems

  • L.H. Crow

    Confidence interval procedures for the Weibull process with application to reliability growth

    Technometrics

    (1982)
  • M.J. Crowder et al.

    Statistical Analysis of Reliability

    (1991)
  • J.T. Duane

    Learning curve approach to reliability monitoring

    IEEE Trans. Aerospace

    (1964)
  • M. Engelhardt et al.

    Prediction intervals for the Weibull process

    Technometrics

    (1978)
  • K.T. Fang et al.

    Number-Theoretic Methods in Statistics

    (1994)
  • S. Geisser

    Predictive Inference: An Introduction

    (1993)
  • A.L. Goel et al.

    Time-dependent error detection rate model for software reliability and other performance measures

    IEEE Trans. Reliability

    (1979)
  • M. Guida et al.

    Bayes inference for a nonhomogeneous Poisson process with power intensity law

    IEEE Trans. Reliability

    (1989)
  • C.Y. Huang et al.

    A unified scheme of some nonhomogeneous Poisson process models for software reliability estimation

    IEEE Trans. Software Engng.

    (2003)
  • H. Joe

    Statistical inference for general order statistics and nonhomogeneous Poisson software reliability models

    IEEE Trans. Software Engng.

    (1989)
  • Kuo, L., Yang, T.Y., 1995. Bayesian computation of software reliability. J. Comput. Graph. Stat. 4(1),...
  • L. Kuo et al.

    Bayesian computation for nonhomogeneous Poisson process in software reliability

    J. Amer. Statist. Assoc.

    (1996)
  • Cited by (0)

    View full text