Sensitivity of software system reliability to usage profile changes

ABSTRACT

Usage profiles are an important factor in software system reliability estimation. To assess the sensitivity of a system's reliability to changes in the usage profile, a Markov based system model is used. With the help of this model, the statistical sensitivity to many independent changes can be estimated. The theory supports both absolute and relative changes and can be used for systems with or without a terminal state. With this approach it is possible to very quickly estimate the uncertainty on the predicted reliability calculated from a Markov model based upon the uncertainty on the usage profile. Finally the theory is applied to an example to illustrate its use and to show its validity.

REFERENCES

• 1: R. C. Cheung. A user-oriented software reliability model. IEEE Transactions on Software Engineering, 6(2):118, 1980.
• 2: K. Goševa-Popstojanova and S. Kamavaram. Software reliability estimation under uncertainty:generalization of the method of moments. Eighth IEEE International Symposium on High Assurance Systems Engineering, 2004. Proceedings., pages 209--218, 2004.
• 3: Leonard Kleinrock, Theory, Volume 1, Queueing Systems, Wiley-Interscience, 1975
• 4: Jung-Hua Lo , Chin-Yu Huang , Ing-Yi Chen , Sy-Yen Kuo , Michael R. Lyu, Reliability assessment and sensitivity analysis of software reliability growth modeling based on software module structure, Journal of Systems and Software, v.76 n.1, p.3-13, April 2005 [doi>10.1016/j.jss.2004.06.025]
• 5: John D. Musa, Operational Profiles in Software-Reliability Engineering, IEEE Software, v.10 n.2, p.14-32, March 1993 [doi>10.1109/52.199724]
• 6: J. Musa. Adjusting measured field failure intensity for operational profile variation. 5th International Symposium on Software Reliability Engineering, 1994. Proceedings., pages 330--333, 1994.
• 7: J. Musa. Sensitivity of field failure intensity to operational profile errors. 5th International Symposium on Software Reliability Engineering, 1994. Proceedings., pages 334--337, 1994.
• 8: A. Pasquini, A. Crespo, and P. Matrella. Sensitivity of reliability-growth models to operational profile errors vs. testing accuracy. IEEE Transactions on Reliability, 45(4):531--540, 1996.
• 9: J. H. Poore , Harlan D. Mills , David Mutchler, Planning and Certifying Software System Reliability, IEEE Software, v.10 n.1, p.88-99, January 1993 [doi>10.1109/52.207234]
• 10: Kyle Siegrist, Reliability of Systems with Markov Transfer of Control, IEEE Transactions on Software Engineering, v.14 n.7, p.1049-1053, July 1988 [doi>10.1109/32.42744]
• 11: K. Siegrist, Reliability of Systems with Markov Transfer of Control, II, IEEE Transactions on Software Engineering, v.14 n.10, p.1478-1480, October 1988 [doi>10.1109/32.6192]
• 12: Anders Wesslén , Per Runeson , Björn Regnell, Assessing the Sensitivity to Usage Profile Changes in Test Planning, Proceedings of the 11th International Symposium on Software Reliability Engineering (ISSRE'00), p.317, October 08-11, 2000
• 13: S. Yacoub, B. Cukic, and H. Ammar. A scenario-based reliability analysis approach for component-based software. IEEE Transactions on Reliability, 53(4):465--480, 2004.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Reliability

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Statistical methods

  G. Mathematics of Computing
  G.3 PROBABILITY AND STATISTICS
      Subjects: Reliability and life testing; Markov processes

General Terms:
Reliability, Theory, Verification

Keywords:
Markov models, sensitivity, software reliability