Collecting data for software reliability analysis and modeling

ABSTRACT

This paper studies the collection of appropriate data for software reliability analysis and modeling. Our approach satisfies the data requirements for various reliability models under the constraints imposed by our project environment. These data-model relations and data - environment constraints are characterized to provide a tentative roadmap for data collection. In the process of collecting data for a group of projects in the system testing stage, we encountered various problems and devised solutions and improvement initiatives to deal with them. We summarize our experience in this paper so that similar initiatives in quality improvement under similar environments can be implemented more effectively.

REFERENCES

• 1: Ram Chillarege , Inderpal S. Bhandari , Jarir K. Chaar , Michael J. Halliday , Diane S. Moebus , Bonnie K. Ray , Man-Yuen Wong, Orthogonal Defect Classification-A Concept for In-Process Measurements, IEEE Transactions on Software Engineering, v.18 n.11, p.943-956, November 1992 [doi>10.1109/32.177364]
• 2: W. J. Farr. A survey of software reliability modeling and estimation. Technical Report NSWC TR 82-171, Naval Surface Warfare Center, Sept. 1983.
• 3: A. L. Goel. Software reliability models: Assumptions, limitations, and applicability. IEEE Trans. on Software Engineering, 11(12):1411--1423, Dec. 1985.
• 4: A. L. Goel and K. Okumoto. A time dependent error detection rate model for software reliability and other performance measures. IEEE Trans. on Reliability, 28: 206--211, 1979.
• 5: P. Lu and J. Tian. Applying software reliability engineering in large-scale software development. In Proc. 3rd Int. Conf. on Software Quality, Lake Tahoe, California, Oct. 1993.
• 6: H. D. Mills, M. Dyer, and R. C. Linger. Cleanroom software engineering. IEEE Computer, pages 19--24, Sept. 1987.
• 7: John D. Musa, Operational Profiles in Software-Reliability Engineering, IEEE Software, v.10 n.2, p.14-32, March 1993 [doi>10.1109/52.199724]
• 8: John D. Musa , Anthony Iannino , Kazuhira Okumoto, Software reliability: measurement, prediction, application, McGraw-Hill, Inc., New York, NY, 1987
• 9: J. Tian and P. Lu. An integrated environment for software reliability modeling. In Proc. 17th Int. Computer Software and Applications Conf., Phoenix, Arizona, Nov. 1993.
• 10: J. Tian and P. Lu. A practical comparison of software reliability models. In Proc. 15th Minnowbrook Workshop on Software Engineering, pages 214--221, Blue Mountain Lake, New York, July 1993.
• 11: J. Tian and P. Lu. Software reliability measurement and modeling for multiple releases of commercial software. In Proc. 4th Int. Symp. on Software Reliability Engineering, Denver, Colorado, Nov. 1993.
• 12: S. Yamada, M. Ohba, and S. Osaki. S-shaped reliability growth modeling for software error detection. IEEE Trans. on Reliability, pages 475--478, 1983.

INDEX TERMS

Keywords:
data collection, reliability, software reliability engineering