Empirical estimates of software availability of deployed systems

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Empirical estimates of software availability of deployed systems

Full text

Pdf (314 KB)

Source

International Symposium on Empirical Software Engineering archive
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering table of contents

Rio de Janeiro, Brazil

SESSION: Software operation and evolution table of contents

Pages: 222 - 231

Year of Publication: 2006

ISBN:1-59593-218-6

Author

Audris Mockus

Basking Ridge, NJ

Sponsors

ACM: Association for Computing Machinery
SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 14, Downloads (12 Months): 57, Citation Count: 0

Additional Information:

abstract references index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1159733.1159767 What is a DOI?

ABSTRACT

We consider empirical evaluation of the availability of the deployed software. Evaluation of real systems is more realistic, more accurate, and provides higher level of confidence than simulations, testing, or models. We process and model information gathered from a variety of operational and service support systems to obtain estimates of software reliability and availability. The three principal quantities are the total runtime, the number of outages, and the duration of outages. We consider methods to assess the quality of information in customer support systems, discuss advantages and disadvantages of various sources, consider methods to deal with missing data, and ways to construct bounds on measures that are not directly available. We propose a method to assess empirically software availability and reliability based on information from operational customer support and inventory systems and use a case study of a large communications system to investigate factors affecting software reliability. We find large variations among platforms and releases and find the failure rate to vary over time.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	D. Coit and W. Turkowski. Practical reliability data and analysis. Reliability Engineering, 14(1):1--17, 1986.
	2	D. W. Coit and K. A. Dey. Analysis of grouped data from field-failure reporting systems. Reliability Engineering and System Safety, 65(2):95--101, 1999.
	3	J. Fahy. Estimating warranty and service costs from mtbf estimates. In Electro/95 International. Professional Program Proceedings, pages 35--47, 21--23 June 1995.
	4	T. H. Fleming and D. Harrington. Nonparametric estimation of the survival distribution in censored data. Comm. in Statistics, 13:2469--86, 1984.
	5	K. Kanoun, M. Kaaniche, and J. Laprie. Experience in software reliability: From data collection to quantitative evaluation. In Proceedings, Fourth International Symposium on Software Reliability Engineering,, pages 234--245, 3--6 Nov 1993.
	6	E. Kaplan and P. Meyer. Non-paramentric estimation from incomplete observations. J Am Stat Assoc, pages 457--481, 1958.
	7	C. Kjaergaard. Field failure data collection and analysis of repairable systems. In Reliability Data Collection and Use in Risk and Availability Assessment. Proceedings of the 6th EuReDatA Conference, pages 848--858, 1989.
	8	K. Liu. Refrigerator failure early prediction based on warranty data. In Proceedings of the Annual Reliability and Maintainability Symposium, pages 195--199, 2002.
	9	M. W. Lu. Automotive reliability prediction based on early field failure warranty data. Quality and Reliability Engineering International, 14(2):103--108, March-April 1998.
	10	H. Malec. Communications reliability: a historical perspective. IEEE Transactions on Reliability, 47(3):333--345, Sept. 1998.
	11	Audris Mockus , Ping Zhang , Paul Luo Li, Predictors of customer perceived software quality, Proceedings of the 27th international conference on Software engineering, p.225-233, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062506]
	12	H. Mueller and J. Wang. Hazard rates estimation under random censoring with varying kernels and bandwidths. Biometrics, 50:61--76, March 1994.
	13	J. D. Musa, A. Iannino, and K. Okumoto. Software Reliability. McGraw-Hill Publishing Co., 1990.
	14	S. original by Kenneth Hess and R. port by R. Gentleman. muhaz: Hazard Function Estimation in Survival Analysis. R package version 1.2.2.
	15	S. original by Terry Therneau and ported by Thomas Lumley. survival: Survival analysis, including penalised likelihood. R package version 2.20.
	16	R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2005. ISBN3-900051-07-0.
	17	B. Rai and N. Singh. Hazard rate estimation from incomplete and unclean warranty data. Reliability Engineering and System Safety, 81(1):79--92, July 2003.
	18	N. Sarawgi. A simple method for predicting the cumulative failures of consumer products during the warranty period. In Annual Reliability and Maintainability Symposium 1995 Proceedings, pages 384--390, 1995.
	19	X. Zhang and H. Pham. Predicting operational software availability and its applications to telecommunication systems. International Journal of Systems Science, 33(11):923--930, Sep 15 2002.