On the analytical comparison of testing techniques

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

On the analytical comparison of testing techniques

Full text

Pdf (234 KB)

Source

International Symposium on Software Testing and Analysis archive
Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis table of contents

Boston, Massachusetts, USA

SESSION: Testing II table of contents

Pages: 154 - 164

Year of Publication: 2004

ISBN:1-58113-820-2

Also published in ...

Authors

Sandro Morasca	Università dell'Insubria, Como, Italy
Stefano Serra-Capizzano	Università dell'Insubria, Como, Italy

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering
ACM: Association for Computing Machinery

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 4, Downloads (12 Months): 54, Citation Count: 7

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1007512.1007533 What is a DOI?

ABSTRACT

We introduce necessary and sufficient conditions for comparing the expected values of the number of failures caused by applications of software testing techniques. Our conditions are based only on the knowledge of a total or even a hierarchical order among the failure rates of the subdomains of a program's input domain. We also prove conditions for comparing the probability of causing at least one failure in three important special cases.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Bhatia, R. Matrix Analysis. Springer, New York, 1997.
	2	Philip J. Boland , Harshinder Singh , Bojan Cukic, Comparing Partition and Random Testing via Majorization and Schur Functions, IEEE Transactions on Software Engineering, v.29 n.1, p.88-94, January 2003 [doi>10.1109/TSE.2003.1166591]
	3	T. Y. Chen , Y. T. Yu, On the Relationship Between Partition and Random Testing, IEEE Transactions on Software Engineering, v.20 n.12, p.977-980, December 1994 [doi>10.1109/32.368132]
	4	Tsong Yueh Chen , Yuen Tak Yu, On the Expected Number of Failures Detected by Subdomain Testing and Random Testing, IEEE Transactions on Software Engineering, v.22 n.2, p.109-119, February 1996 [doi>10.1109/32.485221]
	5	Duran, J.W., and Ntafos, S.C. An Evaluation of Random Testing. IEEE Trans. on Soft. Eng., Vol. SE-10, No. 4, pp. 438--444, July 1984.
	6	P. G. Frankl , E. J. Weyuker, A Formal Analysis of the Fault-Detecting Ability of Testing Methods, IEEE Transactions on Software Engineering, v.19 n.3, p.202-213, March 1993 [doi>10.1109/32.221133]
	7	P. G. Frankl , E. J. Weyuker, Provable Improvements on Branch Testing, IEEE Transactions on Software Engineering, v.19 n.10, p.962-975, October 1993 [doi>10.1109/32.245738]
	8	Phyllis G. Frankl , Richard G. Hamlet , Bev Littlewood , Lorenzo Strigini, Evaluating Testing Methods by Delivered Reliability, IEEE Transactions on Software Engineering, v.24 n.8, p.586-601, August 1998 [doi>10.1109/32.707695]
	9	Dick Hamlet , Ross Taylor, Partition Testing Does Not Inspire Confidence (Program Testing), IEEE Transactions on Software Engineering, v.16 n.12, p.1402-1411, December 1990 [doi>10.1109/32.62448]
	10	Hardy G., Littlewood J., Polya G., Inequalities. Cambridge Univ. Press, London, 1952.
	11	Morasca S., Serra Capizzano S., A Generalized Notion of Majorization and Applications to a Software Engineering Problem. TR Dept. CFM, Univ. Insubria, April 2001.
	12	Elaine J. Weyuker , Bingchiang Jeng, Analyzing Partition Testing Strategies, IEEE Transactions on Software Engineering, v.17 n.7, p.703-711, July 1991 [doi>10.1109/32.83906]

CITED BY 7

	Antonia Bertolino, The (Im)maturity level of software testing, ACM SIGSOFT Software Engineering Notes, v.29 n.5, September 2004
	Stefan Wagner, Modelling the quality economics of defect-detection techniques, Proceedings of the 2006 international workshop on Software quality, May 21-21, 2006, Shanghai, China
	Stefan Wagner, A model and sensitivity analysis of the quality economics of defect-detection techniques, Proceedings of the 2006 international symposium on Software testing and analysis, July 17-20, 2006, Portland, Maine, USA
	Tsong Yueh Chen , Fei-Ching Kuo , Robert Merkel, On the statistical properties of testing effectiveness measures, Journal of Systems and Software, v.79 n.5, p.591-601, May 2006
	Stefan Wagner , Michael Meisinger, Integrating a model of analytical quality assurance into the V-Modell XT, Proceedings of the 3rd international workshop on Software quality assurance, November 06-06, 2006, Portland, Oregon
	Johannes Mayer , Christoph Schneckenburger, An empirical analysis and comparison of random testing techniques, Proceedings of the 2006 ACM/IEEE international symposium on International symposium on empirical software engineering, September 21-22, 2006, Rio de Janeiro, Brazil
	Tsong Yueh Chen , Robert Merkel, An upper bound on software testing effectiveness, ACM Transactions on Software Engineering and Methodology (TOSEM), v.17 n.3, p.1-27, June 2008