Applying design of experiments to software testing

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Applying design of experiments to software testing: experience report

Full text

Pdf (1.33 MB)

Source

International Conference on Software Engineering archive
Proceedings of the 19th international conference on Software engineering table of contents

Boston, Massachusetts, United States

Pages: 205 - 215

Year of Publication: 1997

ISBN:0-89791-914-9

Authors

I. S. Dunietz	AT&T NCS OTC, 480 Red Hill Road, Middletown, NJ
W. K. Ehrlich	AT&T NCS OTC, 480 Red Hill Road, Middletown, NJ
B. D. Szablak	Lucent Technologies, Bell Laboratories, Room 21-409, PO Box 3030, Holmdel, NJ and AT&T NCS OTC, 480 Red Hill Road, Middletown, NJ
C. L. Mallows	AT&T Laboratories, Room 2C-265, 700 Mountain Avenue, Murray Hill, NJ
A. Iannino	Pipeline Associates, 9 Entin Road, Parsippany, NJ

Sponsors

IEEE-CS\TCSE : TC on Software Engineering
SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 9, Downloads (12 Months): 146, Citation Count: 25

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/253228.253271 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Brownlie, R., Prowse, J., and Phadke, M. S., "Robust Testing of AT&T PMX/StarMAIL Using OATS," AT&T Technical Journal, 71, 3 (May/June 1992), 41-47.
	2	Burroughs, K., Jain, A., and Erickson, R. L., "Improved Quality of Protocol Testing Through Techniques of Experimental Design," Proc. Supercomm/ICC '94 (IEEE International Conference on Communications, 1994), 745-752.
	3	David M. Cohen , Siddhartha R. Dalal , Jesse Parelius , Gardner C. Patton, The Combinatorial Design Approach to Automatic Test Generation, IEEE Software, v.13 n.5, p.83-88, September 1996 [doi>10.1109/52.536462]
	4	Siddhartha R. Dalal , Colin L. Mallows, Factor-covering designs for testing software, Technometrics, v.40 n.3, p.234-243, Aug. 1998 [doi>10.2307/1271179]
	5	Dunietz, I. S., "The addmon Family of Tools," Proc. ACET '93, 12th AT&T Conference on ELectronic Testing (Princeton NJ, September 1993), 259-267. (Contact the author.)
	6	Mallows, C. L., "Covering Designs in Random Environments," Technical Memorandum (AT&T Bell Laboratories, Murray Hill, NJ, October, 1995). (Contact the author.)
	7	Robert Mandl, Orthogonal Latin squares: an application of experiment design to compiler testing, Communications of the ACM, v.28 n.10, p.1054-1058, Oct. 1985 [doi>10.1145/4372.4375]
	8	John D. Musa , Anthony Iannino , Kazuhira Okumoto, Software reliability: measurement, prediction, application, McGraw-Hill, Inc., New York, NY, 1987
	9	Nair, V. N., James, D. A., Ehrlich, W. K., and Zevallos, J., "Statistical Issues in Assessing Software Testing Strategies," to appear in Statistica Sinica (January 1998).
	10	Madhan Shridhar Phadke, Quality Engineering Using Robust Design, Prentice Hall PTR, Upper Saddle River, NJ, 1995
	11	Roux, G., k-Proprietes dans des Tableaux de n Colonnes; Gas Particulier de la k-Surjectivite et de la k-Permutivite. Ph.D. dissertation, University of Paris, 1987.
	12	Sherwood, S. B., "Effective Testing of Factor Combinations," Proc. Third International Conference on Software Testing, Analysis and Review (Washington DC, May 1994).
	13	Taguchi, G., Introduction to Quality Engineering. White Plains, NY: Kraus International Publications, 1986.
	14	M. Z. Tsoukalas , J. W. Duran , S. C. Ntafos, On some reliability estimation problems in random and partition testing, IEEE Transactions on Software Engineering, v.19 n.7, p.687-697, July 1993 [doi>10.1109/32.238569]
	15	Elaine J. Weyuker , Bingchiang Jeng, Analyzing Partition Testing Strategies, IEEE Transactions on Software Engineering, v.17 n.7, p.703-711, July 1991 [doi>10.1109/32.83906]
	16	Wong, W. E., Horgan, J. R., London, S., and Mathur, A. P., "Effect of Test Set Size and Block Coverage on the Fault Detection Effectiveness," Proc. Fifrh International Conference on Software Reliability Engineering (Monterey CA, 1994), 230-238.

CITED BY 25

	S. R. Dalal , A. Jain , N. Karunanithi , J. M. Leaton , C. M. Lott , G. C. Patton , B. M. Horowitz, Model-based testing in practice, Proceedings of the 21st international conference on Software engineering, p.285-294, May 16-22, 1999, Los Angeles, California, United States
	Tomas Berling , Per Runeson, Efficient Evaluation of Multifactor Dependent System Performance Using Fractional Factorial Design, IEEE Transactions on Software Engineering, v.29 n.9, p.769-781, September 2003
	David M. Cohen , Siddhartha R. Dalal , Michael L. Fredman , Gardner C. Patton, The AETG System: An Approach to Testing Based on Combinatorial Design, IEEE Transactions on Software Engineering, v.23 n.7, p.437-444, July 1997
	Cemal Yilmaz , Myra B. Cohen , Adam Porter, Covering arrays for efficient fault characterization in complex configuration spaces, ACM SIGSOFT Software Engineering Notes, v.29 n.4, July 2004
	Noritaka Kobayashi , Tatsuhiro Tsuchiya , Tohru Kikuno, A new method for constructing pair-wise covering designs for software testing, Information Processing Letters, v.81 n.2, p.85-91, 31 January 2002
	Dean Hoskins , Renée C. Turban , Charles J. Colbourn, Experimental designs in software engineering: d-optimal designs and covering arrays, Proceedings of the 2004 ACM workshop on Interdisciplinary software engineering research, November 05-05, 2004, Newport Beach, CA, USA
	Cemal Yilmaz , Arvind S. Krishna , Atif Memon , Adam Porter , Douglas C. Schmidt , Aniruddha Gokhale , Balachandran Natarajan, Main effects screening: a distributed continuous quality assurance process for monitoring performance degradation in evolving software systems, Proceedings of the 27th international conference on Software engineering, May 15-21, 2005, St. Louis, MO, USA
	C. Lott , A. Jain , S. Dalal, Modeling requirements for combinatorial software testing, ACM SIGSOFT Software Engineering Notes, v.30 n.4, July 2005
	Renée C. Bryce , Charles J. Colbourn , Myra B. Cohen, A framework of greedy methods for constructing interaction test suites, Proceedings of the 27th international conference on Software engineering, May 15-21, 2005, St. Louis, MO, USA
	Renée C. Bryce , Charles J. Colbourn, Test prioritization for pairwise interaction coverage, ACM SIGSOFT Software Engineering Notes, v.30 n.4, July 2005
	Alan F. Karr , Adam A. Porter, Distributed performance testing using statistical modeling, ACM SIGSOFT Software Engineering Notes, v.30 n.4, July 2005
	Myra B. Cohen , Peter B. Gibbons , Warwick B. Mugridge , Charles J. Colbourn, Constructing test suites for interaction testing, Proceedings of the 25th International Conference on Software Engineering, May 03-10, 2003, Portland, Oregon
	Myra B. Cohen , Matthew B. Dwyer , Jiangfan Shi, Coverage and adequacy in software product line testing, Proceedings of the ISSTA 2006 workshop on Role of software architecture for testing and analysis, p.53-63, July 17-20, 2006, Portland, Maine
	Joseph R. Ruthruff , Sebastian Elbaum , Gregg Rothermel, Experimental program analysis: a new program analysis paradigm, Proceedings of the 2006 international symposium on Software testing and analysis, July 17-20, 2006, Portland, Maine, USA
	Myra B. Cohen , Joshua Snyder , Gregg Rothermel, Testing across configurations: implications for combinatorial testing, ACM SIGSOFT Software Engineering Notes, v.31 n.6, November 2006
	Joseph R. Ruthruff, Experimental program analysis: a new paradigm for program analysis, Proceeding of the 28th international conference on Software engineering, May 20-28, 2006, Shanghai, China
	Myra B. Cohen , Matthew B. Dwyer , Jiangfan Shi, Interaction testing of highly-configurable systems in the presence of constraints, Proceedings of the 2007 international symposium on Software testing and analysis, July 09-12, 2007, London, United Kingdom
	Renée C. Bryce , Charles J. Colbourn, One-test-at-a-time heuristic search for interaction test suites, Proceedings of the 9th annual conference on Genetic and evolutionary computation, July 07-11, 2007, London, England
	Michael Ellims , James Bridges , Darrel C. Ince, The Economics of Unit Testing, Empirical Software Engineering, v.11 n.1, p.5-31, March 2006
	Sandro Fouché , Myra B. Cohen , Adam Porter, Towards incremental adaptive covering arrays, The 6th Joint Meeting on European software engineering conference and the ACM SIGSOFT symposium on the foundations of software engineering: companion papers, September 03-07, 2007, Dubrovnik, Croatia
	Sandro Fouche , Myra B. Cohen , Adam Porter, Towards incremental adaptive covering arrays, Proceedings of the the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering, September 03-07, 2007, Dubrovnik, Croatia
	Ljubomir Lazic , Nikos Mastorakis, Orthogonal array application for optimal combination of software defect detection techniques choices, WSEAS Transactions on Computers, v.7 n.8, p.1319-1336, August 2008
	Cemal Yilmaz , Adam Porter , Arvind S. Krishna , Atif M. Memon , Douglas C. Schmidt , Aniruddha S. Gokhale , Balachandran Natarajan, Reliable Effects Screening: A Distributed Continuous Quality Assurance Process for Monitoring Performance Degradation in Evolving Software Systems, IEEE Transactions on Software Engineering, v.33 n.2, p.124-141, February 2007
	Andreas H. Ronneseth , Charles J. Colbourn, Merging covering arrays and compressing multiple sequence alignments, Discrete Applied Mathematics, v.157 n.9, p.2177-2190, May, 2009
	Sandro Fouché , Myra B. Cohen , Adam Porter, Incremental covering array failure characterization in large configuration spaces, Proceedings of the eighteenth international symposium on Software testing and analysis, July 19-23, 2009, Chicago, IL, USA