Query-aware shrinking test databases

ABSTRACT

Keeping the test databases as small as possible leads to faster execution of tests and facilitates the task of completing the test cases and evaluating the actual outputs against the expected. In this paper we present an automated approach to database reduction that considers an initial database that may be a copy of a production database and the set of queries that are executed against it. The database is reduced in order to preserve the coverage of the data with respect to the queries attaining large reductions with very similar fault detection ability.

REFERENCES

• 1: Carsten Binnig , Donald Kossmann , Eric Lo, Multi-RQP: generating test databases for the functional testing of OLTP applications, Proceedings of the 1st international workshop on Testing database systems, June 13-13, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1385269.1385276]
• 2: Binnig, C., Kossmann, D. and Lo E. Reverse Query Processing. Proceedings of the 23rd International Conference on Data Engineering. IEEE Computer Society, Washington, DC, 2007; 506--515.
• 3: David Chays , Yuetang Deng , Phyllis G. Frankl , Saikat Dan , Filippos I. Vokolos , Elaine J. Weyuker, An AGENDA for testing relational database applications: Research Articles, Software Testing, Verification & Reliability, v.14 n.1, p.17-44, March 2004 [doi>10.1002/stvr.v14:1]
• 4: David Chays , John Shahid , Phyllis G. Frankl, Query-based test generation for database applications, Proceedings of the 1st international workshop on Testing database systems, June 13-13, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1385269.1385277]
• 5: Chilenski, J. J. An investigation of three forms of the modified condition decision coverage (MC/DC) criterion. Technical Report DOT/FAA/AR-01/18, U.S. Department of Transportation, Federal Aviation Administration, April 2001.
• 6: Michael Emmi , Rupak Majumdar , Koushik Sen, Dynamic test input generation for database applications, Proceedings of the 2007 international symposium on Software testing and analysis, July 09-12, 2007, London, United Kingdom [doi>10.1145/1273463.1273484]
• 7: Haftmann, F., Kossmann, D. and Kreutz, A,. Efficient Regression Tests for Database Applications. Proceedings of the 2nd Conference on Innovative Data Systems Research, 2005: 95--106.
• 8: Florian Haftmann , Donald Kossmann , Eric Lo, A framework for efficient regression tests on database applications, The VLDB Journal — The International Journal on Very Large Data Bases, v.16 n.1, p.145-164, January 2007 [doi>10.1007/s00778-006-0028-8]
• 9: William G. J. Halfond , Alessandro Orso, Command-Form Coverage for Testing Database Applications, Proceedings of the 21st IEEE/ACM International Conference on Automated Software Engineering, p.69-80, September 18-22, 2006 [doi>10.1109/ASE.2006.27]
• 10: Haraty, R. A., Mansour, N., and Daou, B. Regression test selection for database applications. In Siau K (Ed.), Advanced Topics in Database Research, vol. 3, Idea Group, 2004; 141--165.
• 11: Gregory M. Kapfhammer , Mary Lou Soffa, A family of test adequacy criteria for database-driven applications, Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering, September 01-05, 2003, Helsinki, Finland
• 12: Gregory M. Kapfhammer , Mary Lou Soffa, Database-aware test coverage monitoring, Proceedings of the 1st conference on India software engineering conference, February 19-22, 2008, Hyderabad, India [doi>10.1145/1342211.1342228]
• 13: Offutt, J., Liu, S., Abdurazik, A. and Ammann, P. Generating test data from state-based specifications. Software Testing, Verification and Reliability 2003; 13(1): 25--53.
• 14: Rothermel, G., Harrold, M. J., von Ronne, J. and Hong, C. Empirical studies of test-suite reduction. Software Testing, Verification and Reliability 2002; 12(4): 219--249.
• 15: María José Suárez-Cabal , Javier Tuya, Using an SQL coverage measurement for testing database applications, Proceedings of the 12th ACM SIGSOFT twelfth international symposium on Foundations of software engineering, October 31-November 06, 2004, Newport Beach, CA, USA
• 16: Suárez-Cabal, M. J. and Tuya J. Structural Coverage Criteria for Testing SQL Queries. Journal of Universal Computer Science 2009; 15(3): 584--619.
• 17: Javier Tuya , M. José Suárez-Cabal , Claudio de la Riva, A practical guide to SQL white-box testing, ACM SIGPLAN Notices, v.41 n.4, April 2006 [doi>10.1145/1147214.1147221]
• 18: Javier Tuya , Ma José Suárez-Cabal , Claudio de la Riva, Mutating database queries, Information and Software Technology, v.49 n.4, p.398-417, April, 2007 [doi>10.1016/j.infsof.2006.06.009]
• 19: Tuya, J., Suárez-Cabal, M. J. and de la Riva, C. Full Predicate Coverage for Testing SQL Database Queries. Submitted, February 2009.
• 20: David Willmor , Suzanne M. Embury, A Safe Regression Test Selection Technique for Database-Driven Applications, Proceedings of the 21st IEEE International Conference on Software Maintenance, p.421-430, September 25-30, 2005 [doi>10.1109/ICSM.2005.15]
• 21: David Willmor , Suzanne M. Embury, An intensional approach to the specification of test cases for database applications, Proceedings of the 28th international conference on Software engineering, May 20-28, 2006, Shanghai, China [doi>10.1145/1134285.1134301]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

General Terms:
Experimentation, Languages, Reliability, Verification

Keywords:
MC/DC, SQL coverage, data reduction, database testing, software testing, test-suite reduction