An intensional approach to the specification of test cases for database applications

ABSTRACT

When testing database applications, in addition to creating in-memory fixtures it is also necessary to create an initial database state that is appropriate for each test case. Current approaches either require exact database states to be specified in advance, or else generate a single initial state (under guidance from the user) that is intended to be suitable for execution of all test cases. The first method allows large test suites to be executed in batch, but requires considerable programmer effort to create the test cases (and to maintain them). The second method requires less programmer effort, but increases the likelihood that test cases will fail in non-fault situations, due to unexpected changes to the content of the database. In this paper, we propose a new approach in which the database states required for testing are specified intensionally, as constrained queries, that can be used to prepare the database for testing automatically. This technique overcomes the limitations of the other approaches, and does not appear to impose significant performance overheads.

REFERENCES

• 1: Marcelo Arenas , Leopoldo Bertossi , Jan Chomicki, Consistent query answers in inconsistent databases, Proceedings of the eighteenth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, p.68-79, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States [doi>10.1145/303976.303983]
• 2: L. E. Bertossi and J. Chomicki. Query answering in inconsistent databases. In J. Chomicki, R. van der Meyden, and G. Saake, editors, Logics for Emerging Applications of Databases, pages 43--83. Springer, 2003.
• 3: Philip Bohannon , Wenfei Fan , Michael Flaster , Rajeev Rastogi, A cost-based model and effective heuristic for repairing constraints by value modification, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland [doi>10.1145/1066157.1066175]
• 4: L. Bravo and L. E. Bertossi. Logic programs for consistently querying data integration systems. In G. Gottlob and T. Walsh, editors, Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI), pages 10--15. Morgan Kaufmann, August 2003.
• 5: Andrea Calì , Domenico Lembo , Riccardo Rosati, On the decidability and complexity of query answering over inconsistent and incomplete databases, Proceedings of the twenty-second ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, p.260-271, June 09-11, 2003, San Diego, California [doi>10.1145/773153.773179]
• 6: David Chays , Saikat Dan , Phyllis G. Frankl , Filippos I. Vokolos , Elaine J. Weber, A framework for testing database applications, Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis, p.147-157, August 21-24, 2000, Portland, Oregon, United States
• 7: David Chays , Yuetang Deng , Phyllis G. Frankl , Saikat Dan , Filippos I. Vokolos , Elaine J. Weyuker, An AGENDA for testing relational database applications: Research Articles, Software Testing, Verification & Reliability, v.14 n.1, p.17-44, March 2004 [doi>10.1002/stvr.v14:1]
• 8: J. Chomicki and J. Marcinkowski. On the computational complexity of minimal-change integrity maintenance in relational databases. In L. E. Bertossi, A. Hunter, and T. Schaub, editors, Inconsistency Tolerance, volume 3300 of Lecture Notes in Computer Science, pages 119--150. Springer, 2005.
• 9: Stavros S. Cosmadakis , Christos H. Papadimitriou, Updates of Relational Views, Journal of the ACM (JACM), v.31 n.4, p.742-760, Oct. 1984 [doi>10.1145/1634.1887]
• 10: Suzanne M. Embury , Sue M. Brandt , John S. Robinson , Iain Sutherland , Frank A. Bisby , W. Alex Gray , Andrew C. Jones , Richard J. White, Adapting integrity enforcement techniques for data reconciliation, Information Systems, v.26 n.8, p.657-689, December 2001 [doi>10.1016/S0306-4379(01)00044-8]
• 11: Gianluigi Greco , Sergio Greco , Ester Zumpano, A Logical Framework for Querying and Repairing Inconsistent Databases, IEEE Transactions on Knowledge and Data Engineering, v.15 n.6, p.1389-1408, November 2003 [doi>10.1109/TKDE.2003.1245280]
• 12: A. Guessoum , J. W. Lloyd, Updating knowledge bases, New Generation Computing, v.8 n.1, p.71-89, 1990 [doi>10.1007/BF03037514]
• 13: F. Haftmann, D. Kossmann, and A. Kreutz. Efficient regression tests for database applications. In Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research (CIDR), pages 95--106. Online Proceedings, January 2005.
• 14: Gregory M. Kapfhammer , Mary Lou Soffa, A family of test adequacy criteria for database-driven applications, Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering, September 01-05, 2003, Helsinki, Finland
• 15: Rom Langerak, View updates in relational databases with an independent scheme, ACM Transactions on Database Systems (TODS), v.15 n.1, p.40-66, March 1990 [doi>10.1145/77643.77645]
• 16: Panagiotis Louridas, JUnit: Unit Testing and Coding in Tandem, IEEE Software, v.22 n.4, p.12-15, July 2005 [doi>10.1109/MS.2005.100]
• 17: Jim Melton , Alan Simon, SQL:1999: understanding relational language components, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2001
• 18: Hua Shu, Using Constraint Satisfaction for View Update, Journal of Intelligent Information Systems, v.15 n.2, p.147-173, Sept./Oct. 2000 [doi>10.1023/A:1008726123320]
• 19: D. Willmor and S. M. Embury. Exploring test adequacy for database systems. In Proceedings of the 3rd UK Software Testing Research Workshop (UKTest), pages 123--133. The University of Sheffield, September 2005.
• 20: David Willmor , Suzanne M. Embury, A Safe Regression Test Selection Technique for Database-Driven Applications, Proceedings of the 21st IEEE International Conference on Software Maintenance (ICSM'05), p.421-430, September 25-30, 2005 [doi>10.1109/ICSM.2005.15]

INDEX TERMS

General Terms:
Experimentation, Verification

Keywords:
database testing, databases, software testing