Testing database transactions with AGENDA

ABSTRACT

AGENDA is a tool set for testing relational database applications. An earlier prototype was targeted to applications consisting of a single query and included components for populating a database with data suitable for testing the application, generating inputs to the query, and checking relatively simple aspects of the results of executing the query. This paper describes substantial extensions to AGENDA, allowing it to test transactions with multiple queries and with complex intended behavior. The paper introduces a technique for checking complex properties of the database state transition performed by the transaction under test, as well as an improved input generation heuristic. Results of using AGENDA to test three applications with seeded faults are presented.

REFERENCES

• 1: DataFactory. http://www.quest.com/datafactory.
• 2: DBFill. http://www.bossi.com/db.ll.
• 3: DBUnit. http://dbunit.sourceforge.net.
• 4: JDBC Tutorial. http://java.sun.com/products/jdbc/book.html.
• 5: SQLUnit. http://sqlunit.sourceforge.net.
• 6: M. Y. Chan and S. C. Cheung. Testing database applications with SQL semantics.Proceedings of the 2nd International Symposium on Cooperative Database Systems for Advanced Applications pages 363--374, March 1999.
• 7: Ramkrishna Chatterjee , Gopalan Arun , Sanjay Agarwal , Ben Speckhard , Ramesh Vasudevan, Using Applications of Data Versioning in Database Application Development, Proceedings of the 26th International Conference on Software Engineering, p.315-325, May 23-28, 2004
• 8: D. Chays , Phyllis Frankl, Test data generation for relational database applications, 2004
• 9: David Chays , Saikat Dan , Phyllis G. Frankl , Filippos I. Vokolos , Elaine J. Weber, A framework for testing database applications, Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis, p.147-157, August 21-24, 2000, Portland, Oregon, United States
• 10: David Chays , Yuetang Deng , Phyllis G. Frankl , Saikat Dan , Filippos I. Vokolos , Elaine J. Weyuker, An AGENDA for testing relational database applications: Research Articles, Software Testing, Verification & Reliability, v.14 n.1, p.17-44, March 2004 [doi>10.1002/stvr.v14:1]
• 11: A. Christensen, A. Moller, and M. Schwartzbach. Precise analysis of string expressions. In Proceeding of the 10th International Static Analysis Symposium 2003.
• 12: R. A. Davies, R. J. A. Beynon, and B. F. Jones. Automating the testing of databases. Proceedings of the First International Workshop on Automated Program Analysis, Testing and Verification June 2000.
• 13: Y. Deng, P. Frankl, and J. Wang. Testing web database applications. In Workshop on Testing, Analysis and Verification of Web Services 2004.
• 14: Y. Deng, P. G. Frankl, and Z. Chen. Testing database transaction concurrency. Proceedings of 18th IEEE International Conference on Automated Software Engineering pages 184--193, 2003.
• 15: Carl Gould , Zhendong Su , Premkumar Devanbu, Static Checking of Dynamically Generated Queries in Database Applications, Proceedings of the 26th International Conference on Software Engineering, p.645-654, May 23-28, 2004
• 16: Gregory M. Kapfhammer , Mary Lou Soffa, A family of test adequacy criteria for database-driven applications, Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering, September 01-05, 2003, Helsinki, Finland
• 17: L. Krupkin. Dynamic query analyis. Master's thesis, Polytechnic University, May 2004.
• 18: Arthur J. Bernstein , Michael Kifer, Databases and Transaction Processing: An Application-Oriented Approach, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2001
• 19: Norman R. Lyons, An automatic data generating system for data base simulation and testing, ACM SIGMIS Database, v.8 n.4, p.10-13, Spring 1977 [doi>10.1145/1017601.1017603]
• 20: Xiaolei Qian , Richard Waldinger, A transaction logic for database specification, Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.243-250, June 01-03, 1988, Chicago, Illinois, United States
• 21: David Spelt , Susan Even, A Theorem Prover-Based Analysis Tool for Object-Oriented Databases, Proceedings of the 5th International Conference on Tools and Algorithms for Construction and Analysis of Systems, p.375-389, March 22-28, 1999
• 22: M. J. Suarez Cabal and J. Tuya. Using a sql coverage measurement for testing database applications. In FSE Oct. 2004.
• 23: Transction Processing Performance Council. TPC-C http://www.tpc.org,2002.
• 24: W. T. Tsai , Dmitry Volovik , Thomas F. Keefe, Automated Test Case Generation for Programs Specified by Relational Algebra Queries, IEEE Transactions on Software Engineering, v.16 n.3, p.316-324, March 1990 [doi>10.1109/32.48939]
• 25: Can Türker , Michael Gertz, Semantic integrity support in SQL:1999 and commercial (object-)relational database management systems, The VLDB Journal — The International Journal on Very Large Data Bases, v.10 n.4, p.241-269, December 2001 [doi>10.1007/s007780100050]
• 26: Jian Zhang , Chen Xu , S. C. Cheung, Automatic Generation of Database Instances for White-box Testing, Proceedings of the 25th International Computer Software and Applications Conference on Invigorating Software Development, p.161-165, October 08-12, 2001

INDEX TERMS

General Terms:
Reliability

Keywords:
database, software testing, transaction