A framework for testing database applications

ABSTRACT

Database systems play an important role in nearly every modern organization, yet relatively little research effort has focused on how to test them. This paper discusses issues arising in testing database systems and presents an approach to testing database applications. In testing such applications, the state of the database before and after the user's operation plays an important role, along with the user's input and the system output. A tool for populating the database with meaningful data that satisfy database constraints has been prototyped. Its design and its role in a larger database application testing tool set are discussed.

REFERENCES

• 1: Gilles Bernot , Marie Claude Gaudel , Bruno Marre, Software testing based on formal specifications: a theory and a tool, Software Engineering Journal, v.6 n.6, p.387-405, Nov. 1991
• 2: Michael J. Carey , David J. DeWitt , Jeffrey F. Naughton, The 007 Benchmark, Proceedings of the 1993 ACM SIGMOD international conference on Management of data, p.12-21, May 25-28, 1993, Washington, D.C., United States
• 3: J. Chang, S. Sankar, and D. J. Richardson. Automated test selection from adl speci~cations. In Proceedings of the 1996 International Symposium on Software Testing and Analysis. ACM Press, Jan. 1996.
• 4: Huo Yan Chen , T. H. Tse , F. T. Chan , T. Y. Chen, In black and white: an integrated approach to class-level testing of object-oriented programs, ACM Transactions on Software Engineering and Methodology (TOSEM), v.7 n.3, p.250-295, July 1998 [doi>10.1145/287000.287004]
• 5: S. R. Dalal , A. Jain , N. Karunanithi , J. M. Leaton , C. M. Lott , G. C. Patton , B. M. Horowitz, Model-based testing in practice, Proceedings of the 21st international conference on Software engineering, p.285-294, May 16-22, 1999, Los Angeles, California, United States [doi>10.1145/302405.302640]
• 6: C. J. Date, A guide to the SQL standard (2nd ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
• 7: R. A. Davies, R. J. A. Beynon, and B. F. Jones. Automating the testing of databases. In Proceedings of the First International Workshop on Automated Program Analysis, Testing and Veri~cation, June 2000.
• 8: Richard A. DeMillo , A. Jefferson Offutt, Experimental results from an automatic test case generator, ACM Transactions on Software Engineering and Methodology (TOSEM), v.2 n.2, p.109-127, April 1993 [doi>10.1145/151257.151258]
• 9: Roong-Ko Doong , Phyllis G. Frankl, The ASTOOT approach to testing object-oriented programs, ACM Transactions on Software Engineering and Methodology (TOSEM), v.3 n.2, p.101-130, April 1994 [doi>10.1145/192218.192221]
• 10: Ramez Elmasri , Shamkant B. Navathe, Fundamentals of database systems (2nd ed.), Benjamin-Cummings Publishing Co., Inc., Redwood City, CA, 1994
• 11: Arnaud Gotlieb , Bernard Botella , Michel Rueher, Automatic test data generation using constraint solving techniques, Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and analysis, p.53-62, March 02-04, 1998, Clearwater Beach, Florida, United States
• 12: Jim Gray , Prakash Sundaresan , Susanne Englert , Ken Baclawski , Peter J. Weinberger, Quickly generating billion-record synthetic databases, ACM SIGMOD Record, v.23 n.2, p.243-252, June 1994
• 13: Neelam Gupta , Aditya P. Mathur , Mary Lou Soffa, Automated test data generation using an iterative relaxation method, Proceedings of the 6th ACM SIGSOFT international symposium on Foundations of software engineering, p.231-244, November 01-05, 1998, Lake Buena Vista, Florida, United States
• 14: B. Korel, Automated Software Test Data Generation, IEEE Transactions on Software Engineering, v.16 n.8, p.870-879, August 1990 [doi>10.1109/32.57624]
• 15: Norman R. Lyons, An automatic data generating system for data base simulation and testing, ACM SIGMIS Database, v.8 n.4, p.10-13, Spring 1977 [doi>10.1145/1017601.1017603]
• 16: T. J. Ostrand , M. J. Balcer, The category-partition method for specifying and generating fuctional tests, Communications of the ACM, v.31 n.6, p.676-686, June 1988 [doi>10.1145/62959.62964]
• 17: Donald R. Slutz, Massive Stochastic Testing of SQL, Proceedings of the 24rd International Conference on Very Large Data Bases, p.618-622, August 24-27, 1998
• 18: Michael Stonebraker , Lawrence A. Rowe, The design of POSTGRES, Proceedings of the 1986 ACM SIGMOD international conference on Management of data, p.340-355, May 28-30, 1986, Washington, D.C., United States
• 19: Transaction Processing Performance Council. TPC-Benchmark C. 1998.
• 20: E. Weyuker , T. Goradia , A. Singh, Automatically Generating Test Data from a Boolean Specification, IEEE Transactions on Software Engineering, v.20 n.5, p.353-363, May 1994 [doi>10.1109/32.286420]

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.3 Language Constructs and Features
          Subjects: Frameworks

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING

  H. Information Systems
  H.2 DATABASE MANAGEMENT

General Terms:
Design, Languages, Management, Measurement, Performance, Theory

Keywords:
database, software testing, test data