A case study in database reliability: component types, usage profiles, and testing

ABSTRACT

Data management lies at the core of most modern information technology deployments. Accordingly, the reliability of the database management system (DBMS) is critical to the reputation and success of both its vendors and their clients. However, there is a dearth of work in the literature focused on the reliability of the DBMS. More specifically, research is yet to be focused on the variables that influence DBMS reliability and the relationships between these variables.

We present an initial case study focused on the relationships between component type, usage profiles, component size, component changes, component usage, and defect yield. The system under study is a distributed enterprise relational DBMS.

REFERENCES

• 1: Hiroshi Akima, Algorithm 761: Scattered-data surface fitting that has the accuracy of a cubic polynomial, ACM Transactions on Mathematical Software (TOMS), v.22 n.3, p.362-371, Sept. 1996 [doi>10.1145/232826.232856]
• 2: David Chays , Saikat Dan , Phyllis G. Frankl , Filippos I. Vokolos , Elaine J. Weber, A framework for testing database applications, Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis, p.147-157, August 21-24, 2000, Portland, Oregon, United States
• 3: Michael K. Daskalantonakis, A Practical View of Software Measurement and Implementation Experiences Within Motorola, IEEE Transactions on Software Engineering, v.18 n.11, p.998-1010, November 1992 [doi>10.1109/32.177369]
• 4: C. J. Date, An introduction to database systems (7th ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 5: Yuetang Deng , Phyllis Frankl , Jiong Wang, Testing web database applications, ACM SIGSOFT Software Engineering Notes, v.29 n.5, September 2004 [doi>10.1145/1022494.1022528]
• 6: Norman E. Fenton , Niclas Ohlsson, Quantitative Analysis of Faults and Failures in a Complex Software System, IEEE Transactions on Software Engineering, v.26 n.8, p.797-814, August 2000 [doi>10.1109/32.879815]
• 7: Mechelle Gittens , Hanan Lutfiyya , Michael Bauer , David Godwin , Yong Woo Kim , Pramod Gupta, An empirical evaluation of system and regression testing, Proceedings of the 2002 conference of the Centre for Advanced Studies on Collaborative research, p.3, September 30-October 03, 2002, Toronto, Ontario, Canada
• 8: Todd L. Graves , Alan F. Karr , J. S. Marron , Harvey Siy, Predicting Fault Incidence Using Software Change History, IEEE Transactions on Software Engineering, v.26 n.7, p.653-661, July 2000 [doi>10.1109/32.859533]
• 9: Jones, C. Programming Productivity. McGraw-Hill Companies, New York, NY, 1986.
• 10: Stephen H. Kan , Brian Thomas, Metrics and Models in Software Quality Engineering, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1994
• 11: Edward Kit , Susannah Finzi, Software testing in the real world: improving the process, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1995
• 12: John Musa, Developing More Reliable Software Faster and Cheaper, Proceedings of the 5th International Conference on Engineering of Complex Computer Systems, p.180, October 18-22, 1999
• 13: Raghu Ramakrishnan , Johannes Gehrke, Database Management Systems, McGraw-Hill Higher Education, 2000
• 14: María José Suárez-Cabal , Javier Tuya, Using an SQL coverage measurement for testing database applications, ACM SIGSOFT Software Engineering Notes, v.29 n.6, November 2004
• 15: Sullivan, M., Chillarege, R. A comparison of software defects in database management systems and operating systems. Twenty-Second International Symposium on Fault-Tolerant Computing 8--10 (Jul. 1992), 475--484.
• 16: Xintao Wu , Yongge Wang , Yuliang Zheng, Privacy preserving database application testing, Proceedings of the 2003 ACM workshop on Privacy in the electronic society, October 30, 2003, Washington, DC [doi>10.1145/1005140.1005159]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Reliability

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Validation

  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.m Miscellaneous

General Terms:
Measurement, Reliability, Verification

Keywords:
case study, database management system, testing, usage profiles