Enhancing database correctness: a statistical approach

ABSTRACT

In this paper, we introduce a new type of integrity constraint, which we call a statistical constraint, and discuss its applicability to enhancing database correctness. Statistical constraints manifest embedded relationships among current attribute values in the database and are characterized by their probabilistic nature. They can be used to detect potential errors not easily detected by the conventional constraints. Methods for extracting statistical constraints from a relation and enforcement of such constraints are described. Preliminary performance evaluation of enforcing statistical constraints on a real life database is also presented.

REFERENCES

• Agra 89: R. Agrawal , N. H. Gehani, ODE (Object Database and Environment): the language and the data model, Proceedings of the 1989 ACM SIGMOD international conference on Management of data, p.36-45, June 1989, Portland, Oregon, United States
• Agra 93: Rakesh Agrawal , Tomasz Imieliński , Arun Swami, Mining association rules between sets of items in large databases, Proceedings of the 1993 ACM SIGMOD international conference on Management of data, p.207-216, May 25-28, 1993, Washington, D.C., United States
• Beer 91: Catriel Beeri , Tova Milo, A Model for Active Object Oriented Databases, Proceedings of the 17th International Conference on Very Large Data Bases, p.337-349, September 03-06, 1991
• Bran 93: David A. Brant , Daniel P. Miranker, Index support for rule activation, Proceedings of the 1993 ACM SIGMOD international conference on Management of data, p.42-48, May 25-28, 1993, Washington, D.C., United States
• Chou 75: Chou, Y-I. "Statistical Analysis", Holt, Rinehart and Winston, 1975.
• Coch 77: Cochran, W. "Sampling Techniques", 3rd Ed., John Wiley & Sons, 1977.
• Codd 70: E. F. Codd, A relational model of data for large shared data banks, Communications of the ACM, v.13 n.6, p.377-387, June 1970 [doi>10.1145/362384.362685]
• Devo 84: Devore, J., "Probability & Statistics for Engineering and the Sciences", Brooks/Cole Publishing, 1984.
• EsCh 75: Eswaran, K., Chamberlin D. "Functional Specifications of a Subsystem for Data Base Integrity", Proc. VLDB 1975, pp. 48-68.
• Hans 92: Eric N. Hanson, Rule condition testing and action execution in Ariel, Proceedings of the 1992 ACM SIGMOD international conference on Management of data, p.49-58, June 02-05, 1992, San Diego, California, United States
• HaSa 78: Michael Hammer , Sunil K. Sarin, Efficient monitoring of database assertions, Proceedings of the 1978 ACM SIGMOD international conference on management of data, May 31-June 02, 1978, Austin, Texas [doi>10.1145/509252.509290]
• HoWo 73: Hollander, M., and Wolfe, D., "Nonparametric Statistical Methods", John Wiley, 1973.
• HoOz 93: Wen-Chi Hou , Gultekin Ozsoyoglu, Processing time-constrained aggregate queries in CASE-DB, ACM Transactions on Database Systems (TODS), v.18 n.2, p.224-261, June 1993 [doi>10.1145/151634.151636]
• HsIm 85: Arding Hsu , Tomasz Imielinski, Integrity checking for multiple updates, Proceedings of the 1985 ACM SIGMOD international conference on Management of data, p.152-168, May 1985, Austin, Texas, United States
• HZZ 93: Wen-Chi Hou , Zhongyang Zhang , Nong Zhou, Statistical inference of unknown attribute values in databases, Proceedings of the second international conference on Information and knowledge management, p.21-30, November 01-05, 1993, Washington, D.C., United States [doi>10.1145/170088.170097]
• JoWi 92: R. A. Johnson , D. W. Wichern, Applied multivariate statistical analysis, Prentice-Hall, Inc., Upper Saddle River, NJ, 1988
• Lohm 91: Guy M. Lohman , Bruce Lindsay , Hamid Pirahesh , K. Bernhard Schiefer, Extensions to Starburst: objects, types, functions, and rules, Communications of the ACM, v.34 n.10, p.94-109, Oct. 1991 [doi>10.1145/125223.125266]
• McCa 89: Dennis McCarthy , Umeshwar Dayal, The architecture of an active database management system, Proceedings of the 1989 ACM SIGMOD international conference on Management of data, p.215-224, June 1989, Portland, Oregon, United States
• Morg 83: Matthew Morgenstern, Active Databases as a Paradigm for Enhanced Computing Environments, Proceedings of the 9th International Conference on Very Large Data Bases, p.34-42, October 31-November 02, 1983
• Piat 91: Gregory Piateski , William Frawley, Knowledge Discovery in Databases, MIT Press, Cambridge, MA, 1991
• SAS 91: "SAS/STAT User's Guide", Release 6.03 Ed., S AS Institute Inc., North Carolina.
• Sell 88: T. Sellis , C. C. Lin , L. Raschid, Implementing large production systems in a DBMS environment: concepts and algorithms, Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.404-423, June 01-03, 1988, Chicago, Illinois, United States
• Ston 90: Michael Stonebraker , Anant Jhingran , Jeffrey Goh , Spyros Potamianos, On rules, procedure, caching and views in data base systems, Proceedings of the 1990 ACM SIGMOD international conference on Management of data, p.281-290, May 23-26, 1990, Atlantic City, New Jersey, United States
• Suit 85: Suits, D. "Statistics : An Introduction to Quantitative Economic Research", Halyburton Press, 1985.
• Tats 88: Tatsuoka, M., "Multivariate Analysis", Macmillan Publishing, 1988.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.0 General
          Subjects: Security, integrity, and protection**

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.1 Logical Design
          Subjects: Data models; Normal forms

General Terms:
Algorithms, Experimentation, Performance