Methodologies for data quality assessment and improvement

ABSTRACT

The literature provides a wide range of techniques to assess and improve the quality of data. Due to the diversity and complexity of these techniques, research has recently focused on defining methodologies that help the selection, customization, and application of data quality assessment and improvement techniques. The goal of this article is to provide a systematic and comparative description of such methodologies. Methodologies are compared along several dimensions, including the methodological phases and steps, the strategies and techniques, the data quality dimensions, the types of data, and, finally, the types of information systems addressed by each methodology. The article concludes with a summary description of each methodology.

REFERENCES

• 1: Serge Abiteboul , Peter Buneman , Dan Suciu, Data on the Web: from relations to semistructured data and XML, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 2: Aiken, P. 1996. Data Reverse Engineering. McGraw Hill.
• 3: Marcelo Arenas , Leopoldo Bertossi , Jan Chomicki, Consistent query answers in inconsistent databases, Proceedings of the eighteenth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, p.68-79, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States [doi>10.1145/303976.303983]
• 4: Paolo Atzeni , Valeria De Antonellis, Relational database theory, Benjamin-Cummings Publishing Co., Inc., Redwood City, CA, 1993
• 5: Paolo Atzeni , Paolo Merialdo , Giuseppe Sindoni, Web Site Evaluation: Methodology and Case Study, Revised Papers from the HUMACS, DASWIS, ECOMO, and DAMA on ER 2001 Workshops, p.253-263, November 27-30, 2001
• 6: Ballou, D. and Pazer, H. 1985. Modeling data and process quality in multi-input, multi-output information systems. Manag. Sci. 31, 2.
• 7: Donald Ballou , Richard Wang , Harold Pazer , Giri Kumar Tayi, Modeling Information Manufacturing Systems to Determine Information Product Quality, Management Science, v.44 n.4, p.462-484, April 1998 [doi>10.1287/mnsc.44.4.462]
• 8: Basile, A., Batini, C., Grega, S., Mastrella, M., and Maurino, A. 2007. Orme: A new methodology for information quality and basel II operational risk. In Proceeedings of the 12th International Conference of Information Quality, Industrial Track.
• 9: Basili, V., Caldiera, C., Rombach, H. 1994. Goal question metric paradigm.
• 10: Baskarada, S., Koronios, A., and Gao, J. 2006. Towards a capability maturity model for information quality management: a tdqm approach. In Proceedings of the 11th International Conference on Information Quality.
• 11: Carlo Batini , Federico Cabitza , Cinzia Cappiello , Chiara Francalanci, A comprehensive data quality methodology for web and structured data, International Journal of Innovative Computing and Applications, v.1 n.3, p.205-218, July 2008 [doi>10.1504/IJICA.2008.019688]
• 12: Carlo Batini , Monica Scannapieco, Data Quality: Concepts, Methodologies and Techniques (Data-Centric Systems and Applications), Springer-Verlag New York, Inc., Secaucus, NJ, 2006
• 13: Bertolazzi, P., Santis, L. D., and Scannapieco, M. 2003. Automatic record matching in cooperative information systems. In Proceedings of the ICDT International Workshop on Data Quality in Cooperative Information Systems (DQCIS).
• 14: Bettschen, P. 2005. Master data management (MDM) enables IQ at Tetra Pak. In Proceedings of the 10th International Conference on Information Quality.
• 15: Alexander Bilke , Jens Bleiholder , Felix Naumann , Christoph Böhm , Karsten Draba , Melanie Weis, Automatic data fusion with HumMer, Proceedings of the 31st international conference on Very large data bases, August 30-September 02, 2005, Trondheim, Norway
• 16: Bovee, M., Srivastava, R., and Mak, B. September 2001. A conceptual framework and belief-function approach to assessing overall information quality. In Proceedings of the 6th International Conference on Information Quality.
• 17: Peter Buneman, Semistructured data, Proceedings of the sixteenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.117-121, May 11-15, 1997, Tucson, Arizona, United States [doi>10.1145/263661.263675]
• 18: Andrea Calì , Diego Calvanese , Giuseppe De Giacomo , Maurizio Lenzerini, Data integration under integrity constraints, Information Systems, v.29 n.2, p.147-163, April 2004 [doi>10.1016/S0306-4379(03)00050-4]
• 19: Calvanese, D., De Giacomo, D., and Lenzerini, M. 1999. Modeling and querying semi-structured data. Network. Inform. Syst. J. 2, 2, 253--273.
• 20: Cappiello, C., Francalanci, C., and Pernici, B. 2003. Preserving Web sites: A data quality approach. In Proceedings of the 7th International Conference on Information Quality (ICIQ).
• 21: Cappiello, C., Francalanci, C., Pernici, B., Plebani, P., and Scannapieco, M. 2003b. Data quality assurance in cooperative information systems: a multi-dimension certificate. In Proceedings of the ICDT International Workshop on Data Quality in Cooperative Information Systems (DQCIS).
• 22: Catarci, T., and Scannapieco, M. 2002. Data quality under the computer science perspective. Archivi Computer 2.
• 23: Chapman, A., Richards, H., and Hawken, S. 2006. Data and information quality at the Canadian institute for health information. In Proceedings of the 11th International Conference on Information Quality.
• 24: InduShobha N. Chengalur-Smith , Donald P. Ballou , Harold L. Pazer, The Impact of Data Quality Information on Decision Making: An Exploratory Analysis, IEEE Transactions on Knowledge and Data Engineering, v.11 n.6, p.853-864, November 1999 [doi>10.1109/69.824597]
• 25: Corey, D., Cobler, L., Haynes, K., and Walker, R. 1996. Data quality assurance activities in the military health services system. In Proceedings of the 1st International Conference on Information Quality. 127--153.
• 26: Tamraparni Dasu , Theodore Johnson, Exploratory Data Mining and Data Cleaning, John Wiley & Sons, Inc., New York, NY, 2003
• 27: Data Warehousing Institute. 2006. Data quality and the bottom line: Achieving business success through a commitment to high quality data. http://www.dw-institute.com/.
• 28: De Amicis, F., Barone, D., and Batini, C. 2006. An analytical framework to analyze dependencies among data quality dimensions. In Proceedings of the 11th International Conference on Information Quality (ICIQ). 369--383.
• 29: De Amicis, F. and Batini, C. 2004. A methodology for data quality assessment on financial data. Studies Commun. Sci. SCKM.
• 30: De Michelis, G., Dubois, E., Jarke, M., Matthes, F., Mylopoulos, J., Papazoglou, M., Pohl, K., Schmidt, J., Woo, C., and Yu, E. 1997. Cooperative Information Systems: A Manifesto. In Cooperative Information Systems: Trends & Directions, M. Papazoglou and G. Schlageter, Eds. Academic-Press.
• 31: De Santis, L., Scannapieco, M., and Catarci, T. 2003. Trusting data quality in cooperative information systems. In Proceedings of the 11th International Conference on Cooperative Information Systems (CoopIS). Catania, Italy.
• 32: Dedeke, A. 2005. Building quality into the information supply chain. Advances in Management Information Systems-Information Quality Monograph (AMIS-IQ) Monograph. R. Wang, E. Pierce, S. Madnick, and Fisher C.W., Eds.
• 33: DQI. 2004. Data quality initiative framework. Project report. www.wales.nhs.uk/sites/documents/319/DQI_Framwork_Update_Letter_160604.pdf
• 34: Larry P. English, Improving data warehouse and business information quality: methods for reducing costs and increasing profits, John Wiley & Sons, Inc., New York, NY, 1999
• 35: English, L. 2002. Process management and information quality: how improving information production processes improved information (product) quality. In Proceedings of the 7th International Conference on Information Quality (ICIQ). 206--211.
• 36: Eppler, M. and Helfert, M. 2004. A classification and analysis of data quality costs. In Proceedings of the 9th International Conference on Information Systems (ICIQ).
• 37: Eppler, M. and Münzenmaier, P. 2002. Measuring information quality in the Web context: A survey of state-of-the-art instruments and an application methodology. In Proceedings of the 7th International Conference on Information Systems (ICIQ).
• 38: Falorsi, P., Pallara, S., Pavone, A., Alessandroni, A., Massella, E., and Scannapieco, M. 2003. Improving the quality of toponymic data in the italian public administration. In Proceedings of the ICDT Workshop on Data Quality in Cooperative Information Systems (DQCIS).
• 39: Fellegi, I. P., and Holt, D. 1976. A systematic approach to automatic edit and imputation. J. Amer. Stat. Assoc. 71, 353, 17--35.
• 40: Craig W. Fisher , Bruce R. Kingma, Criticality of data quality as exemplified in two disasters, Information and Management, v.39 n.2, p.109-116, December 2001 [doi>10.1016/S0378-7206(01)00083-0]
• 41: Fraternali, P., Lanzi, P., Matera, M., and Maurino, A. 2004. Model-driven Web usage analysis for the evaluation of Web application quality. J. Web Eng. 3, 2, 124--152.
• 42: Gackowski, Z. 2006. Redefining information quality: the operations management approach. In Proceedings of the 11th International Conference on Information Quality (ICIQ). 399--419.
• 43: Hammer, M. 1990. Reengineering work: Don't automate, obliterate. Harvard Bus. Rev. 104--112.
• 44: Hammer, M. and Champy, J. 2001. Reengineering the Corporation: A Manifesto for Business Revolution, Harper Collins.
• 45: Mauricio A. Hernández , Salvatore J. Stolfo, Real-world Data is Dirty: Data Cleansing and The Merge/Purge Problem, Data Mining and Knowledge Discovery, v.2 n.1, p.9-37, January 1998 [doi>10.1023/A:1009761603038]
• 46: Tomás Isakowitz , Michael Bieber , Fabio Vitali, Web information systems, Communications of the ACM, v.41 n.7, p.78-80, July 1998 [doi>10.1145/278476.278490]
• 47: Tomás Isakowitz , Edward A. Stohr , P. Balasubramanian, RMM: a methodology for structured hypermedia design, Communications of the ACM, v.38 n.8, p.34-44, Aug. 1995 [doi>10.1145/208344.208346]
• 48: Istat. 2004. Guidelines for the data quality improvement of localization data in public administration (in Italian). www.istat.it
• 49: Matthias Jarke , Y. Vassiliou , P. Vassiliadis , M. Lenzerini, Fundamentals of Data Warehouses, Springer-Verlag New York, Inc., Secaucus, NJ, 1999
• 50: Manfred A. Jeusfeld , Christoph Quix , Matthias Jarke, Design and Analysis of Quality Information for Data Warehouses, Proceedings of the 17th International Conference on Conceptual Modeling, p.349-362, November 16-19, 1998
• 51: Kerr, K. and Norris, T. 2004. The development of a healthcare data quality framework and strategy. In Proceedings of the 9th International Conference on Information Quality.
• 52: William J. Kettinger , Varun Grover, Special section: toward a theory of business process change management, Journal of Management Information Systems, v.12 n.1, p.9-30, June 1995
• 53: Kovac, R. and Weickert, C. 2002. Starting with quality: Using TDQM in a start-up organization. In Proceedings of the 7th International Conference on Information Quality (ICIQ). Boston, 69--78.
• 54: Yang W. Lee , Diane M. Strong , Beverly K. Kahn , Richard Y. Wang, AIMQ: a methodology for information quality assessment, Information and Management, v.40 n.2, p.133-146, December 2002 [doi>10.1016/S0378-7206(02)00043-5]
• 55: Maurizio Lenzerini, Data integration: a theoretical perspective, Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 03-05, 2002, Madison, Wisconsin [doi>10.1145/543613.543644]
• 56: Liu, L. and Chi, L. 2002. Evolutionary data quality. In Proceedings of the 7th International Conference on Information Quality.
• 57: Long, J. and Seko, C. April 2005. A cyclic-hierarchical method for database data-quality evaluation and improvement. In Advances in Management Information Systems-Information Quality Monograph (AMIS-IQ) Monograph, R. Wang, E. Pierce, S. Madnick, and Fisher C.W.
• 58: David Loshin, Enterprise knowledge management: the data quality approach, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000
• 59: Lyman, P. and Varian, H. R. 2003. How much information. http://www.sims.berkeley.edu/how-much-info-2003.
• 60: G. Mecca , P. Atzeni , A. Masci , G. Sindoni , P. Merialdo, The Araneus Web-based management system, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.544-546, June 01-04, 1998, Seattle, Washington, United States
• 61: Mecca, G., Merialdo, P., Atzeni, P., and Crescenzi, V. 1999. The (short) araeneus guide to Web site development. In Proceedings of the 2nd International Workshop on the Web and Databases (WebDB) Conjunction with Sigmod.
• 62: Amihai Motro , Philipp Anokhin, Fusionplex: resolution of data inconsistencies in the integration of heterogeneous information sources, Information Fusion, v.7 n.2, p.176-196, June, 2006 [doi>10.1016/j.inffus.2004.10.001]
• 63: Muthu, S., Withman, L., and Cheraghi, S. H. 1999. Business process re-engineering : a consolidated methodology. In Proceedings of the 4th annual International Conference on Industrial Engineering Theory, Applications and Practice.
• 64: Nadkarni, P. 2006. Delivering data on time: The assurant health case. In Proceedings of the 11th International Conference on Information Quality.
• 65: Felix Naumann, Quality-driven query answering for integrated information systems, Springer-Verlag New York, Inc., New York, NY, 2002
• 66: Nelson, J., Poels, G., Genero, M., and Piattini, Eds. 2003. Proceedings of the 2nd International Workshop on Conceptual Modeling Quality (IWCMQ). Lecture Notes in Computer Science, vol. 2814, Springer.
• 67: Oakland, J. 1989. Total Quality Management. Springer.
• 68: Office of Management and Budget. 2006. Information quality guidelines for ensuring and maximizing the quality, objectivity, utility, and integrity of information disseminated by agencies. http://www.whitehouse.gov/omb/fedreg/reproducible.html.
• 69: Pernici, B. and Scannapieco, M. 2003. Data quality in Web information systems. J. Data Semant. 1, 48--68.
• 70: Leo L. Pipino , Yang W. Lee , Richard Y. Wang, Data quality assessment, Communications of the ACM, v.45 n.4, April 2002 [doi>10.1145/505248.506010]
• 71: Srinivasan Raghunathan, Impact of information quality and decision-maker quality on decision quality: a theoretical model and simulation analysis, Decision Support Systems, v.26 n.4, p.275-286, Oct. 1 1999 [doi>10.1016/S0167-9236(99)00060-3]
• 72: Rahm, E., Thor, A., Aumüller, D., Hong-Hai, D., Golovin, N., and Kirsten, T. June 2005. iFuice information fusion utilizing instance correspondences and peer mappings. In Proceedings of the 8th International Workshop on the Web and Databases (WebDB). located with SIGMOD.
• 73: Ramana Rao, From Unstructured Data to Actionable Intelligence, IT Professional, v.5 n.6, p.29-35, November 2003 [doi>10.1109/MITP.2003.1254966]
• 74: Thomas C. Redman , A. Blanton Godfrey, Data Quality for the Information Age, Artech House, Inc., Norwood, MA, 1997
• 75: Thomas C. Redman, The impact of poor data quality on the typical enterprise, Communications of the ACM, v.41 n.2, p.79-82, Feb. 1998 [doi>10.1145/269012.269025]
• 76: Monica Scannapieco , Antonino Virgillito , Carlo Marchetti , Massimo Mecella , Roberto Baldoni, The DaQuinCIS architecture: a platform for exchanging and improving data quality in cooperative information systems, Information Systems, v.29 n.7, p.551-582, October 2004 [doi>10.1016/j.is.2003.12.004]
• 77: Scannapieco, M., Pernici, B., and Pierce, E. 2002. IP-UML: Towards a Methodology for Quality Improvement based on the IP-MAP Framework. In Proceedings of the 7th International Conference on Information Quality (ICIQ). Boston.
• 78: Scannapieco, M., Pernici, B., and Pierce, E. 2005. IP-UML: A methodology for quality improvement-based on IP-MAP and UML. In Information Quality, Advances in Management Information Systems, Information Quality Monograph (AMIS-IQ), R. Wang, E. Pierce, S. Madnik, and C. Fisher, Eds.
• 79: Sessions, V. 2007. Employing the TDQM methodology: An assessment of the SC SOR. In Proceedings of the 12th International Conference on Information Quality. 519--537.
• 80: Shankaranarayan, G., Wang, R. Y., and Ziad, M. 2000. Modeling the manufacture of an information product with IP-MAP. In Proceedings of the 6th International Conference on Information Quality (ICIQ 2000). Boston.
• 81: Shankaranarayanan, G. and Wang, R. 2007. IPMAP: Current state and perspectives. In Proceedings of the 12th International Conference on Information Quality.
• 82: Sheng, Y. 2003. Exploring the mediating and moderating effects of information quality on firm's endeavour on information systems. In Proceedings of the 8th International Conference on Information Quality 2003 (ICIQ). 344--352.
• 83: Sheng, Y. and Mykytyn, P. 2002. Information technology investment and firm performance: A perspective of data quality. In Proceedings of the 7th International Conference on Information Quality (ICIQ). DC, 132--141.
• 84: Stoica, M., Chawat, N., and Shin, N. 2003. An investigation of the methodologies of business process reengineering. In Proceedings of Information Systems Education Conference.
• 85: Su, Y. and Jin, Z. 2004. A methodology for information quality assessment in the designing and manufacturing processes of mechanical products. In Proceedings of the 9th International Conference on Information Quality (ICIQ). 447--465.
• 86: US Department of Defense. 1994. Data administration procedures. DoD rep. 8320.1-M.
• 87: Panos Vassiliadis , Zografoula Vagena , Spiros Skiadopoulos , Nikos Karayannidis , Timos Sellis, Arktos: towards the modeling, design, control and execution of ETL processes, Information Systems, v.26 n.8, p.537-561, December 2001 [doi>10.1016/S0306-4379(01)00039-4]
• 88: Bas H. P. J. Vermeer, How Important is Data Quality for Evaluating the Impact of EDI on Global Supply Chains?, Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 7, p.7068, January 04-07, 2000
• 89: Yair Wand , Richard Y. Wang, Anchoring data quality dimensions in ontological foundations, Communications of the ACM, v.39 n.11, p.86-95, Nov. 1996 [doi>10.1145/240455.240479]
• 90: Richard Y. Wang, A product perspective on total data quality management, Communications of the ACM, v.41 n.2, p.58-65, Feb. 1998 [doi>10.1145/269012.269022]
• 91: Richard Y. Wang , Diane M. Strong, Beyond accuracy: what data quality means to data consumers, Journal of Management Information Systems, v.12 n.4, p.5-33, March 1996
• 92: World Wide Web Consortium. www.w3.org/WAI/. Web accessibility initiative.
• 93: Zachman, J. 2006. Zachman institute for framework advancement (ZIFA). www.zifa.com.

INDEX TERMS

Primary Classification:
  A. General Literature
  A.1 INTRODUCTORY AND SURVEY

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.m Miscellaneous

General Terms:
Management, Measurement

Keywords:
Data quality, data quality assessment, data quality improvement, data quality measurement, information system, methodology, quality dimension