A "quick and dirty" website data quality indicator

ABSTRACT

This short paper outlines a research study in progress, which is motivated by the perception that the spelling error rate of a document can serve as a rudimentary proxy for the degree of quality control exercised in its creation, and, subsequently, indicate its quality. One objective of this research is to validate this understanding. Ultimately, the goal of this research is to take advantage of such an association. In particular, we propose a simple, "quick and dirty" metric for assisting in the evaluation of the quality of websites. This metric utilizes the reported hit counts of search engine queries on a pre-determined set of commonly misspelled words.

REFERENCES

• 1: Brian Amento , Loren Terveen , Will Hill, Does “authority” mean quality? predicting expert quality ratings of Web documents, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.296-303, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345603]
• 2: Bagrow, J. P. , Rozenfeld, H. D., Bollt, E. M., and ben-Avraham, D. 2004. How famous is a scientist?--Famous to those who know us, Europhysics Letters, Vol. 67, No. 4, 2004, pp. 511--516.
• 3: Cappielo, C. and Pernici, B. 2006. A Methodology for Information Quality Management in Self-Healing Web Services, 11th International Conference on Information Quality (ICIQ-06), MIT, Cambridge MA, 2006.
• 4: Rudi L. Cilibrasi , Paul M. B. Vitanyi, The Google Similarity Distance, IEEE Transactions on Knowledge and Data Engineering, v.19 n.3, p.370-383, March 2007 [doi>10.1109/TKDE.2007.48]
• 5: Eppler, M. J., Algesheimer, R., and Dimpfel, M. 2003. Quality Criteria of Content-driven Websites and their Influence on Customer Satisfaction and Loyalty: An Empirical Test of an Information Quality Framework. 8th International Conference on Information Quality (ICIQ-03), MIT, Cambridge MA, 2003.
• 6: Krebs, V. 2003. What's your Google Number? International Association for Human Resource Information Management Journal, Vol. VII, No. 2, 2003, pp. 40--42.
• 7: Matsuo, Y., Tomobe, H., and Nishimura, T. 2007. Robust Estimation of Google Counts for Social Network Extraction. Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence 2007, pp. 1395--1401.
• 8: Pion, S., and Hamel, L. 2007. The Internet Democracy: A Predictive Model Based on Web Text Mining, International Conference on Data Mining, 2007, pp. 292--300.
• 9: Pun, J. C. C., and Lochovsky, F. H. 2004. Ranking search results by web quality dimensions, Journal of Web Engineering, Vol. 3, No. 3-4, 2004, pp. 216--235.
• 10: Pun, J. C. C., and Lochovsky, F. H. 2005. Finding High-Quality Web Pages Using Cohesiveness. 10th International Conference on Information Quality (ICIQ-05), MIT, Cambridge MA, 2005.
• 11: Schrock, Kathy. 2008. Critical Evaluation of a Web Site: Secondary School Level. Kathy Schrock's Guide for Educators, DiscoverySchool.com. http://school.discovery.com/schrockguide/evalhigh.html {June 5, 2008}
• 12: Simkin, M. V., and Roychowdhury V. P. 2006. "Theory of Aces: Fame by Chance or Merit?"The Journal of Mathematical Sociology, Vol. 30, No. 1, 2006, pp. 33--41.
• 13: Stvilia, B., Twidale, M. B., Smith, L. C., and Les Gasser 2005. Assessing Information Quality of a Community-Based Encyclopedia. 10th International Conference on Information Quality (ICIQ-05), MIT, Cambridge MA, 2005.
• 14: Sweetland, J. H. 2000. Reviewing the World Wide Web-Theory Versus Reality, Library Trends, Spring 2000.
• 15: Ury, Connie and Lori Mardis. 2008. Evaluating Websites: PART of the Research Process. http://www.nwmissouri.edu/library/courses/evaluation/edeval.htm {5 June 2008}
• 16: Virginia Tech 2008. Evaluating Internet Information, http://www.lib.vt.edu/help/instruct/evaluate/evaluating.html {June 5, 2008}.
• 17: Richard Y. Wang , Diane M. Strong, Beyond accuracy: what data quality means to data consumers, Journal of Management Information Systems, v.12 n.4, p.5-33, March 1996

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

General Terms:
Measurement, Reliability

Keywords:
data quality, data quality indicator, indicator, information credibility, information quality, quick and dirty, web data