Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Outliers are data objects with different characteristics compared to other data objects. Exploring the diverse and dynamic web data for outliers is more interesting than finding outliers in numeric data sets. Interestingly, the existing web mining algorithms have concentrated on finding patterns that are frequent while discarding the less frequent ones that are likely to contain the outlying data. This paper refers to outliers present on the web as web outliers to distinguish them from traditional outliers. Web outliers are data objects that show significantly different characteristics than other web data. Although the presence of web outliers appears obvious, there is neither formal definition for web outliers nor algorithms for mining them. Secondly, traditional outlier mining algorithms designed solely for numeric data sets are inappropriate for mining web outliers. This paper establishes the presence of web outliers and discusses some practical applications of web outlier mining. Finally, we present taxonomy for web outliers and propose a general framework for mining web content out.

REFERENCES

• 1: Fabrizio Angiulli , Clara Pizzuti, Fast Outlier Detection in High Dimensional Spaces, Proceedings of the 6th European Conference on Principles of Data Mining and Knowledge Discovery, p.15-26, August 19-23, 2002
• 2: Barnett, V. and Lewis, T. Outliers in Statistical Data. John Willey, 1994.
• 3: Markus M. Breunig , Hans-Peter Kriegel , Raymond T. Ng , Jörg Sander, LOF: identifying density-based local outliers, Proceedings of the 2000 ACM SIGMOD international conference on Management of data, p.93-104, May 15-18, 2000, Dallas, Texas, United States [doi>10.1145/342009.335388]
• 4: Soumen Chakrabarti , Martin van den Berg , Byron Dom, Focused crawling: a new approach to topic-specific Web resource discovery, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.31 n.11-16, p.1623-1640, May 17, 1999 [doi>10.1016/S1389-1286(99)00052-3]
• 5: Cooley, R., Mobasher, B., and Srivastava, J. Data Preparation for Mining World Wide Web Browsing Patterns. Knowledge and Information Systems 1, 1999.
• 6: Cooley, R. Mobasher B. and Srivastava J. Web Mining: Information and Pattern Discovery on the Web. SIGKDD Exploration: Newsletter of SIGKDD and Data Mining, ACM, I(2), 2000
• 7: Danile Riboni. Feature Selection for Web Page Classification. D.S.I Universita, Milano, Italy, 2002
• 8: Hawkins, D. Identification of Outliers. Chapman and Hall, London, 1980.
• 9: Wen Jin , Anthony K. H. Tung , Jiawei Han, Mining top-n local outliers in large databases, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, p.293-298, August 26-29, 2001, San Francisco, California [doi>10.1145/502512.502554]
• 10: Johnson, T., Kwok, I., and Ng, R. Fast Computation of 2-D Depth Contours. Proc. of KDD, 1998, pp 224--228.
• 11: Knorr, E. M., and Ng, R. T. A Unified Notion of Outliers: Properties and Computation. Proc. of KDD, 1997, pp 219--222.
• 12: Edwin M. Knorr , Raymond T. Ng, Algorithms for Mining Distance-Based Outliers in Large Datasets, Proceedings of the 24rd International Conference on Very Large Data Bases, p.392-403, August 24-27, 1998
• 13: Sridhar Ramaswamy , Rajeev Rastogi , Kyuseok Shim, Efficient algorithms for mining outliers from large data sets, Proceedings of the 2000 ACM SIGMOD international conference on Management of data, p.427-438, May 15-18, 2000, Dallas, Texas, United States [doi>10.1145/342009.335437]
• 14: Raymond Kosala , Hendrik Blockeel, Web mining research: a survey, ACM SIGKDD Explorations Newsletter, v.2 n.1, p.1-15, June, 2000 [doi>10.1145/360402.360406]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

General Terms:
Algorithms, Design

Keywords:
content-specific algorithms, data mining, resource extraction, web outliers