Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

In this paper, we present a new method of estimating the novelty of rules discovered by data-mining methods using WordNet, a lexical knowledge-base of English words. We assess the novelty of a rule by the average semantic distance in a knowledge hierarchy between the words in the antecedent and the consequent of the rule - the more the average distance, more is the novelty of the rule. The novelty of rules extracted by the DiscoTEX text-mining system on Amazon.com book descriptions were evaluated by both human subjects and by our algorithm. By computing correlation coefficients between pairs of human ratings and between human and automatic ratings, we found that the automatic scoring of rules based on our novelty measure correlates with human judgments about as well as human judgments correlate with one another. @Text mining

REFERENCES

• 1: Roberto J. Bayardo, Jr. , Rakesh Agrawal, Mining the most interesting rules, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.145-154, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.312219]
• 2: S. C. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and 1%. A. Haxshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41:391-407, 1990.
• 3: R. Feldman, edRor. Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJCAI-99} Workshop on Text Mining: Foundations, Techniques and Applications, Stockholm, Sweden, August 1999.
• 4: R. Feldman and I. Dagan. Knowledge discovery in textual databases (KDT). In Proceedings of the First International Conference on Knowledge Discovery and Data Mining (KDD-95), pages 112-117, 1995.
• 5: C. D. Fellbaum. WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA, 1998.
• 6: Jiawei Han , Yongjian Fu, Discovery of Multiple-Level Association Rules from Large Databases, Proceedings of the 21th International Conference on Very Large Data Bases, p.420-431, September 11-15, 1995
• 7: Jiawei Han , Micheline Kamber, Data mining: concepts and techniques, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000
• 8: Marti A. Hearst, Untangling text data mining, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.3-10, June 20-26, 1999, College Park, Maryland [doi>10.3115/1034678.1034679]
• 9: G. Hirst and D. St-Onge. Lexical chains as representations of context for the detection and correction of malapropims. In C. Fellbaum, editor, WordNet: An Electronic Lexical Database, chapter 13, pages 305-332. MIT Press, 1998.
• 10: Farhad Hussain , Huan Liu , Einoshin Suzuki , Hongjun Lu, Exception Rule Mining with a Relative Interestingness Measure, Proceedings of the 4th Pacific-Asia Conference on Knowledge Discovery and Data Mining, Current Issues and New Applications, p.86-97, April 18-20, 2000
• 11: Mika Klemettinen , Heikki Mannila , Pirjo Ronkainen , Hannu Toivonen , A. Inkeri Verkamo, Finding interesting rules from large sets of discovered association rules, Proceedings of the third international conference on Information and knowledge management, p.401-407, November 29-December 02, 1994, Gaithersburg, Maryland, United States [doi>10.1145/191246.191314]
• 12: T. K. Landauer and S. T. Dumais. A solution to Plato's problem: The Latent Semantic Analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review, 104:211-240, 1997.
• 13: C. Leacock and M. Chodorow. Combining local context and WordNet similarity for word sense identification. In C. Fellbaum, editor, WordNet: An Electronic Lezical Database, chapter 11, pages 265-284. MIT Press, 1998.
• 14: J. H. Lee, M. H. Kim, and Y. J. Lee. Information retrieval based on a conceptual distance in IS-A heirarchy. Journal of Documentation, 49(2):188-207, June 1993.
• 15: Bing Liu , Wynne Hsu , Lai-Fun Mun , Hing-Yan Lee, Finding Interesting Patterns Using User Expectations, IEEE Transactions on Knowledge and Data Engineering, v.11 n.6, p.817-832, November 1999 [doi>10.1109/69.824588]
• 16: Christopher D. Manning , Hinrich Schütze, Foundations of statistical natural language processing, MIT Press, Cambridge, MA, 1999
• 17: D. Mladenid, editor. Proceedings of the Sixth International Conference on Knowledge Discovery and Data Mining (KDD-2000) Workshop on Text Mining, Boston, MA, August 2000.
• 18: Un Yong Nahm , Raymond J. Mooney, A Mutually Beneficial Integration of Data Mining and Information Extraction, Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, p.627-632, July 30-August 03, 2000
• 19: U. Y. Nahm and R. J. Mooney. Mining soft-matching rules from textual data. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-2001), Seattle, WA, 2001.
• 20: B. Padmanabhan and A. Tuzhilin. A belief-driven method for discovering unexpected patterns. In Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining (KDD-98), pages 94-100, 1998.
• 21: R. Rada, H. Mili, E. Bicknell, and M. Blettner. Development and application of a metric on semantic nets. IEEE Transactions on Systems, Man and Cybernetics, 19(1):17-30, 1989.
• 22: P. Resnick. WordNet and distribution analysis: A class-based approach to lexical discovery. In Statistically-Based Natural-Language-Processing Techniques: Papers from the 1992 AAAI Workshop. AAAI Press, 1992.
• 23: P. Resnick. Using information content to evaluate semantic similarity in a taxonomy. In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (IJCAI-95), pages 448-453, 1995.
• 24: Sigal Sahar, Interestingness via what is not interesting, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.332-336, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.312272]
• 25: Avi Silberschatz , Alexander Tuzhilin, What Makes Patterns Interesting in Knowledge Discovery Systems, IEEE Transactions on Knowledge and Data Engineering, v.8 n.6, p.970-974, December 1996 [doi>10.1109/69.553165]
• 26: Michael Sussna, Word sense disambiguation for free-text indexing using a massive semantic network, Proceedings of the second international conference on Information and knowledge management, p.67-74, November 01-05, 1993, Washington, D.C., United States [doi>10.1145/170088.170106]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Textual databases

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Rule-based databases

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Document analysis

General Terms:
Algorithms, Design, Performance

Keywords:
WordNet, interesting rules, knowledge hierarchy, novelty, semantic distance