Joke retrieval: recognizing the same joke told differently

ABSTRACT

In a corpus of jokes, a human might judge two documents to be the "same joke" even if characters, locations, and other details are varied. A given joke could be retold with an entirely different vocabulary while still maintaining its identity. Since most retrieval systems consider documents to be related only when their word content is similar, we propose joke retrieval as a domain where standard language models may fail. Other meaning-centric domains include logic puzzles, proverbs and recipes; in such domains, new techniques may be required to enable us to search effectively. For jokes, a necessary component of any retrieval system will be the ability to identify the "same joke," so we examine this task in both ranking and classification settings. We exploit the structure of jokes to develop two domain-specific alternatives to the "bag of words" document model. In one, only the punch lines, or final sentences, are compared; in the second, certain categories of words (e.g., professions and countries) are tagged and treated as interchangeable. Each technique works well for certain jokes. By combining the methods using machine learning, we create a hybrid that achieves higher performance than any individual approach.

REFERENCES

• 1: Allan, J., Callan, J., Croft, W. B., Ballesteros, L., Broglio, J., Xu, J., and Shu, H. 1997. INQUERY at TREC-5. In Proceedings of the 5th Text Retrieval Conference. NIST, 119-132.
• 2: Attardo, S. and Raskin, V. 1991. Script theory revis(it)ed: Joke similarity and joke representation model. Humor: International Journal of Humor Research 4(3-4), 293--347.
• 3: Michael Bendersky , W. Bruce Croft, Discovering key concepts in verbose queries, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore [doi>10.1145/1390334.1390419]
• 4: Adam Berger , John Lafferty, Information retrieval as statistical translation, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.222-229, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312681]
• 5: Kim Binsted , Benjamin Bergen , Seana Coulson , Anton Nijholt , Oliviero Stock , Carlo Strapparava , Graeme Ritchie , Ruli Manurung , Helen Pain , Annalu Waller , Dave O'Mara, Computational Humor, IEEE Intelligent Systems, v.21 n.2, p.59-69, March 2006 [doi>10.1109/MIS.2006.22]
• 6: Peter F. Brown , John Cocke , Stephen A. Della Pietra , Vincent J. Della Pietra , Fredrick Jelinek , John D. Lafferty , Robert L. Mercer , Paul S. Roossin, A statistical approach to machine translation, Computational Linguistics, v.16 n.2, p.79-85, June 1990
• 7: Ken Goldberg , Theresa Roeder , Dhruv Gupta , Chris Perkins, Eigentaste: A Constant Time Collaborative Filtering Algorithm, Information Retrieval, v.4 n.2, p.133-151, July 2001 [doi>10.1023/A:1011419012209]
• 8: Hofstadter, D. and Gabor, L. 1989. Synopsis of the workshop on humor and cognition. Humor: International Journal of Humor Research, 2(4), 417--440.
• 9: A. Kruger , C. L. Giles , F. M. Coetzee , E. Glover , G. W. Flake , S. Lawrence , C. Omlin, DEADLINER: building a new niche search engine, Proceedings of the ninth international conference on Information and knowledge management, p.272-281, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354829]
• 10: John Lafferty , Chengxiang Zhai, Document language models, query models, and risk minimization for information retrieval, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.111-119, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383970]
• 11: Christopher D. Manning , Prabhakar Raghavan , Hinrich Schtze, Introduction to Information Retrieval, Cambridge University Press, New York, NY, 2008
• 12: Andrew Kachites McCallum , Kamal Nigam , Jason Rennie , Kristie Seymore, Automating the Construction of Internet Portals with Machine Learning, Information Retrieval, v.3 n.2, p.127-163, July 2000 [doi>10.1023/A:1009953814988]
• 13: Rada Mihalcea, The Multidisciplinary Facets of Research on Humour, Proceedings of the 7th international workshop on Fuzzy Logic and Applications: Applications of Fuzzy Sets Theory, July 07-10, 2007, Camogli, Italy [doi>10.1007/978-3-540-73400-0_52]
• 14: Rada Mihalcea , Carlo Strapparava, Technologies That Make You Smile: Adding Humor to Text-Based Applications, IEEE Intelligent Systems, v.21 n.5, p.33-39, September 2006 [doi>10.1109/MIS.2006.104]
• 15: Amihai Motro, VAGUE: a user interface to relational databases that permits vague queries, ACM Transactions on Information Systems (TOIS), v.6 n.3, p.187-214, July 1988 [doi>10.1145/45945.48027]
• 16: Raskin, V. 1985. Semantic Mechanisms of Humor. Studies in Linguistics and Philosophy. D. Reidel.
• 17: Ritchie, G. 2003. The Linguistic Analysis of Jokes. Routledge Studies in Linguistics, Vol. 2. Routledge, London.
• 18: Bruce R. Schatz, The Interspace: Concept Navigation Across Distributed Communities, Computer, v.35 n.1, p.54-62, January 2002 [doi>10.1109/2.976919]
• 19: Taylor, J. M. and Mazlack, L. J. 2007. Multiple component computational recognition of children's jokes. In IEEE International Conference on Systems, Man and Cybernetics. 1194--1199.
• 20: Ian H. Witten , Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems), Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005
• 21: William A. Woods, Conceptual Indexing: A Better Way to Organize Knowledge, Sun Microsystems, Inc., Mountain View, CA, 1997
• 22: William A. Woods , Lawrence A. Bookman , Ann Houston , Robert J. Kuhns , Paul Martin , Stephen Green, Linguistic knowledge can improve information retrieval, Proceedings of the sixth conference on Applied natural language processing, p.262-267, April 29-May 04, 2000, Seattle, Washington [doi>10.3115/974147.974183]
• 23: Chengxiang Zhai , John Lafferty, Model-based feedback in the language modeling approach to information retrieval, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA [doi>10.1145/502585.502654]
• 24: Zhu, J., Eisenstadt, M., Song, D., and Denham, C. 2006. Exploiting semantic association to answer 'vague queries'. In Li, Y., Looi, M., and Zhong, N., eds., Advances in Intelligent IT - Active Media Technology 2006. Frontiers in Artificial Intelligence and Applications, Vol. 138. IOS Press, 73--78.
• 25: Stephane Zrehen , Michael A. Arbib, Understanding jokes: a neural approach to content-based information retrieval, Proceedings of the second international conference on Autonomous agents, p.343-349, May 10-13, 1998, Minneapolis, Minnesota, United States [doi>10.1145/280765.280856]
• 26: Logic Problems - easy, http://www.folj.com/puzzles/easy.htm
• 27: The Aristocrats (2005), The Internet Movie Database, http://www.imdb.com/title/tt0436078/
• 28: Brain Teasers and Math Puzzles, Syvum Technologies, http://www.syvum.com/teasers/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

General Terms:
Algorithms

Keywords:
document similarity, domain-specific retrieval, humor