Managing Word Mismatch Problems in Information Retrieval: A Topic-Based Query Expansion Approach

ABSTRACT

Word mismatch represents a fundamental information retrieval challenge that has become increasingly important as electronic document repositories (e.g., Web resources, digital libraries) grow in number and sheer volume. In general, word mismatch refers to the phenomenon in which a concept is described by different terms in user queries and in source documents. Query expansion represents a promising avenue to address such problems. Previous research predominantly approaches query expansion on the basis of global or local analysis. However, these approaches emphasize a global perspective rather than taking a topic-specific view of term associations. As a consequence, their effectiveness can be severely constrained when the document corpus spans a diverse set of topics. In this study, we propose a topic-based approach for query expansion and develop and empirically evaluate two novel methods-namely, nonfuzzy and fuzzy topic-based query expansion-to address word mismatch problems. According to our evaluation results, the proposed topic-based approach is more effective than a benchmark global analysis method, particularly when user queries consist of multiple query terms.

REFERENCES

• 1: <!{CDATA{Anderberg, M. R Cluster Analysis for Applications. New York: Academic Press, 1973.}}>
• 2: R. Attar , A. S. Fraenkel, Local Feedback in Full-Text Retrieval Systems, Journal of the ACM (JACM), v.24 n.3, p.397-417, July 1977 [doi>10.1145/322017.322021]
• 3: Nicholas J. Belkin , W. Bruce Croft, Information filtering and information retrieval: two sides of the same coin?, Communications of the ACM, v.35 n.12, p.29-38, Dec. 1992 [doi>10.1145/138859.138861]
• 4: Holger Billhardt , Daniel Borrajo , Victor Maojo, A context vector model for information retrieval, Journal of the American Society for Information Science and Technology, v.53 n.3, p.236-249, February 1 2002 [doi>10.1002/asi.10032]
• 5: Daniel Boley , Maria Gini , Robert Gross , Eui-Hong Han , George Karypis , Vipin Kumar , Bamshad Mobasher , Jerome Moore , Kyle Hastings, Partitioning-based clustering for Web document categorization, Decision Support Systems, v.27 n.3, p.329-341, Dec.1999 [doi>10.1016/S0167-9236(99)00055-X]
• 6: Eric Brill, A simple rule-based part of speech tagger, Proceedings of the third conference on Applied natural language processing, March 31-April 03, 1992, Trento, Italy [doi>10.3115/974499.974526]
• 7: Eric Brill, Some advances in transformation-based part of speech tagging, Proceedings of the twelfth national conference on Artificial intelligence (vol. 1), p.722-727, October 1994, Seattle, Washington, United States
• 8: Claudio Carpineto , Giovanni Romano , Vittorio Giannini, Improving retrieval feedback with multiple term-ranking function combination, ACM Transactions on Information Systems (TOIS), v.20 n.3, p.259-290, July 2002 [doi>10.1145/568727.568728]
• 9: <!{CDATA{Croft, W. B., and Harper, D. J. Using probabilistic models of document retrieval without relevance information. Journal of Documentation, 35, 4 (1979), 285-295.}}>
• 10: <!{CDATA{Croft, W. B.; Cook, R.; and Wilder, R. Providing government information on the Internet: Experiences with THOMAS. In R. Furuta (ed.), Proceedings of the Second International Conference on Theory and Practice of Digital Libraries. College Station: Hypermedia Research Lab, Computer Science Department, Texas A&M University, 1995, pp. 19-24.}}>>
• 11: Hang Cui , Ji-Rong Wen , Jian-Yun Nie , Wei-Ying Ma, Query Expansion by Mining User Logs, IEEE Transactions on Knowledge and Data Engineering, v.15 n.4, p.829-839, July 2003 [doi>10.1109/TKDE.2003.1209002]
• 12: Douglass R. Cutting , David R. Karger , Jan O. Pedersen , John W. Tukey, Scatter/Gather: a cluster-based approach to browsing large document collections, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.318-329, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133214]
• 13: <!{CDATA{Deerwester, S.; Dumais, S. T.; Furnas, G. W.; Landauer, T. K.; and Harshman, R. A. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41, 6 (1990), 391-407.}}>
• 14: Susan Dumais , John Platt , David Heckerman , Mehran Sahami, Inductive learning algorithms and representations for text categorization, Proceedings of the seventh international conference on Information and knowledge management, p.148-155, November 02-07, 1998, Bethesda, Maryland, United States [doi>10.1145/288627.288651]
• 15: <!{CDATA{Dunn, J. C. A fuzzy relative of the ISODATA process and its use in detecting compact well separated clusters. Journal of Cybernetics, 3, 3 (1973), 32-57.}}>
• 16: A. El-Hamdouchi , P. Willett, Hierarchic document classification using Ward's clustering method, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.149-156, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253200]
• 17: G. W. Furnas , T. K. Landauer , L. M. Gomez , S. T. Dumais, The vocabulary problem in human-system communication, Communications of the ACM, v.30 n.11, p.964-971, Nov. 1987 [doi>10.1145/32206.32212]
• 18: Susan Gauch , Jianying Wang , Satya Mahesh Rachakonda, A corpus analysis approach for automatic query expansion and its extension to multiple databases, ACM Transactions on Information Systems (TOIS), v.17 n.3, p.250-269, July 1999 [doi>10.1145/314516.314519]
• 19: Venkat N. Gudivada , Vijay V. Raghavan , William I. Grosky , Rajesh Kasanagottu, Information Retrieval on the World Wide Web, IEEE Internet Computing, v.1 n.5, p.58-68, September 1997 [doi>10.1109/4236.623969]
• 20: Vicente P. Guerrero Bote , Félix de Moya Anegón , Victor Herrero Solana, Document organization using Kohonen's algorithm, Information Processing and Management: an International Journal, v.38 n.1, p.79-89, January 2002 [doi>10.1016/S0306-4573(00)00066-2]
• 21: Chien-Kang Huang , Lee-Feng Chien , Yen-Jen Oyang, Relevant term suggestion in interactive web search based on contextual information in query session logs, Journal of the American Society for Information Science and Technology, v.54 n.7, p.638-649, May 2003 [doi>10.1002/asi.10256]
• 22: A. K. Jain , M. N. Murty , P. J. Flynn, Data clustering: a review, ACM Computing Surveys (CSUR), v.31 n.3, p.264-323, Sept. 1999 [doi>10.1145/331499.331504]
• 23: Bernard J. Jansen , Udo Pooch, A review of web searching studies and a framework for future research, Journal of the American Society for Information Science and Technology, v.52 n.3, p.235-246, Feb. 1, 2001 [doi>10.1002/1097-4571(2000)9999:9999<::AID-ASI1607>3.3.CO;2-6]
• 24: <!{CDATA{Jing, Y., and Croft, W. B. An association thesaurus for information retrieval. In F. Bretano and F. Seitz (eds.), Proceedings of the Intelligent Multimedia Information Retrieval Systems and Management Conference (RIAO '94). Paris: Centre de Hautes Etudes Internationales d'Informatique Documentaire (CID), 1994, pp. 146-160.}}>
• 25: M. Shamim Khan , Sebastian Khor, Enhanced web document retrieval using automatic query expansion, Journal of the American Society for Information Science and Technology, v.55 n.1, p.29-40, 1 January 2004 [doi>10.1002/asi.10341]
• 26: Han-Joon Kim , Sang-Goo Lee, A semi-supervised document clustering technique for information organization, Proceedings of the ninth international conference on Information and knowledge management, p.30-37, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354777]
• 27: Han-joon Kim , Sang-goo Lee, An effective document clustering method using user-adaptable distance metrics, Proceedings of the 2002 ACM symposium on Applied computing, March 11-14, 2002, Madrid, Spain [doi>10.1145/508791.508796]
• 28: T. Kohonen, Self-organization and associative memory: 3rd edition, Springer-Verlag New York, Inc., New York, NY, 1989
• 29: Teuvo Kohonen, Self-organizing maps, Springer-Verlag New York, Inc., Secaucus, NJ, 1997
• 30: <!{CDATA{Kraft, D. H.; Chen, J.; and Mikulcic, A. Combining fuzzy clustering and fuzzy inferencing in information retrieval. In Proceedings of the Ninth IEEE International Conference on Fuzzy Systems. Los Alamitos, CA: IEEE Computer Society Press, 2000, pp. 375-380.}}>
• 31: <!{CDATA{Lagus, K.; Honkela, T.; Kaski, S.; and Kohonen, T. Self-organizing maps of document collections: A new approach to interactive exploration. In E. Simoudis, J. Han, and U. Fayyad (eds.), Proceedings of the Second International Conference on Knowledge Discovery and Data Mining. New York: ACM Press, 1996, pp. 238-243.}}>
• 32: Bjornar Larsen , Chinatsu Aone, Fast and effective text mining using linear-time document clustering, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.16-22, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.312186]
• 33: Chienting Lin , Hsinchun Chen , Jay F. Nunamaker, Verifying the proximity and size hypothesis for self-organizing maps, Journal of Management Information Systems, v.16 n.3, p.57-70, December 1999
• 34: Zhenyu Liu , Wesley W. Chu, Knowledge-based query expansion to support scenario-specific retrieval of medical free text, Proceedings of the 2005 ACM symposium on Applied computing, March 13-17, 2005, Santa Fe, New Mexico [doi>10.1145/1066677.1066922]
• 35: <!{CDATA{Mendes, M. E. S., and Sacks, L. Evaluating fuzzy clustering for relevance-based information access. In O. Nasraoui, H. Frigui, and J.M. Keller (eds.), Proceedings of the Twelfth IEEE International Conference on Fuzzy Systems. Los Alamitos, CA: IEEE Computer Society Press, 2003, pp. 648-653.}}>
• 36: Mandar Mitra , Amit Singhal , Chris Buckley, Improving automatic query expansion, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.206-214, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290995]
• 37: Nikolaos A. Mylonopoulos , Vasilis Theoharakis, On site: global perceptions of IS journals, Communications of the ACM, v.44 n.9, p.29-33, Sept. 2001 [doi>10.1145/383694.383701]
• 38: Patrick Pantel , Dekang Lin, Document clustering with committees, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564412]
• 39: Yonggang Qiu , Hans-Peter Frei, Concept based query expansion, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.160-169, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160713]
• 40: <!{CDATA{Raghavan, V. V., and Wong, S. K. A critical analysis of vector space model for information retrieval. Journal of the American Society for Information Science, 37, 5 (1986), 279-287.}}>
• 41: R. Kelly Rainer, Jr. , Mark D. Miller, Examining differences across journal rankings, Communications of the ACM, v.48 n.2, p.91-94, February 2005 [doi>10.1145/1042091.1042096]
• 42: <!{CDATA{Rocchio, J. Relevance feedback in information retrieval. In G. Salton (ed.), The SMART Retrieval System: Experiments in Automatic Document Processing. Englewood Cliffs, NJ: Prentice Hall, 1971, pp. 313-323.}}>
• 43: Dmitri G. Roussinov , Hsinchun Chen, Document clustering for electronic meetings: an experimental comparison of two techniques, Decision Support Systems, v.27 n.1-2, p.67-79, Nov. 1999 [doi>10.1016/S0167-9236(99)00037-8]
• 44: <!{CDATA{Salton, G., and Buckley, C. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41, 4 (1990), 288-297.}}>
• 45: <!{CDATA{Sparck Jones, K. Automatic Keyword Classification for Information Retrieval. London: Butterworths, 1971.}}>
• 46: <!{CDATA{Tanaka, H.; Kumano, T.; Uratani, N.; and Ehara, T. An efficient document clustering algorithm and its application to a document browser. Information Processing and Management, 35, 4 (1999), 541-557.}}>
• 47: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 48: Ellen M Voorhees, Implementing agglomerative hierarchic clustering algorithms for use in document retrieval, Information Processing and Management: an International Journal, v.22 n.6, p.465-476, Dec. 1986 [doi>10.1016/0306-4573(86)90097-X]
• 49: <!{CDATA{Voutilainen, A. NPtool: A detector of English noun phrases. In K.W. Church (ed.), Proceedings of the First Workshop on Very Large Corpora. East Stroudsburg, PA: Association for Computational Linguistics, 1993, pp. 48-57.}}>
• 50: Chih-Ping Wei , Roger Chiang , Chia-Chen Wu, Accommodating Individual Preferences in the Categorization of Documents: A Personalized Clustering Approach, Journal of Management Information Systems, v.23 n.2, p.173-201, Number 2 / October 2006 [doi>10.2753/MIS0742-1222230208]
• 51: <!{CDATA{Wei, C.; Hu, P.; and Dong, Y. X. Managing document categories in e-commerce environments: An evolution-based approach. European Journal of Information Systems, 11, 3 (September 2002), 208-222.}}>
• 52: Chih-Ping Wei , Chin-Sheng Yang , Han-Wei Hsiao , Tsang-Hsiang Cheng, Combining preference- and content-based approaches for improving document clustering effectiveness, Information Processing and Management: an International Journal, v.42 n.2, p.350-372, March 2006 [doi>10.1016/j.ipm.2005.06.008]
• 53: <!{CDATA{Wong, S. K., and Yao, Y. Y. An information-theoretic measure of term specificity. Journal of the American Society for Information Science, 43, 1 (1992), 54-61.}}>
• 54: Jinxi Xu , W. Bruce Croft, Query expansion using local and global document analysis, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.4-11, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243202]
• 55: Jinxi Xu , W. Bruce Croft, Improving the effectiveness of information retrieval with local context analysis, ACM Transactions on Information Systems (TOIS), v.18 n.1, p.79-112, Jan. 2000 [doi>10.1145/333135.333138]
• 56: Ángel F. Zazo , Carlos G. Figuerola , José L. Alonso Berrocal , Emilio Rodríguez, Reformulation of queries using similarity thesauri, Information Processing and Management: an International Journal, v.41 n.5, p.1163-1173, September 2005 [doi>10.1016/j.ipm.2004.05.006]

INDEX TERMS

Keywords:
Document Clustering, Fuzzy Clustering, Information Retrieval, Query Expansion, Text Mining, Topic-Based Query Expansion, Word Mismatch