Towards genre classification for IR in the workplace

ABSTRACT

Use of document genre in information retrieval systems has the potential to improve the task-appropriateness of results. However, genre classification remains a challenging problem. We describe a case study of genre classification in a software engineering workplace domain, which includes the development of a genre taxonomy and experiments in automatic genre classification using supervised machine learning. We present results based on evaluation using real-life enterprise data from this work domain.

REFERENCES

• 1: David Hawking, Challenges in enterprise search, Proceedings of the 15th Australasian database conference, p.15-24, January 01, 2004, Dunedin, New Zealand
• 2: Ronald Fagin , Ravi Kumar , Kevin S. McCurley , Jasmine Novak , D. Sivakumar , John A. Tomlin , David P. Williamson, Searching the workplace web, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775204]
• 3: A. Z. Broder , A. C. Ciccolo, Towards the next generation of enterprise search technology, IBM Systems Journal, v.43 n.3, p.451-454, July 2004
• 4: Jarvelin, K., Ingwersen, P.: Information Seeking Research Needs Extensions towards Tasks and Technology. Information Research 10 (2004)
• 5: Anderson, C. J., Glassman, M, McAfee R. B., Pinelli, T.: An Investigation of Factors Afffecting how Engineers and Scientists Seek Information. Journal of Engineering and Technology Management 18 (2001) 131--155
• 6: Hertzum, M.: The Importance of Trust in Software Engineers' Assessment and Choice of Information Sources. Information and Organization 12 (2002) 1--18
• 7: Raya Fidel , Maurice Green, The many faces of accessibility: engineers' perception of information sources, Information Processing and Management: an International Journal, v.40 n.3, p.563-581, January 2004 [doi>10.1016/S0306-4573(03)00003-7]
• 8: Luanne Freund , Elaine G. Toms , Charles L.A. Clarke, Modeling task-genre relationships for IR in the workplace, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076110]
• 9: Freund, L., Toms, E. G., Waterhouse, J.: Modeling the Information Behaviour of Software Engineers using a Work -Task Framework. 68th Annual Meeting of the American Society for Information Science and Technology, Charlotte, NC (2005).
• 10: Vakkari, P.: Task-Based Information Searching. Annual Review of Information Science and Technology 37 (2003) 413--463
• 11: Katriina Byström , Preben Hansen, Conceptual framework for tasks in information studies: Book Reviews, Journal of the American Society for Information Science and Technology, v.56 n.10, p.1050-1061, August 2005 [doi>10.1002/asi.v56:10]
• 12: Katriina BystrÖm, Information and information sources in tasks of varying complexity, Journal of the American Society for Information Science and Technology, v.53 n.7, p.581-591, July 2002 [doi>10.1002/asi.10064]
• 13: Orlikowski, W. J., Yates, J.: Genre Repertoire: the Structuring of Communicative Practices in Organizations. Administrative Science Quarterly 39 (1994) 541--574
• 14: Toms, E. G.: Recognizing Digital Genre. Bulletin of the American Society for information Science and Technology 27 (2001) 20--22
• 15: Takeshi Yoshioka , George Herman , JoAnne Yates , Wanda Orlikowski, Genre taxonomy: A knowledge repository of communicative actions, ACM Transactions on Information Systems (TOIS), v.19 n.4, p.431-456, October 2001 [doi>10.1145/502795.502798]
• 16: Karlgren, J.: Non-Topical Factors in Information Access. Webnet '99, Honolulu, 1999.
• 17: D. Roussinov , K. Crowston , M. Nilan , B. Kwasnik , J. Cai , X. Liu, Genre based Navigation on the Web, Proceedings of the 34th Annual Hawaii International Conference on System Sciences ( HICSS-34)-Volume 4, p.4013, January 03-06, 2001
• 18: Gheorghe Muresan , Catherine L. Smith , Michael Cole , Lu Liu , Nicholas J. Belkin, Detecting Document Genre for Personalization of Information Retrieval, Proceedings of the 39th Annual Hawaii International Conference on System Sciences, p.50.3, January 04-07, 2006 [doi>10.1109/HICSS.2006.119]
• 19: Bretan, I., Dewe, J., Hallberg, A., Wolkert, N., Karlgren, J.: Web-Specific Genre Visualization. presented at WebNet '98, Orlando Florida (1998)
• 20: Eric J. Glover , Steve Lawrence , Michael D. Gordon , William P. Birmingham , C. Lee Giles, Web Search---Your Way, Communications of the ACM, v.44 n.12, p.97-102, December 2001 [doi>10.1145/501317.501319]
• 21: Nigel Dewdney , Carol VanEss-Dykema , Richard MacMillan, The form is the substance: classification of genres in text, Proceedings of the workshop on Human Language Technology and Knowledge Management, p.1-8, July 06-07, 2001, Toulouse, France [doi>10.3115/1118220.1118227]
• 22: Meyer zu Eissen, S., Stein, B.: Genre Classification of Web Pages. Proceedings of the 27th German Conference on Artificial Intelligence, Ulm, Germany (2004)
• 23: Yong-Bae Lee , Sung Hyon Myaeng, Text genre classification with genre-revealing and subject-revealing features, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564403]
• 24: E. Stamatatos , N. Fakotakis , G. Kokkinakis, Text genre detection using common word frequencies, Proceedings of the 18th conference on Computational linguistics, July 31-August 04, 2000, Saarbrücken, Germany [doi>10.3115/992730.992763]
• 25: Finn, A., Kushmerick, N.: Learning to Classify Documents according to Genre. presented at IJCAI Workshop on Computational Approaches to Style Analysis and Synthesis (2003)
• 26: Shepherd, M., Watters, C., Kennedy, A.: Cybergenre: Automatic Identification of Home Pages on the Web. Journal of Web Engineering 3 (2004) 236--251
• 27: Thorsten Joachims, Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms, Kluwer Academic Publishers, Norwell, MA, 2002
• 28: Thorsten Joachims, Text Categorization with Suport Vector Machines: Learning with Many Relevant Features, Proceedings of the 10th European Conference on Machine Learning, p.137-142, April 21-23, 1998

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Experimentation, Human Factors, Measurement

Keywords:
contextual information retrieval, enterprise search, genre classification, genre-dependent applications