Recognizing user interest and document value from reading and organizing activities in document triage

ABSTRACT

People frequently must sort through large sets of documents to identify useful materials, for example, when they look through web search results. This document triage process may involve both reading and organizing, possibly using different applications for each activity. Users' interests may be inferred from what they read and how they interact with individual documents; these interests may in turn be used as a basis for identifying other documents or document elements of potential interest within the set. To most effectively identify related documents of interest, activity data must be collected from all applications used in document triage. In this paper we present a common framework (the Interest Profile Manager) for collecting and analyzing user interest. We also present models for detecting user interest based on reading activity alone, on organizing activity alone, and on combined reading and organizing activity. A study comparing document value calculated using the different models shows that incorporating interest information from both reading and organizing activity better predicted users' valuation of documents. This difference was statistically significant when compared to using reading activity alone.

REFERENCES

• 1: Bae, S., Badi, R., Meintanis, K., Moore, J.M., Zacchi, A., Hsieh, H., Marshall, C., Shipman, F. "Effects of Display Configurations on Document Triage," Proc. of IFIP Interact Conference, 2005, pp. 130--143.
• 2: Chan, P."A Non-Invasive Learning Approach to Building Web User Profiles," Workshop on Web Usage Analysis and User Profiling, 1999, pp. 7--12.
• 3: Mark Claypool , Phong Le , Makoto Wased , David Brown, Implicit interest indicators, Proceedings of the 6th international conference on Intelligent user interfaces, p.33-40, January 14-17, 2001, Santa Fe, New Mexico, United States [doi>10.1145/359784.359836]
• 4: Jeremy Goecks , Jude Shavlik, Learning users' interests by unobtrusively observing their normal behavior, Proceedings of the 5th international conference on Intelligent user interfaces, p.129-132, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325806]
• 5: Jonathan Grudin, Groupware and social dynamics: eight challenges for developers, Communications of the ACM, v.37 n.1, p.92-105, Jan. 1994 [doi>10.1145/175222.175230]
• 6: Diane Kelly , Nicholas J. Belkin, Display time as implicit feedback: understanding task effects, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009057]
• 7: Kim, J., Oard, D.W., Romanik, K. "Using implicit feedback for user modeling in internet and intranet searching," University of Maryland CLIS Technical Report, 2000.
• 8: Masahiro Morita , Yoichi Shinoda, Information filtering based on user behavior analysis and best match text retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.272-281, July 03-06, 1994, Dublin, Ireland
• 9: Nichols, D."Implicit Rating and Filtering," Proc. of the 5th DELOS Workshop on Filtering and Collaborative Filtering, Budapest, Hungary, 10--12, November 1997, pp. 31--36.
• 10: Badrul M. Sarwar , Joseph A. Konstan , Al Borchers , Jon Herlocker , Brad Miller , John Riedl, Using filtering agents to improve prediction quality in the GroupLens research collaborative filtering system, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.345-354, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289509]
• 11: Frank M. Shipman, III , Haowei Hsieh , Preetam Maloor , J. Michael Moore, The visual knowledge builder: a second generation spatial hypertext, Proceedings of the twelfth ACM conference on Hypertext and Hypermedia, August 14-18, 2001, Århus, none, Denmark [doi>10.1145/504216.504245]
• 12: Frank M. Shipman , Haowei Hsieh , J. Michael Moore , Anna Zacchi, Supporting personal collections across digital libraries in spatial hypertext, Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2004, Tuscon, AZ, USA [doi>10.1145/996350.996433]
• 13: Shipman, F., Price, M., Marshall, C., Golovchinsky, G., Schilit, B. "Identifying Useful Passages in Documents Based on Annotation Patterns," Proc. of European Conference on Digital Libraries, Springer Verlag, 2003, pp. 101--112.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Selection process

General Terms:
Design, Experimentation, Human Factors

Keywords:
document triage, information triage, sensemaking, user interest modeling, user interest recognition, visual knowledge builder