Have a say over what you see: evaluating interactive compression techniques

ABSTRACT

We all encounter many documents on a daily basis that we do not have time to process in their entirety. Nevertheless, we lack good tools to rapidly skim and identify key information from within such documents. This paper develops and evaluates Interactive Compression (IC) techniques that allow users to dynamically configure the amount of information they view in a document, e.g. by automatically removing unimportant information from view (Excision) or by making important information more salient (Highlighting). We explore IC techniques in the context of meeting transcripts that are typically unstructured - making it difficult to isolate relevant regions and extract key information. We demonstrate the superiority of IC compared with an unmodified text control. In contrast to traditional summaries, our results show extensive use of interactive, as opposed to fixed compression level, summarization. They also show the value of word- as opposed to utterance-based compression. There are also trade-offs between different IC designs. Excision allows users to scan documents faster than Highlighting but at the expense of overlooking relevant sections of the document.

REFERENCES

• 1: AMI. http://www.amiproject.org. 2008.
• 2: Lyn Bartram , Albert Ho , John Dill , Frank Henigman, The continuous zoom: a constrained fisheye technique for viewing and navigating large information spaces, Proceedings of the 8th annual ACM symposium on User interface and software technology, p.207-215, November 15-17, 1995, Pittsburgh, Pennsylvania, United States [doi>10.1145/215585.215977]
• 3: Sumit Basu , Surabhi Gupta , Milind Mahajan , Patrick Nguyen , John C. Platt, Scalable summaries of spoken conversations, Proceedings of the 13th international conference on Intelligent user interfaces, January 13-16, 2008, Gran Canaria, Spain [doi>10.1145/1378773.1378809]
• 4: Patrick Baudisch , Nathaniel Good , Victoria Bellotti , Pamela Schraedley, Keeping things in context: a comparative evaluation of focus plus context screens, overviews, and zooming, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503423]
• 5: Benjamin B. Bederson , James D. Hollan, Pad++: a zoomable graphical interface system, Conference companion on Human factors in computing systems, p.23-24, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223394]
• 6: CALO. http://caloproject.sri.com. 2008.
• 7: E. Chi et al. Visual foraging of highlighted text: An eye-tracking study. In Proceedings of CHI, 2006.
• 8: CHIL. http://chil.server.de/servlet/is/101. 2008.
• 9: Douglass R. Cutting , David R. Karger , Jan O. Pedersen , John W. Tukey, Scatter/Gather: a cluster-based approach to browsing large document collections, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.318-329, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133214]
• 10: G. W. Furnas, Generalized fisheye views, Proceedings of the SIGCHI conference on Human factors in computing systems, p.16-23, April 13-17, 1986, Boston, Massachusetts, United States
• 11: T. Hayama et al. Personalized environments for skimming documents. In V. Palade, R. Howlett, and L. Jain, editors, Lecture Notes In Computer Science, volume 2774, pages pp. 771--778. Springer-Verlag, 2003.
• 12: Marti A. Hearst, TileBars: visualization of term distribution information in full text information access, Proceedings of the SIGCHI conference on Human factors in computing systems, p.59-66, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223912]
• 13: M. Hearst. User interfaces and visualization. In R. Baeza-Yates and B. RIbeiro-Neto, editors, Modern Information Retrieval. Addison-Wesley, 1999.
• 14: Lars Erik Holmquist, Focus+context visualization with flip zooming and the zoom browser, CHI '97 extended abstracts on Human factors in computing systems: looking to the future, March 22-27, 1997, Atlanta, Georgia [doi>10.1145/1120212.1120383]
• 15: K. S. Jones. A statistical interpretation of term specificity and its application in retreival. Journal of Documentation, 28:11--21, 1972.
• 16: S. Jones , S. Lundy , G. Paynter, Interactive Document Summarisation Using Automatically Extracted Keyphrases, Proceedings of the 35th Annual Hawaii International Conference on System Sciences (HICSS'02)-Volume 4, p.101.3, January 07-10, 2002
• 17: D. Lalanne et al. The IM2 multimodal meeting browser family. Technical report, IM2 Project, 2005.
• 18: Anton Leuski , Chin-Yew Lin , Eduard Hovy, iNeATS: interactive multi-document summarization, Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, p.125-128, July 07-12, 2003, Sapporo, Japan [doi>10.3115/1075178.1075197]
• 19: I. Mani. Automatic Summarization. John Benjamins, 2001.
• 20: I. McCowan et al. The AMI meeting corpus. In Proceedings of the Measuring Behavior 2005 symposium on Annotating and Measuring Meeting Behavior, 2005.
• 21: G. Murray and S. Renals. Dialogue act compression via pitch contour preservation. In Proceedings of the 9th International Conference on Spoken Language Processing, Pittsburgh, USA, Sept. 2006.
• 22: Ani Nenkova , Lucy Vanderwende , Kathleen McKeown, A compositional context sensitive multi-document summarizer: exploring the factors that influence summarization, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148269]
• 23: P. Pirolli and S. Card. Information foraging. Psychological Review, 106(4):643--675, 1999.
• 24: R. Rienks and D. Heylen. Automatic dominance detection in meetings using easily obtainable features. In H. Bourlard and S. Renals, editors, Lecture Notes In Computer Science. Springer Verlag, Berlin, 2006.
• 25: Simon Tucker , Nicos Kyprianou , Steve Whittaker, Time-Compressing Speech: ASR Transcripts Are an Effective Way to Support Gist Extraction, Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction, September 08-10, 2008, Utrecht, The Netherlands [doi>10.1007/978-3-540-85853-9_21]
• 26: Simon Tucker , Steve Whittaker, Time is of the essence: an evaluation of temporal compression algorithms, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124822]
• 27: Simon Tucker , Steve Whittaker, Have a say over what you see: evaluating interactive compression techniques, Proceedings of the 13th international conference on Intelligent user interfaces, February 08-11, 2009, Sanibel Island, Florida, USA [doi>10.1145/1502650.1502659]
• 28: Steve Whittaker , Julia Hirschberg , Brian Amento , Litza Stark , Michiel Bacchiani , Philip Isenhour , Larry Stead , Gary Zamchick , Aaron Rosenberg, SCANMail: a voicemail interface that makes speech browsable, readable and searchable, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503426]
• 29: Steve Whittaker , Julia Hirschberg , John Choi , Don Hindle , Fernando Pereira , Amit Singhal, SCAN: designing and evaluating user interfaces to support retrieval from speech archives, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.26-33, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312639]
• 30: Steve Whittaker , Simon Tucker , Kumutha Swampillai , Rachel Laban, Design and evaluation of systems to support interaction capture and retrieval, Personal and Ubiquitous Computing, v.12 n.3, p.197-221, January 2008 [doi>10.1007/s00779-007-0146-3]
• 31: Polle T. Zellweger , Anne Mangen , Paula Newman, Reading and writing fluid Hypertext Narratives, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513353]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

General Terms:
Human Factors

Keywords:
gist, interactive compression, meetings, reading, scanning, summary