combinFormation: a mixed-initiative system for representing collections as compositions of image and text surrogates

ABSTRACT

People need to find, work with, and put together information. Diverse activities, such as scholarly research, comparison shopping, and entertainment involve collecting and connecting information resources. We need to represent collections in ways that promote understanding of individual information resources and also their relationships. Representing individual resources with images as well as text makes good use of human cognitive facilities. Composition, an alternative to lists, means putting representations of elements in a collection together using design principles to form a connected whole.We develop combinFormation, a mixed-initiative system for representing collections as compositions of image and text surrogates. The system provides a set of direct manipulation facilities for forming, editing, organizing, and distributing collections as compositions. Additionally, to assist users in sifting through the vast expanse of potentially relevant information resources, the system also includes a generative agent that can proactively engage in processes of collecting information resources and forming image and text surrogates. A generative temporal visual composition agent develops the collection and its visual representation over time, enabling users to see more possibilities. To keep the user in control, we develop interactive techniques that enable the user to direct the agent.For evaluation, we conducted a field study in an undergraduate general education course offered in the architecture department. Alternating groups of students used combinFormation as an aid in preparing one of two major assignments involving information discovery to support processes of invention. The students that used combinFormation were found to perform better.

REFERENCES

• 1: Robert Amar , John Stasko, BEST PAPER: A Knowledge Task-Based Framework for Design and Evaluation of Information Visualizations, Proceedings of the IEEE Symposium on Information Visualization (INFOVIS'04), p.143-150, October 10-12, 2004 [doi>10.1109/INFOVIS.2004.10]
• 2: Baddeley, A.D., Is working memory working?, Quarterly Journal of Exp Psych, 44A, 1--31, 1992.
• 3: Belkin, N., ASK for Information Retrieval: Part I. Background and Theory, Journal of Documentation, Vol 38, Num 2, 1982.
• 4: Burke, M., Organization of Multimedia Resources, Hampshire, UK: Gower, 1999.
• 5: Michelle Chang , John J. Leggett , Richard Furuta , Andruid Kerne , J. Patrick Williams , Samuel A. Burns , Randolph G. Bias, Collection understanding, Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2004, Tuscon, AZ, USA [doi>10.1145/996350.996426]
• 6: Michelangelo Diligenti , Frans Coetzee , Steve Lawrence , C. Lee Giles , Marco Gori, Focused Crawling Using Context Graphs, Proceedings of the 26th International Conference on Very Large Data Bases, p.527-534, September 10-14, 2000
• 7: Wei Ding , Gary Marchionini , Dagobert Soergel, Multimodal surrogates for video browsing, Proceedings of the fourth ACM conference on Digital libraries, p.85-93, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313266]
• 8: Finke, R., Ward, T., Smith, S.M., Creative Cognition, Cambridge, MA, MIT Press, 1992.
• 9: Gentner, D., Stevens, A.L., eds., Mental Models, Hillsdale, NJ: Erlbaum, 99--129, 1983.
• 10: Glenberg, A.M., Langston, W.E., Comprehension of illustrated text: Pictures help to build mental models, Journal of Memory & Language, 31(2):129--151, April 1992.
• 11: Eric Horvitz, Principles of mixed-initiative user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.159-166, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303030]
• 12: Jones, W., Dumais, S., Bruce, H., Once found, what then?: a study of 'keeping' behaviors in personal use of Web information. Proc ASIST 2002, November 18--21, 2002, 391--402.
• 13: Interface Ecology Lab, combinFormation, http://ecologylab.cs.tamu.edu/combinFormation/
• 14: Andruid Kerne , Ken Perlin, Collagemachine: a model of "interface ecology", 2001
• 15: Andruid Kerne , Madhur Khandelwal , Vikram Sundaram, Publishing evolving metadocuments on the web, Proceedings of the fourteenth ACM conference on Hypertext and hypermedia, August 26-30, 2003, Nottingham, UK [doi>10.1145/900051.900072]
• 16: Andruid Kerne , Steven M. Smith, The information discovery framework, Proceedings of the 2004 conference on Designing interactive systems: processes, practices, methods, and techniques, August 01-04, 2004, Cambridge, MA, USA [doi>10.1145/1013115.1013179]
• 17: Kerne, A., Smith, S.M., Mistrot, J.M., Sundaram, V., Khandelwal, M., Mapping Interest and Design to Facilitate Creative Process During Mixed-Initiative Information Composition, Proc Interaction: Systems, Practice and Theory, Creativity & Cognition Symposium 2004, 1--25.
• 18: Andruid Kerne , Steven M. Smith , Hyun Choi , Ross Graeber , Daniel Caruso, Evaluating navigational surrogate formats with divergent browsing tasks, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056960]
• 19: Kerne, A., Koh, E., Smith, S.M., Choi, H., Graeber, R., Caruso, D., Composition of Image and Text Surrogates Supports Expression During Information Discovery, submitted to DIS06.
• 20: Gary Marchionini, Information seeking in electronic environments, Cambridge University Press, New York, NY, 1997
• 21: Catherine C. Marshall , Frank M. Shipman, III , James H. Coombs, VIKI: spatial hypertext supporting emergent structure, Proceedings of the 1994 ACM European conference on Hypermedia technology, p.13-23, September 19-23, 1994, Edinburgh, Scotland [doi>10.1145/192757.192759]
• 22: McNee, S.M. Lam, S. Konstan, J.A., Riedl, J. Interfaces for Eliciting New User Preferences in Recommender Systems. Proc User Modeling 2003, 178--188.
• 23: Julie B. Morrison , Peter Pirolli , Stuart K. Card, A taxonomic analysis of what world wide web activities significantly impact people's decisions and actions, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634167]
• 24: Oxford English Dictionary on Compact Disk, 2nd Edition. Oxford: Oxford University Press, 1992.
• 25: Pirolli, P., Card, S.K., Information Foraging, Psychological Review, 106:4, Oct 1999, 643--675.
• 26: Peter Pirolli , James Pitkow , Ramana Rao, Silk from a sow's ear: extracting usable structures from the Web, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.118-125, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238450]
• 27: Porter, M. F., An algorithm for suffix stripping, Program, 14(3), 1980, 130--137.
• 28: Rocchio, J., Relevance feedback in information retrieval, In The Smart Retrieval System-Experiments in Automatic Document Processing, Prentice-Hall, Englewood Cliffs, NJ, 313--323, 1971.
• 29: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 30: Ben Shneiderman , Pattie Maes, Direct manipulation vs. interface agents, interactions, v.4 n.6, p.42-61, Nov./Dec. 1997 [doi>10.1145/267505.267514]
• 31: Shah, J. J., Smith, S. M., Vargas-Hernandez, N., Gerkens, R., & Wulan, M., Empirical studies of design ideation: Alignment of design experiments with laboratory experiments, Proc Am Soc Mechanical Engineering, 2003.
• 32: Edward Tufte, Envisioning information, Graphics Press, Cheshire, CT, 1990
• 33: Allison Woodruff , Ruth Rosenholtz , Julie B. Morrison , Andrew Faulring , Peter Pirolli, A comparison of the use of text summaries, plain thumbnails, and enhanced thumbnails for Web search tasks, Journal of the American Society for Information Science and Technology, v.53 n.2, p.172-185, January 15, 2002 [doi>10.1002/asi.10029]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

General Terms:
Design, Experimentation, Human Factors

Keywords:
collections, information discovery, mixed-initiative systems