A New Framework for Theory-Based Interaction Design Applied to Serendipitous Information Retrieval

ABSTRACT

The activities of opportunistic and involuntary browsing offer the potential for many of a user's latent problems to be resolved serendipitously, with negligible cognitive effort. In this article, we demonstrate how the design of two novel artifacts to support such behavior was based on a set of Design Actions which were derived from a model of browsing behavior in combination with a cognitive model of human visual information processing. We propose the concept of Design Actions as a way of avoiding the need for an interaction designer associated with these and similar artifacts to understand the cognitive theories underlying them.

REFERENCES

• 1: Phil Barnard, Bridging between basic theories and the artifacts of human-computer interaction, Designing interaction: psychology at the human-computer interface, Cambridge University Press, New York, NY, 1991
• 2: Philip Barnard , Jon May , David Duke , David Duce, Systems, interactions, and macrotheory, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.2, p.222-262, June 2000 [doi>10.1145/353485.353490]
• 3: Jan Borchers , Frank Buschmann, A Pattern Approach to Interaction Design, John Wiley & Sons, Inc., New York, NY, 2001
• 4: Carmel, E., Crawford, S., and Chen, H. 1992. Browsing in hypertext: A cognitive study, IEEE Trans. Syst. Man Cybernetics 22, 865--884.
• 5: Carroll, J. M. 1995. Introduction: The scenario perspective on system development. In Scenario-Based Design: Envisioning Work and Technology in System Development, J. M. Carroll, Ed. John Wiley & Sons, New York, NY, 1--17.
• 6: John M. Carroll , Mary Beth Rosson, Getting around the task-artifact cycle: how to make claims and design by scenario, ACM Transactions on Information Systems (TOIS), v.10 n.2, p.181-212, April 1992 [doi>10.1145/146802.146834]
• 7: Lara D. Catledge , James E. Pitkow, Characterizing browsing strategies in the World-Wide Web, Computer Networks and ISDN Systems, v.27 n.6, p.1065-1073, April 1995
• 8: Clark, H. H. 1996. Using Language. Cambridge University Press, Cambridge, UK.
• 9: Coltheart, V. 1999. Fleeting Memories. MIT Press, Cambridge, MA.
• 10: Oscar de Bruijn , Robert Spence, Rapid serial visual presentation: a space-time trade-off in information presentation, Proceedings of the working conference on Advanced visual interfaces, p.189-192, May 2000, Palermo, Italy [doi>10.1145/345513.345309]
• 11: O. de Bruijn , R. Spence , M. Y. Chong, RSVP Browser: Web Browsing on Small Screen Devices, Personal and Ubiquitous Computing, v.6 n.4, p.245-252, September 2002 [doi>10.1007/s007790200024]
• 12: Oscar de Bruijn , Robert Spence , Chieh Hao Tong, Movement in the web, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634192]
• 13: de Bruijn, O. and Tong, C. H. 2003. M-RSVP: Mobile Web browsing on a PDA. In People and Computers XVII - Designing for Society, E. O'Neill, P. Palanque and P. Johnson, Eds. Springer, Berlin, Germany, 297--311.
• 14: Foster, A. and Ford, N. 2003. Serendipity and information seeking: an empirical study. J. Documen. 59, 321--340.
• 15: Intraub, H. 1980. Presentation rate and the representation of briefly glimpsed pictures in memory. J. Exper. Psych.-Hum. Learn. Memory 6, 1--12.
• 16: Intraub, H. 1981. Rapid conceptual identification of sequentially presented pictures. J. Exper. Psych.-Hum. Percep. Perform. 7, 604--610.
• 17: Intraub, H. 1984. Conceptual masking - the effects of subsequent visual events on memory for pictures. J. Exper. Psych.-Learn. Memory Cognition 10, 115--125.
• 18: Intraub, H. 1999. Understanding and remembering briefly glimpsed pictures: Implications for visual scanning and memory. In Fleeting Memories, V. Coltheart, Ed. MIT Press, Cambridge, MA.
• 19: Matt Jones , Gary Marsden , Norliza Mohd-Nasir , Kevin Boone , George Buchanan, Improving Web interaction on small displays, Proceedings of the eighth international conference on World Wide Web, p.1129-1137, May 1999, Toronto, Canada
• 20: Kaasten, S., Greenberg, S., and Edwards, C. 2002. How people recognize previously seen Web pages from titles, URLs and thumbnails. In Proceedings of HCI'02 People and Computers XVI, X. Faulkner, J. Finlay and F. Detienne, Eds. Springer, Berlin, Germany, 247--266.
• 21: Lavie, N. 2000. Selective attention and cognitive control: Dissociating attentional functions through different types of load. In Attention and Performance: Vol. XVIII. Control of Cognitive Processes, S. Monsell and J. Driver, Eds. MIT Press, Cambridge, MA, 175--197.
• 22: Miyata, Y. and Norman, D. A. 1986. Psychological issues in support of multiple activities. In User Centred System Design: New Perspectives on Human-Computer Interaction, D. A. Norman and S. W. Draper, Eds. LEA, Hillsdale, NJ, 265--284.
• 23: Moyes, J. and Jordan, P. W. 1993. Icon design and its effect on guessability, learnability, and experienced user performance, In Proceedings of the HCI'93 Conference on People and Computers VIII, J. L. Alty, D. Diaper and S. Guest, Eds. Cambridge University Press, Cambridge, UK, 49--59.
• 24: Neisser, U. 1967. Cognitive Psychology. Prentice-Hall, Englewood Cliffs, NJ.
• 25: Norman, D. A. 1986. Cognitive engineering, In User Centered System Design: New Perspectives on Human-Computer Interaction, D. A. Norman and S. Draper, Eds. LEA, Hillsdale, NJ.
• 26: Lucy Nowell , Elizabeth Hetzler , Ted Tanasse, Change Blindness in Information Visualization: A Case Study, Proceedings of the IEEE Symposium on Information Visualization 2001 (INFOVIS'01), p.15, October 22-23, 2001
• 27: Ogmen, H. and Breitmeyer, B. 2006. The First Half Second: The Microgenesis and Temporal Dynamics of Unconscious and Conscious Visual Processes. MIT Press, Cambridge, MA.
• 28: Öqvist, G., Goldstein, M., and Chincholle, D. 2004. Assessing usability across multiple user interfaces. In Multiple User Interfaces: Cross Platform Applications and Context-Aware Interfaces, A. Seffah and H. Javahery, Eds. John Wiley & Sons, New York, NY, 327--349.
• 29: Payne, J. W., Johnson, E. J., and Betmann, J. R. 1993. The Adaptive Decision Maker. Cambridge University Press, Cambridge, UK.
• 30: Pirolli, P. 2005. Rational analyses of information foraging on the Web, Cognitive Sci. 29, 343--373.
• 31: Peter Pirolli , Stuart Card, Information foraging in information access environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.51-58, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223911]
• 32: Potter, M. C. 1975. Meaning in visual search. Science 187, 965--966.
• 33: Potter, M. C. 1976. Short-term conceptual memory for pictures. J. Exper. Psych.-Hum. Learn. Memory 2, 509--522.
• 34: Potter, M. C. 1993. Very short-term conceptual memory. Memory Cognition 21, 156--161.
• 35: Potter, M. C. 1999. Understanding sentences and scenes: The role of conceptual short-term memory. In Fleeting Memories, V. Coltheart, Ed. MIT Press, Cambridge, MA.
• 36: Potter, M. C. and Levy, E. I. 1969. Recognition memory for a rapid sequence of pictures. J. Exper. Psych. 81, 10--&.
• 37: Potter, M. C., Staub, A., Rado, J., and O'Connor, D. H. 2002. Recognition memory for briefly presented pictures: The time course of rapid forgetting. J. Exper. Psych.-Hum. Percep. Perform. 28, 1163--1175.
• 38: Raymond, J. E., Shapiro, K. L., and Arnell, K. M. 1992. Temporary suppression of visual processing in an RSVP task - an attentional blink. J. Exper. Psych.-Hum. Percep. Perform. 18, 849--860.
• 39: Kathy Ryall , Clifton Forlines , Chia Shen , Meredith Ringel Morris, Exploring the effects of group size and table size on interactions with tabletop shared-display groupware, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031654]
• 40: Robert Spence, A framework for navigation, International Journal of Human-Computer Studies, v.51 n.5, p.919-945, Nov. 1999 [doi>10.1006/ijhc.1999.0265]
• 41: Robert Spence, Rapid, serial and visual: a presentation technique with potential, Information Visualization, v.1 n.1, p.13-19, March 2002 [doi>10.1057/palgrave/ivs/9500008]
• 42: Spence, R. 2004. Sensitivity, residue and scent. Concepts to inform interaction design for the support of information space navigation. Inform. Des. J. 12, 163--180.
• 43: Bob Spence , Mark Witkowski , Catherine Fawcett , Brock Craft , Oscar de Bruijn, Image presentation in space and time: errors, preferences and eye-gaze activity, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989884]
• 44: Standing, L. 1973. Learning 10,000 pictures. Quart. J. Exper. Psych. 25, 207--222.
• 45: Stathis, K., de Bruijn, O., and Macedo, S. 2002. Living Memory: agent-based information management for connected local communities, Interac. Comput. 14, 663--688.
• 46: Alistair Sutcliffe, On the effective use and reuse of HCI knowledge, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.2, p.197-221, June 2000 [doi>10.1145/353485.353488]
• 47: A. G. Sutcliffe , J. M. Carroll, Designing claims for reuse in interactive systems design, International Journal of Human-Computer Studies, v.50 n.3, p.213-241, March 1999 [doi>10.1006/ijhc.1999.0245]
• 48: Sutcliffe, A. G. and Kaur, K. 2000. Evaluating the usability of virtual reality user interfaces. Behav. Inform. Techn. 19, 415--426.
• 49: Sutcliffe, A. G. and Ryan, M. 2000. Model mismatch analysis: Towards a deeper explanation of users' usability problems. Behav. Inform. Techn. 19, 43--55.
• 50: Jenifer Tidwell, Designing Interfaces, O'Reilly Media, Inc., 2005
• 51: Tony Tse , Gary Marchionini , Wei Ding , Laura Slaughter , Anita Komlodi, Dynamic key frame presentation techniques for augmenting video browsing, Proceedings of the working conference on Advanced visual interfaces, May 24-27, 1998, L'Aquila, Italy [doi>10.1145/948496.948522]
• 52: Van Welie, M. 2002. Interaction Design Patterns, http://www.welie.com/patterns/index.html.
• 53: Shahtab Wahid, Investigating design knowledge reuse for interface development, Proceedings of the 6th conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA [doi>10.1145/1142405.1142462]
• 54: Andrew Walenstein, Theory adapters as discipline coordinators, Proceedings of the 2004 ACM workshop on Interdisciplinary software engineering research, November 05-05, 2004, Newport Beach, CA, USA [doi>10.1145/1029997.1030001]
• 55: Kent Wittenburg , Wissam Ali-Ahmad , Daniel LaLiberte , Tom Lanning, Rapid-fire image previews for information navigation, Proceedings of the working conference on Advanced visual interfaces, May 24-27, 1998, L'Aquila, Italy [doi>10.1145/948496.948508]
• 56: Kent Wittenburg , Clifton Forlines , Tom Lanning , Alan Esenther , Shigeo Harada , Taizo Miyachi, Rapid serial visual presentation techniques for consumer digital video devices, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.115-124, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964709]
• 57: Yantis, S. and Jonides, J. 1990. Abrupt visual onsets and selective attention - voluntary versus automatic allocation. J. Exper. Psych.-Hum. Percep. Perform. 16, 121--134.
• 58: Zeigarnik, B. 1938. On finished and unfinished tasks. In A Source Book of Gestalt Psychology, W. D. Ellis, Ed. Harcourt-Brace, New York, NY.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods

General Terms:
Design, Experimentation, Human Factors, Theory

Keywords:
Human-computer interaction, cognition, design actions, involuntary browsing, mobile Web browsing, opportunistic browsing, rapid serial visual presentation, serendipity, table-top interaction