The Infocockpit: providing location and place to aid human memory

ABSTRACT

Our work focuses on building and evaluating computer system interfaces that make information memorable. Psychology research tells us people remember spatially distributed information based on its location relative to their body, as well as the environment in which the information was learned. We apply these principles in the implementation of a multimodal prototype system, the Infocockpit (for "Information Cockpit"). The Infocockpit not only uses multiple monitors surrounding the user to engage human memory for location, but also provides ambient visual and auditory displays to engage human memory for place. We report a user study demonstrating a 56% increase in memory for information presented with our Infocockpit system as compared to a standard desktop system.

REFERENCES

• 1: Apple Computer Inc., MacIntosh Human Interface Guidelines, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992
• 2: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 3: Chance, S. S., Gaunet, F., Beall, A. C., & Loomis, J. M. (1998). Locomotion mode affects the updating of objects encountered during travel: The contribution of vestibular and proprioceptive inputs to path integration. Presence, 7(2), 168--178.
• 4: Davis, E. T., Scott, K., Pair, J., Hodges, L. F., & Oliverio, J. (1999). Can audio enhance visual perception and performance in a virtual environment? Proceedings Of The Human Factors And Ergonomics Society 43rd Annual Meeting, 1197--1201.
• 5: Franklin, N., & Tversky, B. (1990). Searching imagined environments. Journal of Experimental Psychology: General, 119(1), 63--76.
• 6: Steve Harrison , Paul Dourish, Re-place-ing space: the roles of place and space in collaborative systems, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.67-76, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240193]
• 7: D. Austin Henderson, Jr. , Stuart Card, Rooms: the use of multiple virtual workspaces to reduce space contention in a window-based graphical user interface, ACM Transactions on Graphics (TOG), v.5 n.3, p.211-243, July 1986 [doi>10.1145/24054.24056]
• 8: Lamming, M., & Flynn, M. (1994). "Forget-me-not" Intimate Computing in Support of Human Memory. Proceedings of FRIEND21, '94 International Symposium on Next Generation Human Interface, Meguro Gajoen, Japan, 125--128.
• 9: Logan, G. D. (1998). What is learned during automatization? II. Obligatory encoding of spatial location. Journal of Experimental Psychology: Human Perception & Performance, 24(6), 1720--1736.
• 10: For more information on Digidesign Pro Tools see http://www.digidesign.com/
• 11: George Robertson , Mary Czerwinski , Kevin Larson , Daniel C. Robbins , David Thiel , Maarten van Dantzich, Data mountain: using spatial memory for document management, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.153-162, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288596]
• 12: Rothkopf, E. Z. (1971). Incidental memory location of information in text. Journal of Verbal Learning and Verbal Behavior, 10, 608--613.
• 13: Daniel Salber , Anind K. Dey , Gregory D. Abowd, The context toolkit: aiding the development of context-enabled applications, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.434-441, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303126]
• 14: Smith, S. M. (1979). Remembering in and out of context. Journal of Experimental Psychology: Human Learning and Memory 5(5): 460--471.
• 15: Smith, S. M., Glenberg, A., & Bjork, R. A. (1978). Environmental context and human memory. Memory & Cognition, 6(4), 342--353.
• 16: Tulving, E. (1983). <u>Elements of episodic memory</u>. Oxford: Oxford University Press.
• 17: Matthew Turk , George Robertson, Perceptual user interfaces (introduction), Communications of the ACM, v.43 n.3, p.32-34, March 2000 [doi>10.1145/330534.330535]

INDEX TERMS

Keywords:
human memory, human-computer interaction, multimodal systems, spatially distributed information