Attention-based design of augmented reality interfaces

ABSTRACT

The objects and surfaces of a task-based environment can be layered with digital interfaces to make them easier and safer to use. Once information can be projected anywhere in the space, it becomes crucial to design the information to make optimal use of users' attention. We have prototyped and evaluated a real-world augmented reality kitchen where user-centered interfaces and displays can be projected anywhere in the space to improve its usability. The augmented environment is designed to support the activities of a variety of people in diverse kitchen environments.This paper presents five intelligent kitchen systems that layer useful interfaces onto the refrigerator, range, cabinets, countertops and sink. The interface design is driven by human factors, especially attention theory and user evaluations. By projecting interfaces where they require the least cognitive load, we hope to improve the performance and confidence of users. The design employs cueing and search principles from attention theory. We present the results of pilot studies and future directions for our work.

REFERENCES

• 1: Bonanni, L., Lee, C.H. "The Kitchen as a Graphical User Interface," in SIGGRAPH 2004 Electronic Art and Animation Catalog, 109--111.
• 2: Wendy Ju , Rebecca Hurwitz , Tilke Judd , Bonny Lee, CounterActive: an interactive cookbook for the kitchen counter, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634227]
• 3: Wendy A. Kellogg , John M. Carroll , John T. Richards, Making reality a cyberspace, Cyberspace: first steps, MIT Press, Cambridge, MA, 1991
• 4: Tara Matthews , Anind K. Dey , Jennifer Mankoff , Scott Carter , Tye Rattenbury, A toolkit for managing user attention in peripheral displays, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029676]
• 5: Pinhanez, C., "Augmenting Reality with Projected Interactive Displays," in Proc. VAA 2001.
• 6: Mark Podlaseck , Claudio Pinhanez , Nancy Alvarado , Margaret Chan , Elisa Dejesus, On interfaces projected onto real-world objects, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766001]
• 7: Sekuler, R., Blake, R. "Perception," Boston: McGRaw-Hill, 2002.
• 8: Itiro Siio , Noyuri Mima , Ian Frank , Tetsuo Ono , Hillel Weintraub, Making recipes in the kitchen of the future, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986130]
• 9: Pierre Wellner, The DigitalDesk calculator: tangible manipulation on a desk top display, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.27-33, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120785]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design

Keywords:
attention, augmented reality, interaction, perception, projection techniques, smart rooms, user evaluation