Designing attentive interfaces

ABSTRACT

In this paper, we propose a tentative framework for the classification of Attentive Interfaces, a new category of user interfaces. An Attentive Interface is a user interface that dynamically prioritizes the information it presents to its users, such that information processing resources of both user and system are optimally distributed across a set of tasks. The interface does this on the basis of knowledge --- consisting of a combination of measures and models --- of the past, present and future state of the user's attention, given the availability of system resources. We will show how the Attentive Interface provides a natural extension to the windowing paradigm found in Graphical User Interfaces. Our taxonomy of Attentive Interfaces allows us to identify classes of user interfaces that would benefit most from the ability to sense, model and optimize the user's attentive state. In particular, we show how systems that influence user workflow in concurrent task situations, such as those involved with management of multiparty communication, may benefit from such facilities.

REFERENCES

• 1: Steve Benford , John Bowers , Lennart E. Fahlén , Chris Greenhalgh , Dave Snowdon, User embodiment in collaborative virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.242-249, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223935]
• 2: Broadbent, D. E. Perception and Communication. London: Pergamon Press, 1958.
• 3: Carter, P. and Mies van der Rohe, L. Mies Van Der Rohe at Work. Phaidon Press, 1999.
• 4: Deutsch, J. A. and Deutsch, D. Attention: Some Theoretical Considerations. Psychological Review 70, 1963, pp. 80-90.
• 5: Duchowski, A. T. and McCormick, B. H. Gaze-Contingent Video Resolution Degradation. In Human Vision and Electronic Imaging III. San Jose, CA USA: SPIE, 1998.
• 6: Duncan, S. Some Signals and Rules for Taking Speaking Turns in Conversations. Journal of Personal and Social Psychology 23, 1972.
• 7: Goldhaber, M. The Attention Economy and the Net. First Monday http://www.firstmonday.dk, 1997.
• 8: H. Helmholtz, von. Helmholtz's Treatise on Physiological Optics. Southall, J. P. C. (Ed.). New York: Dover Publications, 1962.
• 9: Horvitz, E., Jacobs, A., and Hovel, D. Attention-Sensitive Alerting. In Proceedings of UAI '99, Conference on Uncertainty and Artificial Intelligence, Stockholm, Sweden. Morgan Kaufmann: San Francisco, 1999, pp. 305-313.
• 10: James, W. The Principles of Psychology. New York: Holt, 1890.
• 11: LC Technologies, Inc. The Eyegaze Communication System. Fairfax, VA: http://www.eyegaze.com, 1997.
• 12: Murphy, H. and Duchowski, A. Gaze-Contingent Level of Detail Rendering. In EuroGraphics 2001. Manchester, UK, 2001.
• 13: Norman, D. Towards a Theory of Memory and Attention. Psychological Review 88, 1968, pp. 1-15.
• 14: Posner, M. I. Orienting of Attention. Quarterly Journal of Experimental Psychology 32, 1980, pp. 3-25.
• 15: Ted Selker , Andrea Lockerd , Jorge Martinez, Eye-R, a glasses-mounted eye motion detection interface, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634176]
• 16: Smith, D., Irby, C., Kimball, R., Verplank, B., and Harslem, E. Designing the Star User Interface. Byte 7(4), 1982, pp. 242-282.
• 17: Treismann, A. and Gelade, G. A Feature-Integration Theory of Attention. Cognitive Psychology 12, 1980, pp. 97-136.
• 18: Gerrit C. van der Veer , Diederik Broos , Kenneth Donau , Mark J. Fokke , Felix Yap, ETAG: Some applications of a formal representation of the user interface, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.169-174, August 27-31, 1990
• 19: Boris M. Velichkovsky , John Paulin Hansen, New technological windows into mind: there is more in eyes and brains for human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.496-503, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238619]
• 20: Boris Velichkovsky , Andreas Sprenger , Pieter Unema, Towards gaze-mediated interaction: Collecting solutions of the "Midas touch problem", Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.509-516, July 14-18, 1997
• 21: Roel Vertegaal, The GAZE groupware system: mediating joint attention in multiparty communication and collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.294-301, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303065]
• 22: Roel Vertegaal , Connor Dickie , Changuk Sohn , Myron Flickner, Designing attentive cell phone using wearable eyecontact sensors, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506526]
• 23: Roel Vertegaal , Robert Slagter , Gerrit van der Veer , Anton Nijholt, Why conversational agents should catch the eye, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633442]
• 24: Roel Vertegaal , Robert Slagter , Gerrit van der Veer , Anton Nijholt, Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes, Proceedings of the SIGCHI conference on Human factors in computing systems, p.301-308, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365119]
• 25: Vertegaal, R., Van der Veer, G. C., and Vons, H. Effects of Gaze on Multiparty Mediated Communication. In Proceedings of Graphics Interface 2000. Montreal, Canada: Morgan Kaufmann Publishers, 2000, pp. 95-102.
• 26: Roel Vertegaal , Boris Velichkovsky , Gerrit van der Veer, Catching the eye: management of joint attention in cooperative work, ACM SIGCHI Bulletin, v.29 n.4, p.87-92, Oct. 1997 [doi>10.1145/270950.270998]
• 27: Shumin Zhai , Carlos Morimoto , Steven Ihde, Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.246-253, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303053]
• 28: Zhang, J. and Norman, D. Representations in Distributed Cognitive Tasks. Cognitive Science 18, 1994, pp. 87-122.

INDEX TERMS

Keywords:
Attention, Attentive Interfaces, Eye Tracking, Nonverbal Computing, User Interfaces