Predicting human interruptibility with sensors

ABSTRACT

A person seeking another person's attention is normally able to quickly assess how interruptible the other person currently is. Such assessments allow behavior that we consider natural, socially appropriate, or simply polite. This is in sharp contrast to current computer and communication systems, which are largely unaware of the social situations surrounding their usage and the impact that their actions have on these situations. If systems could model human interruptibility, they could use this information to negotiate interruptions at appropriate times, thus improving human computer interaction.This article presents a series of studies that quantitatively demonstrate that simple sensors can support the construction of models that estimate human interruptibility as well as people do. These models can be constructed without using complex sensors, such as vision-based techniques, and therefore their use in everyday office environments is both practical and affordable. Although currently based on a demographically limited sample, our results indicate a substantial opportunity for future research to validate these results over larger groups of office workers. Our results also motivate the development of systems that use these models to negotiate interruptions at socially appropriate times.

REFERENCES

• 1: Barker, R. G. 1968. Ecological Psychology. Stanford University Press.
• 2: James Bo Begole , John C. Tang , Rosco Hill, Rhythm modeling, visualizations and applications, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.11-20, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964698]
• 3: James Bo Begole , John C. Tang , Randall B. Smith , Nicole Yankelovich, Work rhythms: analyzing visualizations of awareness histories of distributed groups, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587125]
• 4: Bellotti, V. and Edwards, K. 2001. Intelligibility and accountability: Human considerations in context-aware systems. Hum.-Comput. Interact. 16, 2-4, 193--212.
• 5: Christopher J. C. Burges, A Tutorial on Support Vector Machines for Pattern Recognition, Data Mining and Knowledge Discovery, v.2 n.2, p.121-167, June 1998 [doi>10.1023/A:1009715923555]
• 6: CMU Sphinx: Open Source Speech Recognition. http://www.speech.cs.cmu.edu/sphinx/.
• 7: Cutrell, E., Czerwinski, M., and Horvitz, E. 2001. Notification, disruption, and memory: Effects of messaging interruptions on memory and performance. In Proceedings of the IFIP Conference on Human-Computer Interaction (INTERACT 2001). 263--269.
• 8: Czerwinski, M., Cutrell, E., and Horvitz, E. 2000a. Instant messaging and interruptions: Influence of task type on performance. In Proceedings of the Australian Conference on Computer-Human Interaction (OZCHI 2000). 356--361.
• 9: Czerwinski, M., Cutrell, E., and Horvitz, E. 2000b. Instant messaging: Effects of relevance and time. In Proceedings of the British HCI Group Annual Conference (HCI 2000). 71--76.
• 10: Nils Dahlbäck , Arne Jönsson , Lars Ahrenberg, Wizard of Oz studies: why and how, Proceedings of the 1st international conference on Intelligent user interfaces, p.193-200, January 04-07, 1993, Orlando, Florida, United States [doi>10.1145/169891.169968]
• 11: Duda, R. O. and Hart, P. E. 1973. Pattern Classification and Scene Analysis. John Wiley and Sons.
• 12: Thomas Erickson , Wendy A. Kellogg, Social translucence: an approach to designing systems that support social processes, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.59-83, March 2000 [doi>10.1145/344949.345004]
• 13: Lisa Feldman Barrett , Daniel J. Barrett, An introduction to computerized experience sampling in psychology, Social Science Computer Review, v.19 n.2, p.175-185, June 12 2001 [doi>10.1177/089443930101900204]
• 14: James Fogarty , Jodi Forlizzi , Scott E. Hudson, Aesthetic information collages: generating decorative displays that contain information, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502369]
• 15: James Fogarty , Scott E. Hudson , Jennifer Lai, Examining the robustness of sensor-based statistical models of human interruptibility, Proceedings of the SIGCHI conference on Human factors in computing systems, p.207-214, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985719]
• 16: James Fogarty , Jennifer Lai , Jim Christensen, Presence versus availability: the design and evaluation of a context-aware communication client, International Journal of Human-Computer Studies, v.61 n.3, p.299-317, September 2004 [doi>10.1016/j.ijhcs.2003.12.016]
• 17: Yoav Freund , Robert E. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting, Journal of Computer and System Sciences, v.55 n.1, p.119-139, Aug. 1997 [doi>10.1006/jcss.1997.1504]
• 18: Goffmann, E. 1982. On Facework. Interaction Ritual, E. Goffmann, Ed. Random House, New York, 5--45.
• 19: Mark A. Hall, Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning, Proceedings of the Seventeenth International Conference on Machine Learning, p.359-366, June 29-July 02, 2000
• 20: Hatch, M. J. 1987. Physical barriers, task characteristics, and interaction activity in research and development firms. Admin. Sci. Quart. 32, 387--399.
• 21: Jeremy M. Heiner , Scott E. Hudson , Kenichiro Tanaka, The information percolator: ambient information display in a decorative object, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.141-148, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322595]
• 22: Eric Horvitz, Principles of mixed-initiative user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.159-166, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303030]
• 23: Eric Horvitz , Johnson Apacible, Learning and reasoning about interruption, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada [doi>10.1145/958432.958440]
• 24: Horvitz, E., Breese, J., Heckerman, D., Hovel, D., and Rommelse, K. 1998. The lumiere project: Bayesian user modeling for inferring the goals and needs of software users. In Proceedings of the Conference on Uncertainty and Artificial Intelligence (UAI 1998). 256--265.
• 25: Horvitz, E., Jacobs, A., and Hovel, D. 1999. Attention-sensitive alerting. In Proceeding of the Conference on Uncertainty and Artificial Intelligence (UAI 1999). 305--313.
• 26: James M. Hudson , Jim Christensen , Wendy A. Kellogg , Thomas Erickson, "I'd be overwhelmed, but it's just one more thing to do": availability and interruption in research management, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503394]
• 27: Scott Hudson , James Fogarty , Christopher Atkeson , Daniel Avrahami , Jodi Forlizzi , Sara Kiesler , Johnny Lee , Jie Yang, Predicting human interruptibility with sensors: a Wizard of Oz feasibility study, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642657]
• 28: Ron Kohavi , George H. John, Wrappers for feature subset selection, Artificial Intelligence, v.97 n.1-2, p.273-324, Dec. 1997 [doi>10.1016/S0004-3702(97)00043-X]
• 29: Langley, P. and Sage, S. 1994. Induction of selected Bayesian classifiers. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI 1994). 399--406.
• 30: Lu, L., Zhang, H., and Jiang, H. 2002. Content analysis for audio classification and segmentation. IEEE Trans. Speech Audio Process. 10, 7, 504--516.
• 31: David Maulsby , Saul Greenberg , Richard Mander, Prototyping an intelligent agent through Wizard of Oz, Proceedings of the SIGCHI conference on Human factors in computing systems, p.277-284, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169215]
• 32: McFarlane, D. C. 2002. Comparison of four primary methods for coordinating the interruption of people in human-computer interaction. Hum.-Comput. Interact. 17, 1, 63--139.
• 33: McFarlane, D. C. 1999. Coordinating the interruption of people in human-computer interaction. In Proceedings of the IFIP Conference on Human-Computer Interaction (INTERACT 1999).
• 34: Allen E. Milewski , Thomas M. Smith, Providing presence cues to telephone users, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.89-96, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358978]
• 35: Thomas M. Mitchell, Machine Learning, McGraw-Hill Higher Education, 1997
• 36: Oliver, N., Horvitz, E., and Garg, A. 2002. Layered representations for recognizing office activity. In Proceedings of the International Conference on Multimodal Interaction (ICMI 2002). 3--8.
• 37: Perlow, L. A. 1999. The time famine: Toward a sociology of work time. In Admin. Sci. Quart. 44, 1, 57--81.
• 38: J. Ross Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 39: Johan Redström , Tobias Skog , Lars Hallnäs, Informative art: using amplified artworks as information displays, Proceedings of DARE 2000 on Designing augmented reality environments, p.103-114, April 2000, Elsinore, Denmark [doi>10.1145/354666.354677]
• 40: Albrecht Schmidt , Antti Takaluoma , Jani Mäntyjärvi, Context-Aware Telephony Over WAP, Personal and Ubiquitous Computing, v.4 n.4, p.225-229, August 2000 [doi>10.1007/s007790070008]
• 41: Sridhar Seshadri , Zur Shapira, Managerial Allocation of Time and Effort: The Effects of Interruptions, Management Science, v.47 n.5, p.647-662, May 2001 [doi>10.1287/mnsc.47.5.647.10481]
• 42: Amy Voida , Wendy C. Newstetter , Elizabeth D. Mynatt, When conventions collide: the tensions of instant messaging attributed, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503410]
• 43: Ian H. Witten , Eibe Frank, Data mining: practical machine learning tools and techniques with Java implementations, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning

Keywords:
Situationally appropriate interaction, context-aware computing, machine learning, managing human attention, sensor-based interfaces