Examining the robustness of sensor-based statistical models of human interruptibility

ABSTRACT

Current systems often create socially awkward interruptions or unduly demand attention because they have no way of knowing if a person is busy and should not be interrupted. Previous work has examined the feasibility of using sensors and statistical models to estimate human interruptibility in an office environment, but left open some questions about the robustness of such an approach. This paper examines several dimensions of robustness in sensor-based statistical models of human interruptibility. We show that real sensors can be constructed with sufficient accuracy to drive the predictive models. We also create statistical models for a much broader group of people than was studied in prior work. Finally, we examine the effects of training data quantity on the accuracy of these models and consider tradeoffs associated with different combinations of sensors. As a whole, our analyses demonstrate that sensor-based statistical models of human interruptibility can provide robust estimates for a variety of office workers in a range of circumstances, and can do so with accuracy as good as or better than people. Integrating these models into systems could support a variety of advances in human computer interaction and computer-mediated communication.

REFERENCES

• 1: James Bo Begole , John C. Tang , Rosco Hill, Rhythm modeling, visualizations and applications, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.11-20, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964698]
• 2: James Bo Begole , John C. Tang , Randall B. Smith , Nicole Yankelovich, Work rhythms: analyzing visualizations of awareness histories of distributed groups, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587125]
• 3: CMU Sphinx: Open Source Speech Recognition. http://www.speech.cs.cmu.edu/sphinx/
• 4: Cutrell, E., Czerwinski, M. and Horvitz, E. (2001) Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance. Proceedings of Interact 2001.
• 5: Duda, R.O. and Hart, P.E. (1973) Pattern Classification and Scene Analysis. John Wiley and Sons.
• 6: Lisa Feldman Barrett , Daniel J. Barrett, An introduction to computerized experience sampling in psychology, Social Science Computer Review, v.19 n.2, p.175-185, June 12 2001 [doi>10.1177/089443930101900204]
• 7: James Fogarty , Scott E. Hudson , Christopher G. Atkeson , Daniel Avrahami , Jodi Forlizzi , Sara Kiesler , Johnny C. Lee , Jie Yang, Predicting human interruptibility with sensors, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.119-146, March 2005 [doi>10.1145/1057237.1057243]
• 8: James Fogarty , Jennifer Lai , Jim Christensen, Presence versus availability: the design and evaluation of a context-aware communication client, International Journal of Human-Computer Studies, v.61 n.3, p.299-317, September 2004 [doi>10.1016/j.ijhcs.2003.12.016]
• 9: Eric Horvitz , Carl Kadie , Tim Paek , David Hovel, Models of attention in computing and communication: from principles to applications, Communications of the ACM, v.46 n.3, March 2003 [doi>10.1145/636772.636798]
• 10: Horvitz, E., Koch, P., Kadie, C.M. and Jacobs, A. (2002) Coordinate: Probabilistic Forecasting of Presence and Availability. Proceedings of the National Conference on Uncertainty and Artificial Intelligence (UAI 2002).
• 11: James M. Hudson , Jim Christensen , Wendy A. Kellogg , Thomas Erickson, "I'd be overwhelmed, but it's just one more thing to do": availability and interruption in research management, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503394]
• 12: Scott Hudson , James Fogarty , Christopher Atkeson , Daniel Avrahami , Jodi Forlizzi , Sara Kiesler , Johnny Lee , Jie Yang, Predicting human interruptibility with sensors: a Wizard of Oz feasibility study, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642657]
• 13: Ron Kohavi , George H. John, Wrappers for feature subset selection, Artificial Intelligence, v.97 n.1-2, p.273-324, Dec. 1997 [doi>10.1016/S0004-3702(97)00043-X]
• 14: Langley, P. and Sage, S. (1994) Induction of Selected Bayesian Classifiers. Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI 1994).
• 15: Lu, L., Zhang, H. and Jiang, H. (2002) Content Analysis for Audio Classification and Segmentation. IEEE Transactions on Speech and Audio Processing, 10 (7). 504--516.
• 16: Jeffrey Nichols , Jacob O. Wobbrock , Darren Gergle , Jodi Forlizzi, Mediator and medium: doors as interruption gateways and aesthetic displays, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England [doi>10.1145/778712.778767]
• 17: Oliver, N., Horvitz, E. and Garg, A. (2002) Layered Representations for Recognizing Office Activity. Proceedings of the Fourth IEEE International Conference on Multimodal Interaction (ICMI 2002), 3--8.
• 18: Leysia Palen , Paul Dourish, Unpacking "privacy" for a networked world, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642635]
• 19: Perlow, L.A. (1999) The Time Famine: Toward a Sociology of Work Time. Administrative Science Quarterly, 44 (1). 57--81.
• 20: Ian H. Witten , Eibe Frank, Data mining: practical machine learning tools and techniques with Java implementations, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems

Keywords:
context-aware computing, machine learning, managing human attention, sensor-based interfaces, situationally appropriate interaction