Effects of intelligent notification management on users and their tasks

ABSTRACT

We present a novel system for notification management and report results from two studies testing its performance and impact. The system uses statistical models to realize defer-to-breakpoint policies for managing notifications. The first study tested how well the models detect three types of breakpoints within novel task sequences. Results show that the models detect breakpoints reasonably well, but struggle to differentiate their type. Our second study explored effects of managing notifications with our system on users and their tasks. Results showed that scheduling notifications at breakpoints reduces frustration and reaction time relative to delivering them immediately. We also found that the relevance of notification content determines the type of breakpoint at which it should be delivered. The core concept of scheduling notifications at breakpoints fits well with how users prefer notifications to be managed. This indicates that users would likely adopt the use of notification management systems in practice.

REFERENCES

• 1: Piotr D. Adamczyk , Brian P. Bailey, If not now, when?: the effects of interruption at different moments within task execution, Proceedings of the SIGCHI conference on Human factors in computing systems, p.271-278, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985727]
• 2: Bailey, B.P., Adamczyk, P.D., Chang, T.Y. and Chilson, N.A. 2006. A Framework for Specifying and Monitoring User Tasks. Journal of Computers in Human Behavior, 22 (4): 685--708.
• 3: Bailey, B.P. and Konstan, J.A. 2006. On the Need for Attention Aware Systems: Measuring Effects of Interruption on Task Performance, Error Rate, and Affective State. Journal of Computers in Human Behavior, 22 (4): 709--732.
• 4: James Bo Begole , Nicholas E. Matsakis , John C. Tang, Lilsys: Sensing Unavailability, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031691]
• 5: Czerwinski, M., Cutrell, E. and Horvitz, E. Instant Messaging: Effects of Relevance and Timing. In People and Computers XIV: Proc. HCI 2000, 71--76.
• 6: James Fogarty , Scott E. Hudson, Toolkit support for developing and deploying sensor-based statistical models of human situations, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240645]
• 7: James Fogarty , Scott E. Hudson , Jennifer Lai, Examining the robustness of sensor-based statistical models of human interruptibility, Proceedings of the SIGCHI conference on Human factors in computing systems, p.207-214, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985719]
• 8: James Fogarty , Andrew J. Ko , Htet Htet Aung , Elspeth Golden , Karen P. Tang , Scott E. Hudson, Examining task engagement in sensor-based statistical models of human interruptibility, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055018]
• 9: James Fogarty , Jennifer Lai , Jim Christensen, Presence versus availability: the design and evaluation of a context-aware communication client, International Journal of Human-Computer Studies, v.61 n.3, p.299-317, September 2004 [doi>10.1016/j.ijhcs.2003.12.016]
• 10: Jennifer Gluck , Andrea Bunt , Joanna McGrenere, Matching attentional draw with utility in interruption, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240631]
• 11: Joyce Ho , Stephen S. Intille, Using context-aware computing to reduce the perceived burden of interruptions from mobile devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055100]
• 12: Eric Horvitz, Principles of mixed-initiative user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.159-166, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303030]
• 13: Eric Horvitz , Johnson Apacible, Learning and reasoning about interruption, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada [doi>10.1145/958432.958440]
• 14: Horvitz, E., Apacible, J. and Subramani, M. Balancing Awareness and Interruption: Investigation of Notification Deferral Policies. Proc.User Modeling 2005, 433--437.
• 15: Horvitz, E., Breese, J., Heckerman, D., Hovel, D. and Rommelse, K. The Lumiere Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users. Proc. UAI 1998, 256--265.
• 16: Horvitz, E., Jacobs, A. and Hovel, D. Attention-Sensitive Alerting. Proc.UAI 1999, 305--313.
• 17: Eric Horvitz , Carl Kadie , Tim Paek , David Hovel, Models of attention in computing and communication: from principles to applications, Communications of the ACM, v.46 n.3, March 2003 [doi>10.1145/636772.636798]
• 18: Horvitz, E., Koch, P., Kadie, C.M. and Jacobs, A. Coordinate: Probabilistic Forecasting of Presence and Availability. Proc. UAI 2002, 224--233.
• 19: Scott Hudson , James Fogarty , Christopher Atkeson , Daniel Avrahami , Jodi Forlizzi , Sara Kiesler , Johnny Lee , Jie Yang, Predicting human interruptibility with sensors: a Wizard of Oz feasibility study, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642657]
• 20: Shamsi T. Iqbal , Brian P. Bailey, Investigating the effectiveness of mental workload as a predictor of opportune moments for interruption, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056948]
• 21: Shamsi T. Iqbal , Brian P. Bailey, Leveraging characteristics of task structure to predict the cost of interruption, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124882]
• 22: Shamsi T. Iqbal , Brian P. Bailey, Understanding and developing models for detecting and differentiating breakpoints during interactive tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240732]
• 23: Shamsi T. Iqbal , Eric Horvitz, Disruption and recovery of computing tasks: field study, analysis, and directions, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240730]
• 24: McFarlane, D.C. 2002. Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction. HCI, 17 (1): 63--139.
• 25: Monk, C.A., Boehm-Davis, D.A. and Trafton, J.G. 2004. Recovering from Interruptions: Implications for Driver Distraction Research. Human Factors, 46 (4): 650--663.
• 26: Newtson, D. 1973. Attribution and the Unit of Perception of Ongoing Behavior. Journal of Personality and Social Psychology, 28 (1): 28--38.
• 27: Zacks, J.M. and Tversky, B. 2001. Event Structure in Perception and Conception. Psychological Bulletin, 127: 3--21.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

General Terms:
Human Factors

Keywords:
breakpoint, interruption, notification, statistical models