Leveraging characteristics of task structure to predict the cost of interruption

ABSTRACT

A challenge in building interruption reasoning systems is to compute an accurate cost of interruption (COI). Prior work has used interface events and other cues to predict COI, but ignore characteristics related to the structure of a task. This work investigates how well characteristics of task structure can predict COI, as objectively measured by resumption lag. In an experiment, users were interrupted during task execution at various boundaries to collect a large sample of resumption lag values. Statistical methods were employed to create a parsimonious model that uses characteristics of task structure to predict COI. A subsequent experiment with different tasks showed that the model can predict COI with reasonably high accuracy. Our model can be expediently applied to many goal-directed tasks, allowing systems to make more effective decisions about when to interrupt.

REFERENCES

• 1: Piotr D. Adamczyk , Brian P. Bailey, If not now, when?: the effects of interruption at different moments within task execution, Proceedings of the SIGCHI conference on Human factors in computing systems, p.271-278, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985727]
• 2: Altmann, E.M. and J.G. Trafton. Task Interruption: Resumption Lag and the Role of Cues. CogSci, 2004.
• 3: Bailey, B.P., P.D. Adamczyk, T.Y. Chang and N.A. Chilson. A Framework for Specifying and Monitoring User Tasks. Journal of Computers in Human Behavior, to appear, 2006.
• 4: Bailey, B.P. and J.A. Konstan. On the Need for Attention Aware Systems: Measuring Effects of Interruption on Task Performance, Error Rate, and Affective State. Journal of Computers in Human Behavior, to appear, 2006.
• 5: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 6: Chung, P.H. and M.D. Byrne. Visual Cues to Reduce Errors in a Routine Procedural Task. CogSci, 2004.
• 7: Edward B. Cutrell , Mary Czerwinski , Eric Horvitz, Effects of instant messaging interruptions on computing tasks, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633351]
• 8: Czerwinski, M., E. Cutrell and E. Horvitz. Instant Messaging and Interruption: Influence of Task Type on Performance. Annual Conference of the Human Factors and Ergonomics Society of Australia (OZCHI) , 2000, 356--361.
• 9: Czerwinski, M., E. Cutrell and E. Horvitz. Instant Messaging: Effects of Relevance and Timing. People and Computers XIV: Proceedings of HCI, 2000, 71--76.
• 10: Mary Czerwinski , Eric Horvitz , Susan Wilhite, A diary study of task switching and interruptions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.175-182, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985715]
• 11: Degani, A. and E. Wiener. Cockpit Checklists: Concepts, Design, and Use. Human Factors, 35 (2), 345--359, 1993.
• 12: Anton N. Dragunov , Thomas G. Dietterich , Kevin Johnsrude , Matthew McLaughlin , Lida Li , Jonathan L. Herlocker, TaskTracer: a desktop environment to support multi-tasking knowledge workers, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040855]
• 13: James Fogarty , Scott E. Hudson , Jennifer Lai, Examining the robustness of sensor-based statistical models of human interruptibility, Proceedings of the SIGCHI conference on Human factors in computing systems, p.207-214, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985719]
• 14: James Fogarty , Andrew J. Ko , Htet Htet Aung , Elspeth Golden , Karen P. Tang , Scott E. Hudson, Examining task engagement in sensor-based statistical models of human interruptibility, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055018]
• 15: Eric Horvitz , Johnson Apacible, Learning and reasoning about interruption, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada [doi>10.1145/958432.958440]
• 16: Horvitz, E., A. Jacobs and D. Hovel. Attention-Sensitive Alerting. Conference Proceedings on Uncertainty in Artificial Intelligence, 1999, 305--313.
• 17: Eric Horvitz , Paul Koch , Johnson Apacible, BusyBody: creating and fielding personalized models of the cost of interruption, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031690]
• 18: James M. Hudson , Jim Christensen , Wendy A. Kellogg , Thomas Erickson, "I'd be overwhelmed, but it's just one more thing to do": availability and interruption in research management, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503394]
• 19: Scott Hudson , James Fogarty , Christopher Atkeson , Daniel Avrahami , Jodi Forlizzi , Sara Kiesler , Johnny Lee , Jie Yang, Predicting human interruptibility with sensors: a Wizard of Oz feasibility study, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642657]
• 20: Shamsi T. Iqbal , Piotr D. Adamczyk , Xianjun Sam Zheng , Brian P. Bailey, Towards an index of opportunity: understanding changes in mental workload during task execution, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055016]
• 21: Shamsi T. Iqbal , Brian P. Bailey, Investigating the effectiveness of mental workload as a predictor of opportune moments for interruption, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056948]
• 22: Jackson, T.W., R.J. Dawson and D. Wilson. The Cost of Email Interruption. Journal of Systems and Information Technology, 5 (1), 81--92, 2001.
• 23: Bonnie E. John , Konstantine Prevas , Dario D. Salvucci , Ken Koedinger, Predictive human performance modeling made easy, Proceedings of the SIGCHI conference on Human factors in computing systems, p.455-462, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985750]
• 24: Paul P. Maglio , Christopher S. Campbell, Tradeoffs in displaying peripheral information, Proceedings of the SIGCHI conference on Human factors in computing systems, p.241-248, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332438]
• 25: D. Scott McCrickard , Richard Catrambone , C. M. Chewar , John T. Stasko, Establishing tradeoffs that leverage attention for utility: empirically evaluating information display in notification systems, International Journal of Human-Computer Studies, v.58 n.5, p.547-582, May 2003 [doi>10.1016/S1071-5819(03)00022-3]
• 26: McFarlane, D.C. Coordinating the Interruption of People in Human-Computer Interaction. Proceedings of the IFIP TC.13 International Conference on Human-Computer Interaction, 1999, 295--303.
• 27: McFarlane, D.C. and K.A. Latorella. The Scope and Importance of Human Interruption in Hci Design. Human-Computer Interaction, 17 (1), 1--61, 2002.
• 28: Miyata, Y. and D.A. Norman. Psychological Issues in Support of Multiple Activities. In Norman, D.A. and Draper, S.W. (eds.) User Centered System Design: New Perspectives on Human-Computer Interaction, Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, 265--284.
• 29: Monk, C.A., D.A. Boehm-Davis and J.G. Trafton. The Attentional Costs of Interrupting Task Performance at Various Stages. HFES, 2002.
• 30: Navon, D. and D. Gopher. On the Economy of the Human Processing Systems. Psychological Review, 86, 254--255, 1979.
• 31: Newell, A. and P.S. Rosenbloom. Mechanisms of Skill Acquisition and the Law of Practice. In Anderson, J.R. ed. Cognitive Skills and Their Acquisition, Erlbaum, Hillsdale, NJ, 1981, 1--55.
• 32: Frank E. Ritter , Gordon D. Baxter , Gary Jones , Richard M. Young, Supporting cognitive models as users, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.2, p.141-173, June 2000 [doi>10.1145/353485.353486]
• 33: Rubinstein, J.S., D.E. Meyer and J.E. Evans. Executive Control of Cognitive Processes in Task Switching. Journal of Experimental Psychology: Human Perception and Performance, 27 (4), 763--797, 2001.
• 34: Shneiderman, B. Designing the User Interface. Pearson Addison Wesley, Third Edition, 1997.
• 35: Irene Tollinger , Richard L. Lewis , Michael McCurdy , Preston Tollinger , Alonso Vera , Andrew Howes , Laura Pelton, Supporting efficient development of cognitive models at multiple skill levels: exploring recent advances in constraint-based modeling, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055029]
• 36: J. Gregory Trafton , Erik M. Altmann , Derek P. Brock , Farilee E. Mintz, Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal, International Journal of Human-Computer Studies, v.58 n.5, p.583-603, May 2003 [doi>10.1016/S1071-5819(03)00023-5]
• 37: Wickens, C.D. Multiple Resources and Performance Prediction. Theoretical Issues in Ergonomic Science, 3 (2), 159--177, 2002.
• 38: Zacks, J., B. Tversky and G. Iyer. Perceiving, Remembering, and Communicating Structure in Events. Journal of Experimental Psychology: General, 130 (1), 29--58, 2001.
• 39: Zijlstra, F.R.H., R.A. Roe, A.B. Leonora and I. Krediet. Temporal Factors in Mental Work: Effects of Interrupted Activities. Journal of Occupational and Organizational Psychology, 72, 163--185, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems

Keywords:
attention, interruption, learning, task models, workload