Context restoration in multi-tasking dialogue

ABSTRACT

In this paper we conduct an exploratory experiment on context restoration in multi-tasking dialogue and report our preliminary findings. We examine a corpus of human-human dialogues, in which pairs of conversants, using speech, work on an ongoing task while occasionally completing real-time tasks. We investigate whether the conversants, when returning to the ongoing task, make any effort to restore the context. First, we identify two types of actions, utterance restatement and information review, as possible restorations. Second, from a statistical analysis, we find that these actions are used more often when returning to the ongoing task, and hence seem to play a role in context restoration. Our findings will help to build a foundation for future speech interfaces that support multi-tasking dialogue.

REFERENCES

• 1: H. H. Clark and E. F. Schaefer. Contributing to discourse. Cognitive Science, 13:259--294, 1989.
• 2: Michael S. English , Peter A. Heeman, Learning mixed initiative dialog strategies by using reinforcement learning on both conversants, Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, p.1011-1018, October 06-08, 2005, Vancouver, British Columbia, Canada [doi>10.3115/1220575.1220702]
• 3: Barbara J. Grosz , Candace L. Sidner, Attention, intentions, and the structure of discourse, Computational Linguistics, v.12 n.3, p.175-204, July-September 1986
• 4: Peter A. Heeman , Fan Yang , Andrew L. Kun , Alexander Shyrokov, Conventions in human-human multi-threaded dialogues: a preliminary study, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040903]
• 5: Andrew L. Kun , W. Thomas Miller , William H. Lenharth, Computers in Police Cruisers, IEEE Pervasive Computing, v.3 n.4, p.34-41, October 2004 [doi>10.1109/MPRV.2004.3]
• 6: Oliver Lemon , Alexander Gruenstein, multithreaded context for robust conversational interfaces: Context-sensitive speech recognition and interpretation of corrective fragments, ACM Transactions on Computer-Human Interaction (TOCHI), v.11 n.3, p.241-267, September 2004 [doi>10.1145/1017494.1017496]
• 7: Marilyn A. Walker, The effect of resource limits and task complexity on collaborative planning in dialogue, Artificial Intelligence, v.85 n.1-2, p.181-243, Aug. 1996 [doi>10.1016/0004-3702(95)00114-X]
• 8: F. Yang, P. A. Heeman, and A. Kun. Switching to real-time tasks in multi-tasking dialogue. In Proceedings of CoLing, pages 1025--1032, Manchester, UK, August 2008.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O

General Terms:
Human Factors

Keywords:
context restoration, multi-tasking dialogue