Patterns of entry and correction in large vocabulary continuous speech recognition systems

ABSTRACT

A study was conducted to evaluate user performance and satisfaction in completion of a set of text creation tasks using three commercially available continuous speech recognition systems. The study also compared user performance on similar tasks using keyboard input. One part of the study (Initial Use) involved 24 users who enrolled, received training and carried out practice tasks, and then completed a set of transcription and composition tasks in a single session. In a parallel effort (Extended Use), four researchers used speech recognition to carry out real work tasks over 10 sessions with each of the three speech recognition software products. This paper presents results from the Initial Use phase of the study along with some preliminary results from the Extended Use phase. We present details of the kinds of usability and system design problems likely in current systems and several common patterns of error correction that we found.

REFERENCES

• 1: Clark, H. H. & Brennan, S. E. (1991). Grounding in communication. In J. Levine, L. B. Resnick, and S. D. Behrand (Eds.), Shared Cognition: Thinking as Social Practice. APA Books, Washington.
• 2: Catalina Danis , John Karat, Technology-driven design of speech recognition systems, Proceedings of the conference on Designing interactive systems: processes, practices, methods, & techniques, p.17-24, August 23-25, 1995, Ann Arbor, Michigan, United States [doi>10.1145/225434.225437]
• 3: John D. Gould , John Conti , Todd Hovanyecz, Composing letters with a simulated listening typewriter, Communications of the ACM, v.26 n.4, p.295-308, April 1983 [doi>10.1145/2163.358100]
• 4: John Karat, Scenario use in the design of a speech recognition system, Scenario-based design: envisioning work and technology in system development, John Wiley & Sons, Inc., New York, NY, 1995
• 5: Alison Kidd, The marks are on the knowledge worker, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.186-191, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191740]
• 6: Jennifer Lai , John Vergo, MedSpeak: report creation with continuous speech recognition, Proceedings of the SIGCHI conference on Human factors in computing systems, p.431-438, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258829]
• 7: Brenda Laurel, Computers as theatre, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1991
• 8: V. Ogozalek , J. Van Praag, Comparison of elderly and younger users on keyboard and voice input computer-based composition tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.205-211, April 13-17, 1986, Boston, Massachusetts, United States
• 9: Oviatt, S. (1995). Predicting spoken disfluencies during human-computer interaction. Computer Speech and Language, 9, 19-35.
• 10: Nicole Yankelovich , Gina-Anne Levow , Matt Marx, Designing SpeechActs: issues in speech user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.369-376, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223952]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Design, Experimentation, Performance

Keywords:
analysis methods, input techniques, speech recognition, speech user interfaces