Modeling command selection for speech-based applications

ABSTRACT

Command selection is an important problem in human computer interaction. We are applying a decision-making approach to model the process by which users select commands when multiple alternatives exist. Our initial focus is on speech-based systems, but the underlying approach is applicable to a wide range of interaction styles. Two empirical studies that provide a foundation for this research are complete and an initial decision model is proposed which specifies the factors that influence the command selection decisions and the relationships between those factors. Empirical studies are planned to investigate users' perceptions of individual model components and to validate the complete model.

REFERENCES

• 1: Feng, J., Sears, A., and Forgionne, G. (2003). Command selection in speech recognition software: A decision making approach. To appear in International Journal of Systems and Cybernetics.
• 2: Feng, J., Sears, A., and Karat, C. (2003). An investigation of speech-based navigation during continuous dictation. UMBC Technical Report.
• 3: K. B. Gaylin, How are windows used? Some notes on creating an empirically-based windowing benchmark task, Proceedings of the SIGCHI conference on Human factors in computing systems, p.96-100, April 13-17, 1986, Boston, Massachusetts, United States
• 4: Halverson, C., Horn, D., Karat, C. & Karat, J. (1999). The Beauty of Errors: Patterns of Error Correction in Desktop Speech systems. Proceedings of INTERACT '99. pp. 1--9.
• 5: Clare-Marie Karat , Christine Halverson , Daniel Horn , John Karat, Patterns of entry and correction in large vocabulary continuous speech recognition systems, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.568-575, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303160]
• 6: Robert E. Kraut , Stephen J. Hanson , James M. Farber, Command use and interface design, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.120-124, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801594]
• 7: Sears, A., Feng, J., Oseitutu, K., and Karat. C. (2003). Speech-based navigation during dictation: Difficulties, consequences, and solutions. UMBC Technical Report. Figure 1. A decision model for command selection within speech-based applications.

INDEX TERMS

Keywords:
command selection, speech recognition