Speech technology in real world environment: early results from a long term study

ABSTRACT

Existing knowledge on how people use speech-based technologies in realistic settings is limited. We are conducting a longitudinal field study, spanning six months, to investigate how users with no physical impairments and users with upper body physical impairments use speech technologies when interacting with computers in their home environment. Digital data logs, time diaries, and interviews are being used to record the types of applications used, frequency of use of each application, and difficulties experienced as well as subjective data regarding the usage experience. While confirming many expectations, initial results have provided several unexpected insights including a preference to use speech for navigation instead of dictation tasks, and the use of speech technology for programming and games.

REFERENCES

• 1: Feng, J., Karat, C-M., & Sears, A. (2005). How Productivity Improves in Hands--Free Continuous Dictation Tasks: Lessons Learned from a Longitudinal Study. Interacting with Computers, 17(3), 265--289.
• 2: Jinjuan Feng , Andrew Sears, Using confidence scores to improve hands-free speech based navigation in continuous dictation systems, ACM Transactions on Computer-Human Interaction (TOCHI), v.11 n.4, p.329-356, December 2004 [doi>10.1145/1035575.1035576]
• 3: Manaris, B., Macgyvers, V., & Lagoudakis, M. (2002). A listening keyboard for users with motor impairments: A usability study. International Journal of Speech Technology, 5, 371--388.
• 4: Manasse, B., Hux, K., & Rankin-Erickson, J. (2000). Speech recognition training for enhancing written language generation by a traumatic brain injury survivor. Brain Injury, 14(11), 1015--1034.
• 5: Michael Pieper , Alfred Kobsa, Talking to the ceiling: an interface for bed-ridden manually impaired users, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632723]
• 6: Andrew Sears , Jinjuan Feng , Kwesi Oseitutu , Clare-Marie Karat, Hands-free, speech-based navigation during dictation: difficulties, consequences, and solutions, Human-Computer Interaction, v.18 n.3, p.229-257, September 2003 [doi>10.1207/S15327051HCI1803_2]
• 7: Andrew Wilson , Steven Shafer, XWand: UI for intelligent spaces, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642706]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O

Additional Classification:
  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

General Terms:
Design, Human Factors

Keywords:
field study, physical impairment, speech technology