VoiceNotes: a speech interface for a hand-held voice notetaker

ABSTRACT

VoiceNotes is an application for a voice-controlled hand-held computer that allows the creation, management, and retrieval of user-authored voice notes—small segments of digitized speech containing thoughts, ideas, reminders, or things to do. Iterative design and user testing helped to refine the initial user interface design. VoiceNotes explores the problem of capturing and retrieving spontaneous ideas, the use of speech as data, and the use of speech input and output in the user interface for a hand-held computer without a visual display. In addition, VoiceNotes serves as a step toward new uses of voice technology and interfaces for future portable devices.

REFERENCES

• 1: Barry Arons, Hyperspeech: navigating in speech-only hypermedia, Proceedings of the third annual ACM conference on Hypertext, p.133-146, December 15-18, 1991, San Antonio, Texas, United States [doi>10.1145/122974.122989]
• 2: Arons, B. Techniques, perception, and applications of time-compressed speech. In Proceedings of AVIOS '92, pp. 169-177. American Voice I/O Society, 1992.
• 3: Barbara L. Chalfonte , Robert S. Fish , Robert E. Kraut, Expressive richness: a comparison of speech and text as media for revision, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.21-26, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108848]
• 4: Cypher, A. The structure of users' activities. In Norman, D.A. and Draper, S.W., editors, User Centered System Design, chapter 12, pp. 243-263. Lawrence Erlbaum Associates, 1986.
• 5: Leo Degen , Richard Mander , Gitta Salomon, Working with audio: integrating personal tape recorders and desktop computers, Proceedings of the SIGCHI conference on Human factors in computing systems, p.413-418, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142877]
• 6: Ericsson, K.A. and Simon, H.A. Protocol Analysis. The MIT Press, 1984.
• 7: Gaver, W.W. The SonicFinder: An interface that uses auditory icons. Human-Computer Interaction, 4(1):67- 94, 1989.
• 8: Gould, J.D. An experimental study of writing, dictating, and speaking. In Requin, J., editor, Attention & Performance VII, pp. 299-319. Lawrence Erlbaum, 1978.
• 9: Hayes, P.J. and Reddy, D.R. Steps toward graceful interaction in spoken and written man-machine communication. International Journal of Man.Machine Studies, 19:231-284, 1983.
• 10: Heiman, G.W., Leo, R.J., Leighbody, G. and Bowler, K. Word intelligibility decrements and the comprehension of time-compressed speech. Perception and Psychophysics, 40(6):407-411, 1986.
• 11: G. L. Martin, The utility of speech input in user-computer interfaces, International Journal of Man-Machine Studies, v.30 n.4, p.355-375, April 1989
• 12: M. J. Muller , J. E. Daniel, Toward a definition of voice documents, Proceedings of the ACM SIGOIS and IEEE CS TC-OA conference on Office information systems, p.174-183, April 25-27, 1990, Cambridge, Massachusetts, United States
• 13: Jakob Nielsen, Usability engineering at a discount, Proceedings of the third international conference on human-computer interaction on Designing and using human-computer interfaces and knowledge based systems (2nd ed.), p.394-401, September 1989, Boston, Massachusetts, United States
• 14: Alexander I. Rudnicky , Alexander G. Hauptmann, Models for evaluating interaction protocols in speech recognition, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.285-291, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108919]
• 15: Stifelman, L.J. VoiceNotes: An application for a voice-controlled hand-held computer. Master's Thesis. Massachusetts Institute of Technology, 1992.
• 16: Voor, J.B. and Miller, J.M. The effect of practice upon the comprehension of time-compressed speech. Speech Monographs, 32:452-455, 1965.
• 17: Waterworth, J.A. Interaction with machines by voice: A telecommunications perspective. Behaviour and Information Technology, 3(2):163-177, 1984.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.1 Applications and Expert Systems
          Subjects: Natural language interfaces

Additional Classification:
  B. Hardware
  B.4 INPUT/OUTPUT AND DATA COMMUNICATIONS
      B.4.2 Input/Output Devices
          Subjects: Voice

  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors

Keywords:
hand-held computers, non-speech audio, speech as data, speech interfaces, speech recognition