A voice-activated syntax-directed editor for manually disabled programmers

ABSTRACT

This paper discusses a research project targeted at the design and implementation of an interface intended to allow manually disabled people to more easily perform the task of programming. It proposes a Speech User Interface (SUI) targeted for this task. Voice was selected as the means of input as an alternative to the keyboard and mouse. Traditional programming IDEs tend to be character and line oriented. It is argued that this orientation is not conducive to voice input, and so a syntaxdirected programming interface is proposed. To test the viability of this combination of voice with a syntax-directed approach, an editor named VASDE (Voice-Activated Syntax-Directed Editor) was implemented using ECLIPSE as the underlying platform for development. This paper describes the syntax-directed interface, VASDE, and some of the lessons learned from initial usability studies.

REFERENCES

• 1: Farah Arefi , Charles E. Hughes , David A. Workman, Automatically generating visual syntax-directed editors, Communications of the ACM, v.33 n.3, p.349-360, March 1990 [doi>10.1145/77481.77487]
• 2: Glen Wallace , Robert Biddle , Ewan Tempero, Smarter cut-and-paste for programming text editors, Proceedings of the 2nd Australasian conference on User interface, p.56-63, January 29-February 01, 2001, Queensland, Australia
• 3: Désilets, Alain. "Context Sensitive Magic Words for Programming by Voice". Proceedings of the 1st VoiceCode Design Session. Boston, MA. 2000. 21 August 2002. <http://voicecode.iit.nrc.ca/VoiceCode/VCode1stMeeting/Alain_Desilets/CSMWs/index.htm >
• 4: Désilets, Alain. "Miscellaneous Techniques for Programming-by-Voice". Proceedings of the 1st VoiceCode Design Session. Boston, MA. 2000. 21 August 2002. <http://voicecode.iit.nrc.ca/VoiceCode/VCode1stMeeting/Alain_Desilets/ misc_techniques/index.htm>
• 5: "Eclipse.org Main Page". 5 March 2005. The Eclipse Foundation. <http://www.eclipse.org>
• 6: Epstein, Jonathan. "Programming by Voice Using Continuous and Discrete Methods". Proceedings of the 1st Voice-Code Design Session. Boston, MA. 2000. 21 August 2002. <http://voicecode.iit.nrc.ca/VoiceCode/VCode1stMeeting/Jo nathan_Epstein/index.htm>
• 7: Froeseth, Julie. "A Model for Voice-Activated Visual GUI Editors", Masters thesis, University of South Alabama, December 2005
• 8: Phil Pfeiffer , Matt Heintzelman, Machines, statues, and people: strategies for promoting RSI awareness in computing curricula, Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education, p.296-300, February 27-March 01, 1997, San Jose, California, United States
• 9: Hennessy, Sean. "Computer Code Voice Transcription". 6 January 2005. 7 March 2005. <http://www.hdm.com/resources/HappyHands_Java/hh_paper_short_technical.html>
• 10: Susan Horwitz , Tim Teitelbaum, Generating editing environments based on relations and attributes, ACM Transactions on Programming Languages and Systems (TOPLAS), v.8 n.4, p.577-608, Oct. 1986 [doi>10.1145/6465.6512]
• 11: "Java Speech API Programmer's Guide". Version 1.0. 26 October 1998. Sun Microsystems, Inc. <http://java.sun.com/products/javamedia/speech/forDevelopers/jsapi-guide/>
• 12: Johansson, Eric. "Speech Driven Coding". 10 March 1998. 21 August 2002. <http://www.connact.com/~esj/voice_coding/voicecoding2.PPT>
• 13: "Lost-worktime Injuries and Illnesses: Characteristics and Resulting Time Away from Work, 2000". Bureau of Labor Statistics. 10 April 2002. 12 October 2002. <http://www.bls.gov/news.release/osh2.nr0.htm>
• 14: Sharon L. Oviatt , Philip R. Cohen , Michelle Wang, Toward interface design for human language technology: modality and structure as determinants of linguistic complexity, Speech Communication, v.15 n.3-4, p.283-300, Dec. 1994
• 15: Steven P. Reiss, Pecan: Program development systems that support multiple views, Proceedings of the 7th international conference on Software engineering, p.324-333, March 26-29, 1984, Orlando, Florida, United States
• 16: Shmerling, Robert. "Harvard Commentary: Computer Use and Carpal Tunnel Syndrome". InteliHealth. 27 August 2001. 12 October 2002. <http://www.intelihealth.com/IH/ihtIH/WSIHW000/20813/20888/332014.html?d=dmtJHNewsArchive>
• 17: Christoph Steindl, Benefits of a data flow-aware programming environment, Proceedings of the 1999 ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering, p.105-109, September 06-06, 1999, Toulouse, France
• 18: VoiceCode White Paper. National Research Council of Canada. 23 February 2005. <http://voicecode.iit.nrc.ca/VoiceCode/public/wiki.cgi?VoiceCode_white_paper>

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); Graphical user interfaces (GUI); Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Experimentation, Human Factors, Languages

Keywords:
IDE, programming by voice, speech user interface, syntax directed