From creating virtual gestures to "writing" in sign languages

ABSTRACT

Sign languages have been proven to be natural languages, as capable of expressing human thoughts and emotions as traditional languages are. The distinct visual and spatial nature of sign languages seems to be an insurmountable barrier for developing a sign language "word processor". However, we argue that with the advancement of computer graphics technology and graphical implementations of linguistic results obtained from the study of sign languages, "writing" in a sign language should not be difficult. We have pursued exploratory work in constructing virtual gestures, applying hand constraints to facilitate the creation of natural gestures, and combining these gestures into meaningful American Sign Language (ASL) parts that follow the ASL Movement-Hold model. The results, although preliminary, are encouraging. We believe that space effective sign language composition is possible space with the implementation of easy-to-use graphical user interfaces and the development of specialized data management methods.

REFERENCES

• 1: UPenn HMS Center. http://hms.upenn.edu/.
• 2: DePaul ASL Synthesizer. http://asl.cs.depaul.edu/.
• 3: Matthew P. Huenerfauth. A Survey and Critique of American Sign Language Natural Language Generation and Machine Translation Systems. Technical report, Computer and Information Sciences, University of Pennsylvania, September 2003.
• 4: Scott K. Liddell. Grammar, Gesture, and Meaning in American Sign Language. Cambridge University Press, 2003.
• 5: Scott K. Liddell and Robert E. Johnson. American sign language: The phonological base. Sign Language Studies, Fall(64):195--227, 1989.
• 6: David McNeill. Hand and Mind: What Gestures Reveal About Thought. The University of Chicago Press, Chicago, 1992.
• 7: David McNeill, editor. Language and Gesture. Cambridge University Press, 2000.
• 8: American Academy of Orthopaedic Surgeons. Joint Motion: Method of Measuring and Recording. Churchill Livingstone, New York, 1988.
• 9: Joel Spolsky, User interface design for programmers, Apress, Berkely, CA, 2001
• 10: IKAN: Inverse Kinematics using ANalytical Methods. http://hms.upenn.edu/software/ik/.
• 11: Clayton Valli and Ceil Lucas. Linguistics of American Sign Language: An Introduction. Gallaudet University Press, 3rd edition, 2000.
• 12: Vcom3D. http://vcom3d.com/.
• 13: VRlab. http://vrlab.epfl.ch/.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Keywords:
ASL, GUI, computer graphics, sign language interfacing