Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Motion-capture recordings of sign language are used in research on automatic recognition of sign language or generation of sign language animations, which have accessibility applications for deaf users with low levels of written-language literacy. Motion-capture gloves are used to record the wearer's handshape. Unfortunately, these gloves require a time-consuming and inexact manual calibration process each time they are worn. This paper describes the design and evaluation of a new calibration protocol for motion-capture gloves, which is designed to make the process more efficient and to be accessible for participants who are deaf and use American Sign Language (ASL). The protocol was evaluated experimentally; deaf ASL signers wore the gloves, were calibrated (using the new protocol and using a calibration routine provided by the glove manufacturer), and were asked to perform sequences of ASL handshapes. A native ASL signer rated the correctness and understandability of the collected handshape data. The new protocol received significantly higher scores than the standard calibration. The protocol has been made freely available online, and it includes directions for the researcher, images and videos of how participants move their hands during the process, and directions for participants (as ASL videos and English text).

REFERENCES

• 1: Helene Brashear , Thad Starner , Paul Lukowicz , Holger Junker, Using Multiple Sensors for Mobile Sign Language Recognition, Proceedings of the 7th IEEE International Symposium on Wearable Computers, p.45, October 21-23, 2003
• 2: Chao, A. 2001. Uni-dimensional evaluation of Wristsystem and Cyberglove®. Master Thesis, Wichita State University, Dept. of Industrial&Manufacturing Engineering.
• 3: Chou, T.-S., Gadd, A., Knott, D. 2000. Hand-eye: A vision based approach to data glove calibration. In Proceedings of Human Interface Technologies, pp. 47--54.
• 4: Stephen Cox , Michael Lincoln , Judy Tryggvason , Melanie Nakisa , Mark Wells , Marcus Tutt , Sanja Abbott, Tessa, a system to aid communication with deaf people, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638287]
• 5: Dipietro, L., Sabatini, A. M., Dario, P. 2003. Evaluation of an instrumented glove for hand-movement acquisition. J. Rehabil. Res. Dev., 40, pp. 179--190.
• 6: R. Elliott , J. R. W. Glauert , J. R. Kennaway , I. Marshall , E. Safar, Linguistic modelling and language-processing technologies for Avatar-based sign language presentation, Universal Access in the Information Society, v.6 n.4, p.375-391, January 2008 [doi>10.1007/s10209-007-0102-z]
• 7: Fischer, M., Van Der Smagt, P., Hirzinger, G. 1998. Learning techniques in a Dataglove based telemanipulation system for the DLR hand. IEEE ICRA, pp. 1603--1608.
• 8: Greenleaf, W. J. 1996. Developing the Tools for Practical VR Applications. IEEE Engineering in Medicine and Biology, pp. 23--30.
• 9: Griffin, W.B., Findley, R.P., Turner, M.L., Cutkosky, M.R., 2000. Calibration and Mapping of a Human Hand for Dexterous Telemanipulation. In Proc. of ASME International Mechanical Engineering Congress and Exposition, Dynamics Systems and Controls, 69, pp. 1145--1152.
• 10: Holt, J.A. 1993. Stanford Achievement Test - 8th Edition: Reading comprehension subgroup results. American Annals of the Deaf, 138, pp. 172--175.
• 11: Matt Huenerfauth, Improving Spatial Reference in American Sign Language Animation through Data Collection from Native ASL Signers, Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services, July 19-24, 2009, San Diego, CA [doi>10.1007/978-3-642-02713-0_56]
• 12: Immersion Touchsense Technology. 2007. VirtualHand® for MotionBuilder - User Guide Version 1.10, San Jose, CA.
• 13: Immersion Corporation. 2006. Immersion Cyberglove Data Glove User Guide, San Jose, CA.
• 14: Kadouche, R., Mokhtari, M. 2005. Modeling of the residual capability for people with severe motor disabilities: Analysis of hand posture. In Proc. UM'05, Edinburgh, pp. 231--235.
• 15: Ferenc Kahlesz , Gabriel Zachmann , Reinhard Klein, 'Visual-Fidelity' Dataglove Calibration, Proceedings of the Computer Graphics International, p.403-410, June 16-19, 2004 [doi>10.1109/CGI.2004.1]
• 16: G. Drew Kessler , Larry F. Hodges , Neff Walker, Evaluation of the CyberGlove as a whole-hand input device, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.4, p.263-283, Dec. 1995 [doi>10.1145/212430.212431]
• 17: Kim, J. S., Jang, W., Bien, Z. 1996. A dynamic gesture recognition system for the Korean sign language (KSL), IEEE Trans. Syst., Man, Cybern. B, 26, pp. 354--359.
• 18: Kramer, J. 1991. Communication system for deaf, deaf-blind, or non-vocal individuals using instrumented glove. U.S. patent 5,047,952. U.S. Patent Office, Washington, D.C.
• 19: Lee, C.-S., Bien, Z., Park, G.T., Jang, W., Kim, J.S., Kim, S.K. 1997. Real-time recognition system of Korean sign language based on elementary components. In Proc. 6th IEEE International Conference on Fuzzy Systems, pp. 1463--1468.
• 20: Yung-Hui Lee , Cheng-Yueh Tsai, Taiwan sign language (TSL) recognition based on 3D data and neural networks, Expert Systems with Applications: An International Journal, v.36 n.2, p.1123-1128, March, 2009 [doi>10.1016/j.eswa.2007.10.038]
• 21: R. -H. Liang , M. Ouhyoung, A Real-Time Continuous Gesture Recognition System for Sign Language, Proceedings of the 3rd. International Conference on Face & Gesture Recognition, p.558, April 14-16, 1998
• 22: Menon, A. S., Barnes, B., Mills, R., Bruyns, C. D., Twombly, A., Smith , J., Montgomery, K., Boyle, R. 2003. Using Registration, Calibration, and Robotics to Build A More Accurate Virtual Reality Simulation For Astronaut Training and Telemedicine, In Proc. WSCG'03, http://wscg.zcu.cz/wscg2003/Papers_2003/C67.pdf
• 23: Micera, S., Cavallaro, E., Belli, R., Zaccone, F., Guglielmelli, E., Dario, P., Collarini, D., Martinelli, B., Santin, C., Marcovich, R. 2003. Functional assessment of hand orthopedic disorders using a sensorised glove: preliminary results, Proc IEEE International Conference on Robotics and Automation, Taipei (TW), pp. 2212--2217.
• 24: Mitchell, R., Young, T., Bachleda, B.,&Karchmer, M. 2006. How Many People Use ASL in the United States? Why Estimates Need Updating. Sign Language Studies, 6(3), pp. 306--335.
• 25: Tolba, A.S., Abu-Rezq, A.N. 1998. Arabic glove talk (AGT): a communication aid for vocally impaired. Pattern Analysis and Applications, 1(4), pp. 218--230.
• 26: Vamplew, P., Adams, A. 1998. Recognition of sign language gestures using neural networks, Austral. J. Intell. Inform. Process. Syst., 5(2), pp. 94--102.
• 27: Virtual Technologies. 1992. CyberGlove User's Manual. Virtual Technologies, Palo Alto, Calif.
• 28: Vogler, C., Metaxas, D. 2004. Handshapes and movements: Multiple-channel ASL recognition. J. Carbonell, J. Siekmann (eds.), Gesture-Based Communication in Human-Computer Interaction, LNAI 2915, Berlin: Springer, pp. 247--258.
• 29: Chunli Wang , Shiguang Shan , Wen Gao, An Approach Based on Phonemes to Large Vocabulary Chinese Sign Language Recognition, Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, p.411, May 20-21, 2002
• 30: Williams, N.W., Penrose, J.M.T., Caddy, C.M., Barnes, E., Hose, D.R., Harley, P. 2000. A goniometric glove for clinical hand assessment. J Hand Surg {1}, 25B(2), pp. 200--207.
• 31: Wireless Data Glove: The CyberGlove® II System, http://www.cyberglovesystems.com/cyber_glove.php.htm

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

Additional Classification:
  B. Hardware
  B.4 INPUT/OUTPUT AND DATA COMMUNICATIONS
      B.4.2 Input/Output Devices

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Experimentation, Human Factors, Measurement

Keywords:
CyberGlove?, accessibility technology for people who are deaf, american sign language, animation, calibration, motion-capture glove