A teaching system of Japanese sign language using sign language recognition and generation

ABSTRACT

In recent years, the number of sign language learners is increasing in Japan. And there are many teaching materials of sign language such as textbooks, videotapes and software for PCs. However, these teaching materials have several problems that learners cannot study sign language sufficiently because the learners can mainly study manual gestures, cannot change the direction to see signed gestures, and cannot check their signed gestures by themselves. We developed a sign language teaching system applying sign language recognition and sign language generation technologies to solve these problems and realize effective sign language study. Further, we carried out an evaluation experiment by several users and confirmed that the developed system was effective.

REFERENCES

• 1: Japanese-Sign Language Dictionary, Japanese Federation of the Deaf, 1997 {in Japanese}.
• 2: M. L. A. Sternberg: American Sign Language Concise Dictionary, HarperCollins Publishers, 1994.
• 3: Everybody's Sign Language, IBM Japan, Ltd., 1995 {in Japanese}.
• 4: Sign Language Master the Introduction (Light version). LITEC Co., Ltd., 1996 {in Japanese}.
• 5: Sign Language for Everyone. Higher Learning Systems, Inc., http://www.idrt.com/.
• 6: American Sign Language Browser. The Communication Technology Laboratory at Michigan State University, http://commtechlab.msu.edu/sites/aslweb/.
• 7: R. Stine: Animated American Sign Language Dictionary. http://www.bconnex.net/~randys/.
• 8: H. Sagawa, M. Takeuchi and M. Ohki: Methods to Describe and Recognize Sign Language Based on Gesture Components Represented by Symbols and Numerical Values. Knowledge-Based Systems, Vol. 10, No. 5 (March 1998), 287--294.
• 9: Hirohiko Sagawa , Masaru Takeuchi, A Method for Recognizing a Sequence of Sign Language Words Represented in a Japanese Sign Language Sentence, Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, p.434, March 26-30, 2000
• 10: H. Sagawa, A. Koizumi and M. Takeuchi: A Recognition Method of Japanese Sign Language Sentences Based on Head Movements. HCII2001 (August 2001).
• 11: T. Sakiyama, H. Sagawa, E. Oohira, H. Ikeda and M. Ooki: A Generation Method of Sign Language Animation Using Time Sequential Data. Proceedings of the 20th Annual Meeting of Japanese Federation of the Deaf (July 1994), 69--72 {in Japanese}.
• 12: T. Sakiyama, E. Oohira, H. Sagawa, M. Ooki and H. Ikeda: A Generation Method for Real-Time Sign Language Animation. Transactions of IEICE, Vol. J79-D-II, No. 2 (February 1996), 182--190 {in Japanese}.
• 13: SigningAvatarTM Internet Enabled 3D Charaters CD-ROM. Vcom3D, Inc., http://www.signingavatar.com/.
• 14: Y. Tabata, T. Kurokawa, K. Chihara: A Method to Evaluate Finger Characters For Finger Spelling Learning System. Proceedings of the Human Interface Symposium '99 (October 1999), 717--720

INDEX TERMS

General Terms:
Languages

Keywords:
3DCG animation and teaching system, recognition, sign language