|
 ABSTRACT
There are many important factors in the design of evaluation studies for systems that generate animations of American Sign Language (ASL) sentences, and techniques for evaluating natural language generation of written texts are not easily adapted to ASL. When conducting user-based evaluations, several cultural and linguistic characteristics of members of the American Deaf community must be taken into account so as to ensure the accuracy of evaluations involving these users. This article describes an implementation and user-based evaluation (by native ASL signers) of a prototype ASL natural language generation system that produces sentences containing classifier predicates, which are frequent and complex spatial phenomena that previous ASL generators have not produced. Native signers preferred the system's output to Signed English animations -- scoring it higher in grammaticality, understandability, and naturalness of movement. They were also more successful at a comprehension task after viewing the system's classifier predicate animations.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
Badler, N., Allbeck, J., Lee, S. J., Rabbitz, R., Broderick, T., and Mulkern, K. 2005. New behavioral paradigms for virtual human models. In Proceedings of the SAE Digital Human Modeling Conference.
|
| |
2
|
Badler, N., Bindiganavale, R., Allbeck, J., Schuler, W., Zhao, L., Lee, S., Shin, H., and Palmer, M. 2000. Parameterized action representation & natural language instructions for dynamic behavior modification of embodied agents. In Proceedings of the AAAI Spring Symposium.
|
| |
3
|
|
 |
4
|
|
| |
5
|
Emmorey, K., (ed.). 2003. Perspectives on Classifier Constructions in Sign Languages. Lawrence Erlbaum Associates, Mahwah, NJ.
|
| |
6
|
Holt, J. A. 1993. Demographic, stanford achievement test - 8th edition for deaf and hard of hearing students: Reading comprehension subgroup results. Amer. Annals Deaf. 138, 172--175.
|
| |
7
|
Huenerfauth, M. 2006a. Representing coordination and non-coordination in American Sign Language animations. Behaviour & Information Technology, 25:4.
|
| |
8
|
|
| |
9
|
Huenerfauth, M. 2008. Animations from Article in ACM Transactions on Accessible Computing (TACCESS). Linguistic and Assistive Technologies Laboratory website. (Accessed on 28 March 2008.) http://latlab.cs.qc.cuny.edu/taccess2008/.
|
| |
10
|
Huenerfauth, M. In Press. Representing ASL Classifier Predicates Using Spatially Parameterized Planning Templates. In Generalization of Knowledge: Multidisciplinary Perspectives. M. T. Banich and D. Caccamise, Eds., Psychology Press, New York, NY.
|
| |
11
|
Huenerfauth, M., Zhao, L., Gu, E., and Allbeck, J. 2007a. Design and evaluation of an American Sign Language generator. In Proceedings of the Workshop on Embodied Language Processing, 45th Annual Meeting of the Association for Computational Linguistics. Prague, Czech Republic.
|
| |
12
|
Matt Huenerfauth , Liming Zhao , Erdan Gu , Jan Allbeck, Evaluating American Sign Language generation through the participation of native ASL signers, Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility, October 15-17, 2007, Tempe, Arizona, USA
[doi> 10.1145/1296843.1296879]
|
| |
13
|
Liddell, S. 2003. Grammar, Gesture, and Meaning in American Sign Language. Cambridge University Press, Cambridge, UK.
|
| |
14
|
Lucas, C. and Valli, C. 1992. Language Contact in the American Deaf Community. Academic Press, San Diego, CA.
|
| |
15
|
Mitchell, R. E., Young, T. A., Bachleda, B., and Karchmer, M. A. 2006. How many people use ASL in the United States? Why estimates need updating. Sign Language Studies, 6:3.
|
| |
16
|
Morrissey, S. and Way, A. 2006. Lost in translation: The problems of using mainstream MT evaluation metrics for sign language translation. In Proceedings of the 5th SALTMIL Workshop on Minority Languages, Language Resources and Evaluation Conference (LREC-2006).
|
| |
17
|
Neidle, C., Kegl, J., MacLaughlin, D., Bahan, B., and Lee, R. G. 2000. The Syntax of American Sign Language: Functional Categories and Hierarchical Structure. The MIT Press, Cambridge, MA.
|
| |
18
|
Padden, C. and Humphries, T. 2005. Inside Deaf Culture. Harvard University Press, Cambridge, MA.
|
| |
19
|
|
| |
20
|
Pasquariello, S. and Pelachaud, C. 2001. Greta: A simple facial animation engine. In Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications.
|
| |
21
|
Sáfár, É. and Marshall, I. 2001. The architecture of an English-text-to-Sign-Languages translation system. In Recent Advances in Natural Language Processing.
|
| |
22
|
Sandler, W. and Lillo-Martin, D. 2006. Sign Language and Linguistic Universals. Cambridge University Press, Cambridge, UK.
|
| |
23
|
Strong, M. and Prinz, P. 1997. A study of the relationship between American Sign Language and English literacy. J. Deaf Stud. Deaf Educat. 2, 1, 37--46.
|
| |
24
|
Supalla, T. 1978. Morphology of verbs of motion and location. In Proceedings of the 2nd National Symposium on Sign Language Research and Teaching, F. Caccamise and D. Hicks (eds.), National Association for the Deaf, Silver Spring, MD. pp. 27--45.
|
| |
25
|
Liwei Zhao , Karin Kipper , William Schuler , Christian Vogler , Norman I. Badler , Martha Palmer, A Machine Translation System from English to American Sign Language, Proceedings of the 4th Conference of the Association for Machine Translation in the Americas on Envisioning Machine Translation in the Information Future, p.54-67, October 10-14, 2000
|
| |
26
|
Zhao, L., Liu, Y., and Badler, N. I. 2005. Applying empirical data on upper torso movement to real-time collision-free reach tasks. In Proceedings of the 2005 SAE Digital Human Modeling for Design and Engineering Conference and Exhibition.
|
|
Adobe Acrobat
QuickTime
Windows Media Player
Real Player
Pdf
I.2