Iconic language design for people with significant speech and multiple impairments

ABSTRACT

We present an approach of iconic language design for people with significant speech and multiple impairments (SSMI), based upon the theory of Icon Algebra and the theory of Conceptual Dependency (CD) to derive the meaning of iconic sentences. An interactive design environment based upon this methodology is described.

REFERENCES

• 1: B.R. Baker, "Minspeak, A Semantic Compaction System that makes Self-Expression for communicatively Disabled Incliv/duals," Byte, vol. 7, no. 9, pp. 186-202, September 1982.
• 2: B.R. Baker and R. F. Barry, "A Mattwanati~ Model of Minspeak," 2nd Annua/Eur0pean M/nspeak Conference, May 31.June 1, 1990.
• 3: B.R. Baker and E. Nyberg, "Semantic Compaction: A Basic Technology for Artificial Imelligence in AAC," 5th Annual Minspeak Conference, Nov 14-15, 1990.
• 4: B. R. Baker. P. J. SchwarU, and R. V. Conti, "Minspeak, Models and Semantic Relalionships," Fi}'tk Annual Minspeak Conference Proceedings, Seattle, WA, November 1990.
• 5: c. K. Bliss Semantography, Sydney semantography-Blismbolics Publications 1942.
• 6: N.W. Bray, "A Cognitive Model for Mimpeak," 5th Annual Minspeak Conference, November 14- 15, 1990.
• 7: S.K. Chang, G. Cosmgliola, S. Orefice, O. Poksa, and B. R. Baker, "A Methodology for Icconic: Language Design with Appacatica to Augmentation five Communication," Proc. of 1992 IEEE Workshop on Visual Languages, pp. 110-116, Seattle, Washington, USA, Seplmnber 15-18.
• 8: Shi-Kuo Chang, Icon semantics—a formal approach to icon system design, International Journal of Pattern Recognition and Artificial Intelligence, v.1 n.1, p.103-120, April 1987 [doi>10.1142/S0218001487000084]
• 9: Shi-Kuo Chang, Principles of visual programming systems, Prentice-Hall, Inc., Upper Saddle River, NJ, 1990
• 10: Shi-Kuo Chang, Principles of pictorial information systems design, Prentice-Hall, Inc., Upper Saddle River, NJ, 1989
• 11: S.K. Chang, S. Orefice, G. Polese, and B. R. Baker, "Deriving the Menning of Iconic Smtences for Augmentative Communication," Proc. of 1993 IEEE Workshop on Visual Languages, pp. 267-274, Bergen, Norway, August 25-27 1993.
• 12: C. Sclmnk, "Conceptual Dependency: A themy of natural language understanding," Cognitive Psycology, 1972.
• 13: R.C. Sclmnk, "Identification of Conceptualization Underlying Natural Language ," R. C. Schank and g. M. Colby (eds) , W. H. Freemm, San Fraa. cisco, CA, 1973.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.5 ARTS AND HUMANITIES
      Subjects: Language translation

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Machine translation

General Terms:
Algorithms, Design, Human Factors, Languages, Theory