Open syntax: improving access for all users

ABSTRACT

Trends in new multi-modal user interfaces and pervasive mobile computing are raising technical problems for building flexible interfaces that can adapt to different communication modes. I hope to show how some aspects of the technical solutions that will be needed for these problems will also help to solve problems of access for elderly users.

REFERENCES

• 1: C. M. Beshers , S. Feiner, Scope: automated generation of graphical interfaces, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.76-85, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73670]
• 2: James Foley , Won Chul Kim , Srdjan Kovacevic , Kevin Murray, Defining Interfaces at a High Level of Abstraction, IEEE Software, v.6 n.1, p.25-32, January 1989 [doi>10.1109/52.16899]
• 3: J. D. Foley and V. L. Wallace, "The Art of Natural Graphic Man-Machine Conversation," Proceedings of the IEEE, vol. 62, no. 4, pp. 462-471, 1974.
• 4: James D. Foley , Andries van Dam , Steven K. Feiner , John F. Hughes, Computer graphics: principles and practice (2nd ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990
• 5: Mark Green , Robert Jacob, SIGGRAPH '90 Workshop report: software architectures and metaphors for non-WIMP user interfaces, ACM SIGGRAPH Computer Graphics, v.25 n.3, p.229-235, July 1991 [doi>10.1145/126640.126677]
• 6: H. Rex Hartson , Deborah Hix, Human-computer interface development: concepts and systems for its management, ACM Computing Surveys (CSUR), v.21 n.1, p.5-92, March 1989 [doi>10.1145/62029.62031]
• 7: E. L. Hutchins, J. D. Hollan, and D. A. Norman, "Direct Manipulation Interfaces," in User Centered System Design: New Perspectives on Human-computer Interaction, ed. by D. A. Norman and S. W. Draper, pp. 87-124, Lawrence Erlbaum, Hillsdale, N.J., 1986.
• 8: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 9: Robert J. K. Jacob, Using formal specifications in the design of a human-computer interface, Communications of the ACM, v.26 n.4, p.259-264, April 1983 [doi>10.1145/2163.358093]
• 10: R. J. K. Jacob, "An Executable Specification Technique for Describing Human-Computer Interaction," in Advances in Human-Computer Interaction, Vol. 1, ed. by H. R. Hartson, pp. 211-242, Ablex Publishing Co., Norwood, N.J., 1985.
• 11: R. J. K. Jacob, "Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces," in Advances in Human-Computer Interaction, Vol. 4, ed. by H. R. Hartson and D. Hix, pp. 151-190, Ablex Publishing Co., Norwood, N.J., 1993. http://www.eecs.tufts.edu/~jacob/papers/hartson.txt {ASCII}; http://www.eecs.tufts.edu/~jacob/papers/hartson.ps {Postscript}.
• 12: R. J. K. Jacob and J. G. Schmolze, "A Human-Computer Interaction Framework for Media-Independent Knowledge," AAAI Workshop on Representations for Multi-Modal Human-Computer Interaction, pp. 26-30, Position paper, Technical Report WS-98-09, AAAI Press, Menlo Park, Calif., 1998. http://www.eecs.tufts.edu/~jacob/papers/aaai98.html {HTML}; http://www.eecs.tufts.edu/~jacob/papers/aaai98.ps {Postscript}.
• 13: Robert J. K. Jacob , Leonidas Deligiannidis , Stephen Morrison, A software model and specification language for non-WIMP user interfaces, ACM Transactions on Computer-Human Interaction (TOCHI), v.6 n.1, p.1-46, March 1999 [doi>10.1145/310641.310642]
• 14: Dan Olsen, User Interface Management Systems: Models and Algorithms, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1992
• 15: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 16: B. Shneiderman, "Direct Manipulation: A Step Beyond Programming Languages," IEEE Computer, vol. 16, no. 8, pp. 57-69, 1983.
• 17: Ben Shneiderman, Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1997

INDEX TERMS

General Terms:
Human Factors, Languages, Standardization

Keywords:
dialogue independence, multi-modal interaction, semantics, syntax, universal access, user interface management system