Multimodal response planning: an adaptive rule based approach

ABSTRACT

This paper describes the architecture and prototype of a system which dynamically determines how to present information to a user. The system utilizes a rule based approach to select one or more modalities for presenting information. Next the system determines one or more techniques to present the information within each of the previously selected modalities. This system also adapts to individual users providing flexibility not found in traditional presentation systems. Finally, models are used for storing knowledge about the user resulting in a system which can be easily enhanced as new data is obtained and can adapt to the needs of its users.

REFERENCES

• 1: Betty Binns and Nancy Clark. The graphic designer's use of visual syntax. In Proceedir~gs of the Section on Statistical Graphics of ~he American Statistical Association, 1986. This paper is a sub-paper in the paper: "Three Perspectives on Statistical Graphs: A Basis for Defining Evaluation Criteria" by Nancy Clark.
• 2: Nancy Clark. The language of data: tables and graphs as exposition, in Proceedings ICRISA Tt 1986.
• 3: William S. Cleveland and Robert McGill. Graphical perception: theory~ experimentation~ and application to the development of graphical methods..formal of ~he American Statistical Association, 79(387):531- 554, September 1984.
• 4: Gerardine DeSanctis. Computer graphics as decision aids: directions for research. Decision Sciences, 15:463- 487, 1984.
• 5: James L. Dolby, Nancy Clark, and William H. Rogers. The language of data: a general theory of data. In Proceedings Eighteenth Symposium on the Interface, 1986.
• 6: Steven Feiner. Apex: an experiment in the automated creation of pietored explanations. IEEE Comp~er Graphics and Applica~ior~s, 29 - 37, November 1985.
• 7: Julian Hochber8 and David H. Krantz. Perceptu~l properties of statistical graphs. In Proceedings of the Section or~ Statistical Graphics of ~he American Statistical Association, 1986. This paper is a sub-paper in the paper: "Three Perspectives on Statistical Graphs" A Basis for Definin8 Evoluation Criteria" by Nancy Clark.
• 8: J. D. Mackinlay, Automatic design of graphical presentations, Stanford University, Stanford, CA, 1987
• 9: William Remus. An empirical investication of the impact of graphical and tabular data presentatoins on decision making. M~nagemen~ Science, 30(5):533- 542, May 1984.
• 10: Elaine Rich. Users are individuals: individualizing user models. In R. Davies, editor, Intelligent Information 5~ts~ems: Progress and Prospects, chapter 7, Horwood / WHey, 1985.
• 11: Joseph W. Sullivan, Sherman W. Tyler, and Robert A. Gargan Jr. Eztending Natural T, arguage for Intelligent In~erfaee$: Supporting Multimodal Communication Through Ezplici~ Discourse Contezt. Technical Report AIC-87- 003, Lockheed Artificial Intellisence Center, September 1987.
• 12: Paul A. Tukey. A data analyst's view of statistical plots. In Proceedings of ~he Section on Statistical Graphics of the American Statistical Association, 1986. This paper is a sub-paper in the paper: "Three Perspectives on Statistical Graphs: A Basis for Defining Evaluation Criteria" by Nancy Clark.
• 13: Thomas S. Tullis. An evaluation of alphanumeric, graphic, and color information displays. Human Factors, 23(5):541-550, 1981.
• 14: Sherman W. Tyler. Adaptation in User- Computer In~erface Design. Technical Report AIC-87-001, Lockheed Artificial Intelligence Center, September 1987.
• 15: Sherman William Tyler, Sauci: self-adaptive user-computer interface (expert systems, artificial intelligence), 1986
• 16: Christopher D. Wickens and Barry Goettle. Multiple :resources and display formatting: the implications of task integration. In Proceedings of the Human Factors Society - ~Sfh Annual Meeting, 1984.
• 17: Christopher D. Wickens, Diane L. Sundry, and Michael Vidulich. Compatibility and resource competition between modalities of input, central processing, and output. Human Factors, 25(2):227- 248, 1983.
• 18: Christopher D. Wickens, Michael Vidulich, and Diane Sandry-Garza. Principles of s-c-r compatibility with spatial and verbal tasks. In Proceedings, ~nd Symposium on, Aviation Psychology, April 1983.
• 19: Frank Zdybel, Norton It. Greenfeld, Martin D. Yonke, and Jeff Gibbons. An information presentation system. In Proceedings of the Seventh International Join~ Conference on Artificial Intelligence~ 1981.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.1 Project and People Management
          Subjects: Systems analysis and design

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Query processing

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.1 Applications and Expert Systems
          Subjects: Office automation
      I.2.4 Knowledge Representation Formalisms and Methods
          Subjects: Representations (procedural and rule-based)
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Design, Human Factors, Management