Planning, reasoning, and agents for non-visual navigation of tables and frames

ABSTRACT

In this paper we demonstrate how the DSL for Table navigation [16] can be reinterpreted in the context of an action theory [8]. We also show how this generalization provides the ability to carry out more complex tasks such as (i) allowing the user to describe the objective of his/her navigation as a goal and let automatic mechanisms (i.e., a planner) develop (part of) the navigation process; and (ii) allowing the semantic description to predefine not only complete navigation strategies (as in [16]) but also partial skeletons, making the remaining part of the navigation dependent on run-time factors, e.g., user's goals, specific aspects of the table's content, User's run-time decisions.

REFERENCES

• 1: C. Asakawa and C. Laws. Home Page Reader: IBM's Talking Web Browser. Technical report, IBM, 1998.
• 2: Fahiem Bacchus , Froduald Kabanza, Using temporal logics to express search control knowledge for planning, Artificial Intelligence, v.116 n.1-2, p.123-191, Jan. 2000 [doi>10.1016/S0004-3702(99)00071-5]
• 3: F. Bacchus et al. AIPS-00 Planning Competition. In Int. Conference on Artificial Intelligence Planning and Scheduling Systems, 2000.
• 4: T. Bernmers-Lee, J. Hendler, O. Lassila. The Semantic Web. Scientific American, 284(5):34--43, 2001.
• 5: A. Cattagni and E. Farris Westat. Internet Access in U.S. Public Schools and Classrooms. U.S. Dept. of Education, 2001.
• 6: S. Citrigno et al. The DLV System: Model Generator and Application Frontends. In Workshop on Logic Programming, 1997.
• 7: C. Earl and J. Leventhal. A Survey of Windows Screen Reader Users. Journal of Visual Impairment and Blindness, 93(3), 1999.
• 8: M. Gelfond and V. Lifschitz. Action Languages. In ETAI, 3(6), 1998.
• 9: J. Gunderson and R. Mendelson. Usability of World Wide Web Browsers by Persons with Visual Impairments. In RESNA Annual Conference, pages 330--332, 1997.
• 10: G. Gupta and E. Pontelli. Specification, Implementation, and Verification of Domain Specific Languages. In Computational Logic: from Logic Programming into the Future. Springer Verlag, 2001.
• 11: Frankie James, Presenting HTML Structure in Audio: User Satisfaction with Audio Hypertext, Stanford University, Stanford, CA, 1998
• 12: Arthur I. Karshmer , Enrico Pontelli , Gopal Gupta, Software technology and computer interfaces for the disabled: non-visual WWW browsing, Proceedings of the HCI International '99 (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Communication, Cooperation, and Application Design-Volume 2, p.792-796, August 22-26, 1999
• 13: A. Kennel, L. Perrochon, and A. Darvishi. WAB: World Wide Web Access for Blind And Visually Impaired Computer Users. In New Technologies in the Education of the Visually Handicapped, 1996.
• 14: Ilkka Niemelä , Patrik Simons, Smodels - An Implementation of the Stable Model and Well-Founded Semantics for Normal LP, Proceedings of the 4th International Conference on Logic Programming and Nonmonotonic Reasoning, p.421-430, July 28-31, 1997
• 15: E. Pontelli et al. Non-visual Navigation of Tables and Frames: a Progress Report. Technical report, New Mexico State University, 2001.
• 16: E. Pontelli , W. Xiong , G. Gupta , A. I. Karshmer, A domain specific language framework for non-visual browsing of complex HTML structures, Proceedings of the fourth international ACM conference on Assistive technologies, p.180-187, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354373]
• 17: R. Reiter. KNOWLEDGE IN ACTION. MIT Press, 2001.
• 18: Myriam Ribière , Rose Dieng, Introduction of Viewpoints in Conceptual Graph Formalism, Proceedings of the Fifth International Conference on Conceptual Structures: Fulfilling Peirce's Dream, p.168-182, August 03-08, 1997
• 19: T.C. Son, C. Baral, S. Mcllraith. Domain Dependent Knowledge in Planning - An Answer Set Planning Approach. In LPNMR, Springer Verlag, 2001.
• 20: J. F. Sowa, Conceptual structures: information processing in mind and machine, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1984
• 21: M. Zajicek et al. Ergonomic Factors for a Speaking Computer Interface. In Contemporary Ergonomics. Taylor & Francis, 1999.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Language parsing and understanding; Speech recognition and synthesis

General Terms:
Algorithms, Documentation, Experimentation, Human Factors

Keywords:
agents, domain specific language, semantics navigation