A goal-oriented web browser

ABSTRACT

Many users are familiar with the interesting but limited functionality of Data Detector interfaces like Microsoft's Smart Tags and Google's AutoLink. In this paper we significantly expand the breadth and functionality of this type of user interface through the use of large-scale knowledge bases of semantic information. The result is a Web browser that is able to generate personalized semantic hypertext, providing a goal-oriented browsing experience.We present (1) Creo, a Programming by Example system for the Web that allows users to create a general-purpose procedure with a single example, and (2) Miro, a Data Detector that matches the content of a page to high-level user goals.An evaluation with 34 subjects found that they were more efficient using our system, and that the subjects would use features like these if they were integrated into their Web browser.

REFERENCES

• 1: Singh, P. The Public Acquisition of Commonsense Knowledge. Proceedings of AAAI Spring Symposium on Acquiring (and Using) Linguistic (and World) Knowledge for Information Access. (2002).
• 2: P. Singh , B. Barry , H. Liu, Teaching Machines about Everyday Life, BT Technology Journal, v.22 n.4, p.227-240, October 2004 [doi>10.1023/B:BTTJ.0000047601.53388.74]
• 3: Push Singh , Thomas Lin , Erik T. Mueller , Grace Lim , Travell Perkins , Wan Li Zhu, Open Mind Common Sense: Knowledge Acquisition from the General Public, On the Move to Meaningful Internet Systems, 2002 - DOA/CoopIS/ODBASE 2002 Confederated International Conferences DOA, CoopIS and ODBASE 2002, p.1223-1237, October 30-November 01, 2002
• 4: H. Liu , P. Singh, ConceptNet — A Practical Commonsense Reasoning Tool-Kit, BT Technology Journal, v.22 n.4, p.211-226, October 2004 [doi>10.1023/B:BTTJ.0000047600.45421.6d]
• 5: Fellbaum, C. WordNet: An Electronic Lexical Database. MIT Press. Cambridge, Massachusetts. (1998).
• 6: TAP: Building the Semantic Web. http://tap.stanford.edu/.
• 7: R. Guha , Rob McCool, TAP: a Semantic Web platform, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.42 n.5, p.557-577, 05 August 2003 [doi>10.1016/S1389-1286(03)00225-1]
• 8: Guha, R., McCool, R. A System for Integrating Web Services into a Global Knowledge Base. http://tap.stanford.edu/sw002.html.
• 9: R. Guha , Rob McCool , Eric Miller, Semantic search, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775250]
• 10: McCool, R., Guha, R., Fikes, R. Contexts for the Semantic Web. http://tap.stanford.edu/contexts.pdf.
• 11: Douglas B. Lenat, CYC: a large-scale investment in knowledge infrastructure, Communications of the ACM, v.38 n.11, p.33-38, Nov. 1995 [doi>10.1145/219717.219745]
• 12: Lieberman, H. Your Wish is My Command: Programming by Example. Morgan Kaufmann. San Francisco, California. (2001).
• 13: Mathias Bauer , Dietmar Dengler , Gabriele Paul, Instructible information agents for Web mining, Proceedings of the 5th international conference on Intelligent user interfaces, p.21-28, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325758]
• 14: Miller, R., Myers, B. Creating Dynamic World Wide Web Pages by Demonstration. Technical Report CMU-CS-97-131 (and CMU-HCII-97-101), CMU School of Computer Science. (1997).
• 15: Atsushi Sugiura , Yoshiyuki Koseki, Internet scrapbook: automating Web browsing tasks by demonstration, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.9-18, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288395]
• 16: Alex Safonov, Web macros by example: users managing the WWW of applications, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632761]
• 17: Milind S. Pandit , Sameer Kalbag, The selection recognition agent: instant access to relevant information and operations, Proceedings of the 2nd international conference on Intelligent user interfaces, p.47-52, January 06-09, 1997, Orlando, Florida, United States [doi>10.1145/238218.238285]
• 18: Bonnie A. Nardi , James R. Miller , David J. Wright, Collaborative, programmable intelligent agents, Communications of the ACM, v.41 n.3, p.96-104, March 1998 [doi>10.1145/272287.272331]
• 19: Anind K. Dey , Gregory D. Abowd , Andrew Wood, CyberDesk: a framework for providing self-integrating context-aware services, Proceedings of the 3rd international conference on Intelligent user interfaces, p.47-54, January 06-09, 1998, San Francisco, California, United States [doi>10.1145/268389.268398]
• 20: Alan Dix , Russell Beale , Andy Wood, Architectures to make simple visualisations using simple systems, Proceedings of the working conference on Advanced visual interfaces, p.51-60, May 2000, Palermo, Italy [doi>10.1145/345513.345250]
• 21: Henry Lieberman , Bonnie A. Nardi , David Wright, Grammex: defining grammars by example, CHI 98 conference summary on Human factors in computing systems, p.11-12, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286504]
• 22: Lieberman, H., Liu, H., Singh, P., Barry, B. Beating Some Common Sense into Interactive Applications. AI Magazine, Winter 2004. (2004).
• 23: Henry Lieberman , Hugo Liu, Adaptive Linking between Text and Photos Using Common Sense Reasoning, Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, p.2-11, May 29-31, 2002
• 24: Hugo Liu , Ted Selker , Henry Lieberman, Visualizing the affective structure of a text document, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765961]
• 25: Tom Stocky , Alexander Faaborg , Henry Lieberman, A commonsense approach to predictive text entry, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986014]
• 26: Henry Lieberman , Alexander Faaborg , Waseem Daher , José Espinosa, How to wreck a nice beach you sing calm incense, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040898]
• 27: Eagle, N., Singh, P. Context Sensing Using Speech and Common Sense. Proceedings of the NAACL/HLT 2004 Workshop on Higher-Level Linguistic and Other Knowledge for Automatic Speech Processing. (2004).
• 28: Hugo Liu , Henry Lieberman , Ted Selker, GOOSE: A Goal-Oriented Search Engine with Commonsense, Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, p.253-263, May 29-31, 2002
• 29: Kaminski, C. Much Ado About Smart Tags. http://www.alistapart.com/articles/smarttags/.
• 30: Mossberg, W. Microsoft Will Abandon Controversial Smart Tags. http://ptech.wsj.com/archive/ptech-20010628.html.
• 31: Faaborg, A. A Goal-Oriented User Interface for Personalized Semantic Search. Masters Thesis. Massachusetts Institute of Technology. (2005). http://agents.media.mit.edu/projects/semanticsearch/.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing

General Terms:
Experimentation, Human Factors

Keywords:
ConceptNet, TAP, commonsense reasoning, context aware computing, data detectors, goal-oriented design, open mind, programming by example, software agents