InfoSleuth: agent-based semantic integration of information in open and dynamic environments

ABSTRACT

The goal of the InfoSleuth project at MCC is to exploit and synthesize new technologies into a unified system that retrieves and processes information in an ever-changing network of information sources. InfoSleuth has its roots in the Carnot project at MCC, which specialized in integrating heterogeneous information bases. However, recent emerging technologies such as internetworking and the World Wide Web have significantly expanded the types, availability, and volume of data available to an information management system. Furthermore, in these new environments, there is no formal control over the registration of new information sources, and applications tend to be developed without complete knowledge of the resources that will be available when they are run. Federated database projects such as Carnot that do static data integration do not scale up and do not cope well with this ever-changing environment. On the other hand, recent Web technologies, based on keyword search engines, are scalable but, unlike federated databases, are incapable of accessing information based on concepts. In this experience paper, we describe the architecture, design, and implementation of a working version of InfoSleuth. We show how InfoSleuth integrates new technological developments such as agent technology, domain ontologies, brokerage, and internet computing, in support of mediated interoperation of data and services in a dynamic and open environment. We demonstrate the use of information brokering and domain ontologies as key elements for scalability.

REFERENCES

• 1: A. Arning, R. Agrawal, and P. Raghavan, "A linear method for deviation detection in large databases", In KDD-96 Proceedings, Second International Conference on Knowledge Discovery and Data Mining, 1996.
• 2: J. Ambros-Ingerson and S. Steel, "Integrating planning, execution and monitoring", In Proceedings of the Seventh National Conference on Artificial Intelligence (AAAI-88), pages 83-88, St. Paul, MN, 1988.
• 3: Rakesh Agrawal , Tomasz Imieliński , Arun Swami, Mining association rules between sets of items in large databases, Proceedings of the 1993 ACM SIGMOD international conference on Management of data, p.207-216, May 25-28, 1993, Washington, D.C., United States
• 4: Yigal Arens , Craig A. Knoblock , Wei-Min Shen, Query reformulation for dynamic information integration, Journal of Intelligent Information Systems, v.6 n.2-3, p.99-130, June 1996 [doi>10.1007/BF00122124]
• 5: R. Agrawal, and K. Shim, "Developing tightly-coupled data mining applications on a relational database system". In KDD-96 Proceedings, Second International Conference on Knowledge Discovery and Data Mining, 1996.
• 6: Christopher Ahlberg , Christopher Williamson , Ben Shneiderman, Dynamic queries for information exploration: an implementation and evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.619-626, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143054]
• 7: "http://www. mcc.com/projects/carnot"
• 8: Oren Etzioni , Daniel Weld, A softbot-based interface to the Internet, Communications of the ACM, v.37 n.7, p.72-76, July 1994 [doi>10.1145/176789.176797]
• 9: Usama M. Fayyad , S. George Djorgovski , Nicholas Weir, Automating the analysis and cataloging of sky surveys, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
• 10: J. Firby, "Task networks for controlling continuous processes", In Proceedings of the Second International Conference on AI Planning Systems, 1994.
• 11: Tim Finin , Richard Fritzson , Don McKay , Robin McEntire, KQML as an agent communication language, Proceedings of the third international conference on Information and knowledge management, p.456-463, November 29-December 02, 1994, Gaithersburg, Maryland, United States [doi>10.1145/191246.191322]
• 12: Usama M. Fayyad , Gregory Piatetsky-Shapiro , Padhraic Smyth, From data mining to knowledge discovery: an overview, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
• 13: M. R. Genesereth, It. E. Fikes, et al. "Knowledge Interchange Format Version 3 Reference Manual", Logic- 92-1, Stanford University Logic Group, 1992.
• 14: Michael R. Genesereth , Steven P. Ketchpel, Software agents, Communications of the ACM, v.37 n.7, p.48-ff., July 1994 [doi>10.1145/176789.176794]
• 15: Thomas R. Gruber, A translation approach to portable ontology specifications, Knowledge Acquisition, v.5 n.2, p.199-220, June 1993 [doi>10.1006/knac.1993.1008]
• 16: H. Garcia-Molina, Y. Papakonstantinou, D. Quass, A. Rajaraman, Y. Sagiv, J. Ullman and 3. Widom, "The TSIMMIS Approach to Mediation: Data Models and Languages", In Proceedings of the NGITS (Next Generation Information Technologies and Systems), June 1995.
• 17: K. J. Hammond, "CHEF: A model of case-based planning". In Proceedings of the Fifth National Conference on Artificial Intelligence (AAAI-86), Philadelphia, PA, 1986.
• 18: M. Huhns, N. Jacobs, T. Ksiezyk, W. M. Shen, M. Singh and P. Canata, "Enterprise Information Modeling and Model Integration in Carnot', Enterprise integration Modeling: Proceedings of the First International Conference, The MIT Press, 1992.
• 19: "http://www.mcc.com/projects/infosleuth"
• 20: N. Jacobs and R. Shea, "The Role of Java in InfoSleuth: Agent-based Exploitation of Heterogeneous Information Resources", IntraNet96 Java Developers Conference, April, 1996.
• 21: C. Knoblock, "Planning, executing, sensing, and replanning for information gathering", In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, 1995.
• 22: Yannis Labrou , Timothy Finin, Semantics for an agent communication language, 1996
• 23: J.Lee, M.Huber, E.Durfee, and P.Kenny, "UM-PRS: An implementation of the procedural reasoning system for multirobot applications", In Proceeding of the AIAA/NASA Conference on Intelligent Robotics in Field, Factory Service and Space, pages 842-859, 1994.
• 24: Alon Y. Levy , Anand Rajaraman , Joann J. Ordille, Querying Heterogeneous Information Sources Using Source Descriptions, Proceedings of the 22th International Conference on Very Large Data Bases, p.251-262, September 03-06, 1996
• 25: Ling Liu , Calton Pu, The distributed interoperable object model and its application to large-scale interoperable database systems, Proceedings of the fourth international conference on Information and knowledge management, p.105-112, November 29-December 02, 1995, Baltimore, Maryland, United States [doi>10.1145/221270.221340]
• 26: J. E. Laird, D. J. Pearson, R. M. Jones, and R. E. Wray III, "Dynamic knowledge integration during plan execution", In Proceedings of the AAAI-96 Fall Symposium on Plan Execution: Problems and Issues, 1996.
• 27: Alon Y. Levy , Divesh Srivastava , Thomas Kirk, Data model and query evaluation in global information systems, Journal of Intelligent Information Systems, v.5 n.2, p.121-143, Sept. 1995 [doi>10.1007/BF00962627]
• 28: E. Mena , V. Kashyap , A. Sheth , A. Illarramendi, OBSERVER: An Approach for Query Processing in Global Information Systems based on Interoperation across Pre-existing Ontologies, Proceedings of the First IFCIS International Conference on Cooperative Information Systems, p.14, June 19-21, 1996
• 29: Christopher J. Matheus , Gregory Piatetsky-Shapiro , Dwight McNeill, Selecting and reporting what is interesting, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
• 30: Object Management Group. "CORBA: The Common Object Request Broker: Architecture and Specification", Release 2.0, July 1995.
• 31: MV N Prasad, Retrieval and Reasoning in Distributed Case Bases, University of Massachusetts, Amherst, MA, 1995
• 32: G. Riley, "CLIPS: An Expert System Building Tool", Proceedings of the Technology 2001 Conference, San Jose, CA, December 1991.
• 33: , A. Tomasic, L. Raschid, and P. Valduriez, "Scaling Heterogeneous Distributed Databases and the Design of DISCO", Proceedings of the 16th International Conference on Distributed Computing Systems, Hong Kong, 1995.
• 34: M. Williamson, K. Decker, and K. Sycara, "Unified information and control flow in hierarchical task networks", Technical report, The Robotics Institute, CMU, 1996.
• 35: D. Woelk, M. Huhns and C. Tomlinson. "InfoSleuth Agents: The Next Generation of Active Objects", Object Magazine, July/August, 1995.
• 36: D. Woelk, P. Cannata, M. Huhns, N. Jacobs, T. Ksiezyk, R. Lavender, G. Merdith, K. Ong, W. Shen, M. Singh, aaad C. Tomlinson, "Carnot Prototype", in Object-Oriented Multidatabase Systems, O. Bukhres and A. Elmagarmid (editors), 1996.
• 37: D. Woelk and C. Tomlinson, "The InfoSleuth Project: Intelligent Search Management via Semantic Agents", Second International World Wide Web Conference, October, 1994.
• 38: C. Zaniolo, "The Logical Data Language (LDL): An Integrated Approach to Logic and Databases", MCC Technical Report STP-LD-328-91, 1991.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS

  D. Software
  D.3 PROGRAMMING LANGUAGES

  F. Theory of Computation
  F.3 LOGICS AND MEANINGS OF PROGRAMS

General Terms:
Design, Languages, Management, Performance, Standardization, Theory