Extracting semi-structured data through examples

ABSTRACT

In this paper, we describe an innovative approach to extracting semi-structured data from Web sources. The idea is to collect a couple of example objects from the user and to use this information to extract new objects from new pages or texts. To perform the extraction of new objects, we introduce a bottom-up extration strategy and, through experimentation, demonstrate that it works quite effectively with distinct Web sources, even if only a few examples are provided by the user.

REFERENCES

• 1: Amazon.corn Web Site. http://www.amazon.com.
• 2: CDnow Web Site. http://www.cdnow.com.
• 3: DB&LP Site. http://www.informatik.uni-trier, de/~Iey/db/.
• 4: ~ravelocity Site. http://www.travelocity, com/.
• 5: Brad Adelberg, NoDoSE—a tool for semi-automatically extracting structured and semistructured data from text documents, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.283-294, June 01-04, 1998, Seattle, Washington, United States
• 6: Naveen Ashish , Craig A. Knoblock, Wrapper generation for semi-structured Internet sources, ACM SIGMOD Record, v.26 n.4, p.8-15, Dec. 1997 [doi>10.1145/271074.271078]
• 7: Paolo Atzeni , Giansalvatore Mecca, Cut and paste, Proceedings of the sixteenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.144-153, May 11-15, 1997, Tucson, Arizona, United States [doi>10.1145/263661.263678]
• 8: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 9: Peter Buneman, Semistructured data, Proceedings of the sixteenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.117-121, May 11-15, 1997, Tucson, Arizona, United States [doi>10.1145/263661.263675]
• 10: James P. Callan, Passage-level evidence in document retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.302-310, July 03-06, 1994, Dublin, Ireland
• 11: CHAWATHE, S., GARCIA-MOLtNA, H., HAMMER, J., IRELAND, K., PAPAKONSTANTINOU, Y., ULLMAN, J., AND WIDOM, J. The TSIMMIS Project: Integration of Heterogeneous Information Sources. In Proceedings of IPSJ Conference (Tokyo, Japan, 1994), pp. 7-18.
• 12: Jim Cowie , Wendy Lehnert, Information extraction, Communications of the ACM, v.39 n.1, p.80-91, Jan. 1996 [doi>10.1145/234173.234209]
• 13: David W. Embley , Douglas M. Campbell , Y. S. Jiang , Stephen W. Liddle , Yiu-Kai Ng , Dallan Quass , Randy D. Smith, A Conceptual-Modeling Approach to Extracting Data from the Web, Proceedings of the 17th International Conference on Conceptual Modeling, p.78-91, November 16-19, 1998
• 14: David W. Embley , Douglas M. Campbell , Randy D. Smith , Stephen W. Liddle, Ontology-based extraction and structuring of information from data-rich unstructured documents, Proceedings of the seventh international conference on Information and knowledge management, p.52-59, November 02-07, 1998, Bethesda, Maryland, United States [doi>10.1145/288627.288641]
• 15: Jean-Robert Gruser , Louiqa Raschid , M. E. Vidal , Laura Bright, Wrapper Generation for Web Accessible Data Sources, Proceedings of the 3rd IFCIS International Conference on Cooperative Information Systems, p.14-23, August 20-22, 1998
• 16: Joachim Hammer , Héctor García-Molina , Svetlozar Nestorov , Ramana Yerneni , Marcus Breunig , Vasilis Vassalos, Template-based wrappers in the TSIMMIS system, Proceedings of the 1997 ACM SIGMOD international conference on Management of data, p.532-535, May 11-15, 1997, Tucson, Arizona, United States
• 17: Marcin Kaszkiel , Justin Zobel, Passage retrieval revisited, Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, p.178-185, July 27-31, 1997, Philadelphia, Pennsylvania, United States
• 18: Pallavi Pyreddy , W. Bruce Croft, TINTIN: a system for retrieval in text tables, Proceedings of the second ACM international conference on Digital libraries, p.193-200, July 23-26, 1997, Philadelphia, Pennsylvania, United States [doi>10.1145/263690.263816]
• 19: Berthier Ribeiro-Neto , Alberto H. F. Laender , Altigran S. da Silva, Top-Down Extraction of Semi-Structured Data, Proceedings of the String Processing and Information Retrieval Symposium & International Workshop on Groupware, p.176, September 21-24, 1999
• 20: SILVA, E. S. Extraction of Semi-Structured Data Based on Examples. Master's thesis, Departament of Computer Science, Federal University of Minas Gerais, 1999. In portuguese.
• 21: SODERLAND, S. Learning to Extract Text-based Information from the World Wide Web. In Proceedings of the Third International Conference on Knowledge Discovery and Data Mining - KDD-97 (Newport Beach, California, 1997), pp. 251-254.
• 22: ZLOOP, M. M. Query-by-Example: A Data Base Language. IBM Systems Journal 16, 4 (1977), 324-343.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services
          Subjects: Web-based services
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Web-based interaction

General Terms:
Design, Management, Measurement, Performance, Theory