Documentum ECI self-repairing wrappers: performance analysis

ABSTRACT

Documentum Enterprise Content Integration (ECI) services is a content integration middleware that provides one-query access to the Intranet and Internet content resources. The ECI Adapter technology offers an interface to any application for data and metadata extraction from unstructured Web pages. It offers a unique frame-work of wrapper production, automatic recovery and maintenance, developed at Xerox Research Centre Europe and based on state-of-art algorithms from machine learning and grammatical inference. In this presentation we analyze the performance of ECI adapters deployed in current commercial installations. We benefit from accessing reports on daily tests for all ECI commercially deployed adapters collected from June 2003 to September 2005. Using the daily reports, we analyze different aspects of the wrapper technology.

REFERENCES

• 1: Alberto H. F. Laender , Berthier A. Ribeiro-Neto , Altigran S. da Silva , Juliana S. Teixeira, A brief survey of web data extraction tools, ACM SIGMOD Record, v.31 n.2, June 2002 [doi>10.1145/565117.565137]
• 2: Robert Baumgartner , Sergio Flesca , Georg Gottlob, Visual Web Information Extraction with Lixto, Proceedings of the 27th International Conference on Very Large Data Bases, p.119-128, September 11-14, 2001
• 3: D. Bredelet and B. Roustant. Java IWrap: Wrapper Induction by Grammar Learning. Master's thesis, ENSIMAG, Grenoble, France, 2000.
• 4: Boris Chidlovskii, Wrapping Web Information Providers by Transducer Induction, Proceedings of the 12th European Conference on Machine Learning, p.61-72, September 05-07, 2001
• 5: Boris Chidlovskii, Automatic Repairing of Web Wrappers by Combining Redundant Views, Proceedings of the 14th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'02), p.399, November 04-06, 2002
• 6: Valter Crescenzi , Giansalvatore Mecca, Automatic information extraction from large websites, Journal of the ACM (JACM), v.51 n.5, p.731-779, September 2004 [doi>10.1145/1017460.1017462]
• 7: Valter Crescenzi , Giansalvatore Mecca , Paolo Merialdo, RoadRunner: Towards Automatic Data Extraction from Large Web Sites, Proceedings of the 27th International Conference on Very Large Data Bases, p.109-118, September 11-14, 2001
• 8: T. G. Dietterich. Machine learning for sequential data: A review. In T. Caelli, editor, Lecture Notes in Computer Science. Springer-Verlag, 2002.
• 9: Thomas G. Dietterich, Ensemble Methods in Machine Learning, Proceedings of the First International Workshop on Multiple Classifier Systems, p.1-15, June 21-23, 2000
• 10: Documentum Services ECI Adapter Library. http://www.documentum.com/products/glossary/al.htm.
• 11: Documentum Enterprise Content Integration. http://www.documentum.com/solutions/eci.
• 12: Fetch technologies. http://www.fetch.com/.
• 13: Daniela Florescu , Alon Levy , Alberto Mendelzon, Database techniques for the World-Wide Web: a survey, ACM SIGMOD Record, v.27 n.3, p.59-74, Sept. 1, 1998 [doi>10.1145/290593.290605]
• 14: A Primer for Building Portlets Using Oracle Dynamic Services. Oracle Portal Development Kit. http://portalstudio.oracle.com/pls/ops/docs/, 2000.
• 15: Georg Gottlob , Christoph Koch , Robert Baumgartner , Marcus Herzog , Sergio Flesca, The Lixto data extraction project: back and forth between theory and practice, Proceedings of the twenty-third ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 14-16, 2004, Paris, France [doi>10.1145/1055558.1055560]
• 16: Andrew Hogue , David Karger, Thresher: automating the unwrapping of semantic content from the World Wide Web, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060762]
• 17: Theodore W. Hong , Keith L. Clark, Using Grammatical Inference to Automate Information Extraction from the Web, Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery, p.216-227, September 03-05, 2001
• 18: C.-N. Hsu and C.-C. Chang. Finite-State Transducers for Semi-Structured Text Mining. In Proceedings of IJCAI-99 Workshop on Text Mining: Foundations, Techniques and Applications, 1999.
• 19: Neil Ireson , Fabio Ciravegna , Mary Elaine Califf , Dayne Freitag , Nicholas Kushmerick , Alberto Lavelli, Evaluating machine learning for information extraction, Proceedings of the 22nd international conference on Machine learning, p.345-352, August 07-11, 2005, Bonn, Germany [doi>10.1145/1102351.1102395]
• 20: Itemfield. http://www.itemfield.com/.
• 21: R. Kosala, J. den Bussche, M. Bruynooghe, and H. Blockeel. Information extraction in structured documents using tree automata induction, 2002.
• 22: Stefan Kuhlins , Ross Tredwell, Toolkits for Generating Wrappers, Revised Papers from the International Conference NetObjectDays on Objects, Components, Architectures, Services, and Applications for a Networked World, p.184-198, October 07-10, 2002
• 23: Nicholas Kushmerick, Regression testing for wrapper maintenance, Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence, p.74-79, July 18-22, 1999, Orlando, Florida, United States
• 24: Nicholas Kushmerick, Wrapper induction: efficiency and expressiveness, Artificial Intelligence, v.118 n.1-2, p.15-68, April 2000 [doi>10.1016/S0004-3702(99)00100-9]
• 25: K. Lerman, S. Minton, and C. A. Knoblock. Wrapper maintenance: A machine learning approach. Journal of Artif. Intell. Research (JAIR), 18:149--181, 2003.
• 26: XWRAP: An XML-Enabled Wrapper Construction System for Web Information Sources, Proceedings of the 16th International Conference on Data Engineering, p.611, February 28-March 03, 2000
• 27: Lixto software gmbh. http://www.lixto.com/.
• 28: Ion Muslea , Steve Minton , Craig Knoblock, A hierarchical approach to wrapper induction, Proceedings of the third annual conference on Autonomous Agents, p.190-197, April 1999, Seattle, Washington, United States [doi>10.1145/301136.301191]
• 29: J. Oncina , P. García , E. Vidal, Learning Subsequential Transducers for Pattern Recognition Interpretation Tasks, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.15 n.5, p.448-458, May 1993 [doi>10.1109/34.211465]
• 30: A. Sahuguet and F. Azavant. Building light-weight wrappers for legacy Web data-sources using W4F. The VLDB Journal, pages 738--741, 1999.
• 31: Ian H. Witten and Eibe Frank. Data Mining: Practical machine learning tools and techniques, 2nd Edition. Morgan Kaufmann, San Francisco, 2005.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.5 Heterogeneous Databases

General Terms:
Algorithms, Measurement, Performance

Keywords:
content integration, web wrappers, wrapper maintenance