Towards domain-independent information extraction from web tables

ABSTRACT

Traditionally, information extraction from web tables has focused on small, more or less homogeneous corpora, often based on assumptions about the use of

REFERENCES

• 1: Serge Abiteboul , Richard Hull , Victor Vianu, Foundations of Databases: The Logical Level, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 2: Eugene Agichtein , Luis Gravano, Snowball: extracting relations from large plain-text collections, Proceedings of the fifth ACM conference on Digital libraries, p.85-94, June 02-07, 2000, San Antonio, Texas, United States [doi>10.1145/336597.336644]
• 3: Yonatan Aumann , Ronen Feldman , Yair Liberzon , Benjamin Rosenfeld , Jonathan Schler, Visual information extraction, Knowledge and Information Systems, v.10 n.1, p.1-15, July 2006 [doi>10.1007/s10115-006-0014-x]
• 4: M. Banko, M. J. Cafarella, S. Soderland, M. Broadhead, and O. Etzioni. Open information extraction from the Web. In Proc. 20th IJCAI, pp. 2670--2676, Jan. 2007.
• 5: Mikhail Bilenko , Sugato Basu , Mehran Sahami, Adaptive Product Normalization: Using Online Learning for Record Linkage in Comparison Shopping, Proceedings of the Fifth IEEE International Conference on Data Mining, p.58-65, November 27-30, 2005 [doi>10.1109/ICDM.2005.18]
• 6: D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma. Extracting content structure for web pages based on visual representation. In Proc. 5th AP Web, pp. 406--417. Springer, Apr. 2003.
• 7: Hsin-Hsi Chen , Shih-Chung Tsai , Jin-He Tsai, Mining tables from large scale HTML texts, Proceedings of the 18th conference on Computational linguistics, p.166-172, July 31-August 04, 2000, Saarbrücken, Germany [doi>10.3115/990820.990845]
• 8: William W. Cohen , Matthew Hurst , Lee S. Jensen, A flexible learning system for wrapping tables and lists in HTML documents, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511477]
• 9: M. Cosulschi, N. Constantinescu, and M. Gabroveanu. Classification and comparison of information structures from a web page. The Annals of the University of Craiova, 31:109--121, 2004.
• 10: Aron Culotta , Andrew McCallum , Jonathan Betz, Integrating probabilistic extraction models and data mining to discover relations and patterns in text, Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, p.296-303, June 04-09, 2006, New York, New York [doi>10.3115/1220835.1220873]
• 11: Nilesh Dalvi , Dan Suciu, Answering queries from statistics and probabilistic views, Proceedings of the 31st international conference on Very large data bases, August 30-September 02, 2005, Trondheim, Norway
• 12: D.W. Embley, M. Hurst, D. P. Lopresti, and G. Nagy. Table-processing paradigms: a research survey. IJDAR, 8(2-3):66--86, June 2006.
• 13: D.W. Embley, D.P. Lopresti, and G. Nagy. Notes on contemporary table recognition. In Proc. 7th Int. Workshop on Document Analysis Systems (DAS), pp. 164--175. Springer, Feb. 2006.
• 14: O. Etzioni, M.J. Cafarella, D. Downey, A.-M. Popescu, T. Shaked, S. Soderland, D.S. Weld, and A. Yates. Methods for domain-independent information extraction from the Web: An experimental comparison. In Proc. 19th AAAI, pp. 391--398. AAAI Press/MIT Press, July 2004.
• 15: W. Gatterbauer and P. Bohunsky. Table extraction using spatial reasoning on the CSS2 visual box model. In Proc. 21st AAAI, pp. 1313--1318. AAAI Press, July 2006.
• 16: Xiao-Dong Gu , Jinlin Chen , Wei-Ying Ma , Guo-Liang Chen, Visual Based Content Understanding towards Web Adaptation, Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, p.164-173, May 29-31, 2002
• 17: Why Table Ground-Truthing is Hard, Proceedings of the Sixth International Conference on Document Analysis and Recognition, p.129, September 10-13, 2001
• 18: M. Hurst. Layout and language: Challenges for table understanding on the Web. In Proc. 1st WDA at 6th ICDAR, pp. 27--30, Sept. 2001.
• 19: Milos Kovacevic , Michelangelo Diligenti , Marco Gori , Veljko Milutinovic, Recognition of Common Areas in a Web Page Using Visual Information: a possible application in a page classification, Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM'02), p.250, December 09-12, 2002
• 20: Bernhard Krüpl , Marcus Herzog, Visually guided bottom-up table detection and segmentation in web documents, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135951]
• 21: Bernhard Krüpl , Marcus Herzog , Wolfgang Gatterbauer, Using visual cues for extraction of tabular data from arbitrary HTML documents, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1062745.1062838]
• 22: Kristina Lerman , Lise Getoor , Steven Minton , Craig Knoblock, Using the structure of Web sites for automatic segmentation of tables, Proceedings of the 2004 ACM SIGMOD international conference on Management of data, June 13-18, 2004, Paris, France [doi>10.1145/1007568.1007584]
• 23: Bing Liu , Kevin Chen-Chuan-Chang, Editorial: special issue on web content mining, ACM SIGKDD Explorations Newsletter, v.6 n.2, p.1-4, December 2004 [doi>10.1145/1046456.1046457]
• 24: Bijan Parsia , Peter F. Patel-Schneider, Meaning and the semantic web, Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters, May 19-21, 2004, New York, NY, USA [doi>10.1145/1013367.1013448]
• 25: Flexible Web Document Analysis for Delivery to Narrow-Bandwidth Devices, Proceedings of the Sixth International Conference on Document Analysis and Recognition, p.1074, September 10-13, 2001
• 26: A. Pivk, P. Cimiano, and Y. Sure. From tables to frames. Journal of Web Semantics, 3(2--3):132--146, 2005.
• 27: B. Pollak and W. Gatterbauer. Creating permanent test sets of web pages for information extraction research. In Proc. 33rd SOFSEM: Theory and Practice of Computer Science, volII, pp. 103--115, Jan. 2007.
• 28: Kai Simon , Georg Lausen, ViPER: augmenting automatic information extraction with visual perceptions, Proceedings of the 14th ACM international conference on Information and knowledge management, October 31-November 05, 2005, Bremen, Germany [doi>10.1145/1099554.1099672]
• 29: Ashwin Tengli , Yiming Yang , Nian Li Ma, Learning table extraction from examples, Proceedings of the 20th international conference on Computational Linguistics, p.987-es, August 23-27, 2004, Geneva, Switzerland [doi>10.3115/1220355.1220497]
• 30: Yuri A. Tijerino , David W. Embley , Deryle W. Lonsdale , Yihong Ding , George Nagy, Towards Ontology Generation from Tables, World Wide Web, v.8 n.3, p.261-285, September 2005 [doi>10.1007/s11280-005-0360-8]
• 31: C. Vanoirbeek. Formatting structured tables. In Proc. of Electronic Publishing'92, pp. 291--309. Cambridge University Press, Apr. 1992.
• 32: Xinxin Wang , Derick Wood, Tabular abstraction, editing, and formatting, University of Waterloo, Waterloo, Ont., Canada, 1996
• 33: Yalin Wang , Jianying Hu, A machine learning based approach for table detection on the web, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511478]
• 34: H. Wium Lie, B. Bos, C. Lilley, and I. Jacobs. Cascading Style Sheets, level 2. Technical report, World WideSS2.
• 35: T. Wohlberg. Hypertables: Development of a structure description language for tables in XML. Master thesis, University of Hamburg, Germany, 1999.(Original title in German: Hypertables: Entwicklung einer Strukturbeschreibungssprache für Tabellen in XML).
• 36: Yingchen Yang , Wo-Shun Luk, A framework for web table mining, Proceedings of the 4th international workshop on Web information and data management, November 08-08, 2002, McLean, Virginia, USA [doi>10.1145/584931.584940]
• 37: HTML Page Analysis Based on Visual Cues, Proceedings of the Sixth International Conference on Document Analysis and Recognition, p.859, September 10-13, 2001
• 38: M. Yoshida, K. Torisawa, and J. Tsujii. A method to integrate tables of the world wide web. In Proc. 1st WDA at 6th ICDAR, pp. 31--34, Sept. 2001.
• 39: Richard Zanibbi , Dorothea Blostein , R. Cordy, A survey of table recognition: Models, observations, transformations, and inferences, International Journal on Document Analysis and Recognition, v.7 n.1, p.1-16, March 2004 [doi>10.1007/s10032-004-0120-9]
• 40: Yanhong Zhai , Bing Liu, Web data extraction based on partial tree alignment, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060761]
• 41: Hongkun Zhao , Weiyi Meng , Zonghuan Wu , Vijay Raghavan , Clement Yu, Fully automatic wrapper generation for search engines, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060760]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

General Terms:
Algorithms, Experimentation, Theory

Keywords:
information extraction, visual analysis, web mining, web page representation, web tables