Mining tables from large scale HTML texts

ABSTRACT

Table is a very common presentation scheme, but few papers touch on table extraction in text data mining. This paper focuses on mining tables from large-scale HTML texts. Table filtering, recognition, interpretation, and presentation are discussed. Heuristic rules and cell similarities are employed to identify tables. The F-measure of table recognition is 86.50%. We also propose an algorithm to capture attribute-value relationships among table cells. Finally, more structured data is extracted and presented.

REFERENCES

• 1: Appelt, D. and Israel, D. (1997) "Tutorial Notes on Building Information Extraction Systems," Tutorial on Fifth Conference on Applied Natural Language Processing, 1997.
• 2: Chen, H. H.; Ding Y. W.; and Tsai, S. C. (1998) "Named Entity Extraction for Information Retrieval," Computer Processing of Oriental Languages, Special Issue on Information Retrieval on Oriental Languages, Vol. 12, No. 1, 1998, pp. 75--85.
• 3: Douglas, S.; Hurst, M. and Quinn, D. (1995) "Using Natural Language Processing for Identifying and Interpreting Tables in Plain Text," Proceedings of Fourth Annual Symposium on Document Analysis and Information Retrieval, 1995, pp. 535--545.
• 4: Douglas, S. and Hurst, M. (1996) "Layout and Language: Lists and Tables in Technical Documents," Proceedings of ACL SIGPARSE Workshop on Punctuation in Computational Linguistics, 1996, pp. 19--24.
• 5: Gaizauskas, R. and Wilks, Y. (1998) "Information Extraction: Beyond Document Retrieval," Computational Linguistics and Chinese Language Processing, Vol. 3, No. 2, 1998, pp. 17--59.
• 6: Green, E. and Krishnamoorthy, M. (1995) "Recognition of Tables Using Grammars," Proceedings of the Fourth Annual Symposium on Document Analysis and Information Retrieval, 1995, pp. 261--278.
• 7: Matthew Hurst , Shona Douglas, Layout & language: preliminary experiments in assigning logical structure to table cells, Proceedings of the fifth conference on Applied natural language processing, p.217-220, March 31-April 03, 1997, Washington, DC [doi>10.3115/974557.974589]
• 8: Hurst, M. (1999a) "Layout and Language: Beyond Simple Text for Information Interaction - Modeling the Table," Proceedings of the 2nd International Conference on Multimodal Interfaces, Hong Kong, January 1999.
• 9: Hurst, M. (1999b) "Layout and Language: A Corpus of Documents Containing Tables," Proceedings of AAAI Fall Symposium: Using Layout for the Generation, Understanding and Retrieval of Documents, 1999.
• 10: Mikheev, A. and Finch, S. (1995) "A Workbench for Acquisition of Ontological Knowledge from Natural Text," Proceedings of the 7th Conference of the European Chapter for Computational Linguistics, 1995, pp. 194--201.
• 11: MUC (1998) Proceedings of 7th Message Understanding Conference, http://www.muc.saic.com/proceedings/proceedings_index.html.
• 12: Hwee Tou Ng , Chung Yong Lim , Jessica Li Teng Koo, Learning to recognize tables in free text, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.443-450, June 20-26, 1999, College Park, Maryland [doi>10.3115/1034678.1034746]