Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

We describe an HTML web page segmentation algorithm, which is applied to segment online medical journal articles (regular HTML and PDF-Converted-HTML files). The web page content is modeled by a zone tree structure based primarily on the geometric layout of the web page. For a given journal article, a zone tree is generated by combining DOM tree analysis and recursive X-Y cut algorithm. Combining with other visual cues, such as background color, font size, font color and so on, the page is segmented into homogeneous regions. Evaluation is conducted with 104 articles from 11 journals. Out of 9726 ground-truth zones, 9376 zones are correctly segmented, for an accuracy of 96.40%. Segmenting the entire web page into zones can significantly expedite and increase the accuracy of the subsequent information retrieval steps.

REFERENCES

• 1: Baird, H.S., Jones, S.E., and Fortune, S.J., Image Segmentation by Shape-Directed Covers, Proc. International Conference Pattern Recognition, pp. 820--825, 1990.
• 2: Orkut Buyukkokten , Hector Garcia-Molina , Andreas Paepcke, Accordion summarization for end-game browsing on PDAs and cellular phones, Proceedings of the SIGCHI conference on Human factors in computing systems, p.213-220, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365102]
• 3: Cai, D., Yu, S., Wen, J. R., and Ma, W. Y., Extracting Content Structure for Web Pages Based on Visual Representation, Proc. of 5th Asia Pacific Web Conference, 2003.
• 4: Cai, D., Yu, S., Wen J. R., and Ma, W. Y., VIPS: a Vision-Based Page Segmentation Algorithm, Microsoft Technical Report (MSR-TR-2003-79), 2003.
• 5: Jinlin Chen , Baoyao Zhou , Jin Shi , Hongjiang Zhang , Qiu Fengwu, Function-based object model towards website adaptation, Proceedings of the 10th international conference on World Wide Web, p.587-596, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372161]
• 6: Yanlei Diao , Hongjun Lu , Songting Chen , Zengping Tian, Toward Learning Based Web Query Processing, Proceedings of the 26th International Conference on Very Large Data Bases, p.317-328, September 10-14, 2000
• 7: Jaekyu Ha , R. M. Haralick , I. T. Phillips, Recursive X-Y cut using bounding boxes of connected components, Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 2), p.952, August 14-15, 1995
• 8: Hauser, S.E., Le D.X., and Thoma G.R., Automated zone correction in bitmapped document images, Proc. SPIE: Document Recognition and Retrieval VII, SPIE Vol. 3976, San Jose, CA, pp. 248--258, 2000.
• 9: Anil K. Jain , Bin Yu, Document Representation and Its Application to Page Decomposition, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.3, p.294-308, March 1998 [doi>10.1109/34.667886]
• 10: Eija Kaasinen , Matti Aaltonen , Juha Kolari , Suvi Melakoski , Timo Laakko, Two approaches to bringing Internet services to WAP devices, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.231-246, June 2000, Amsterdam, The Netherlands
• 11: Shian-Hua Lin , Jan-Ming Ho, Discovering informative content blocks from Web documents, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775134]
• 12: Joe Marini, Document Object Model, McGraw-Hill, Inc., New York, NY, 2002
• 13: George Nagy , Sharad Seth , Mahesh Viswanathan, A Prototype Document Image Analysis System for Technical Journals, Computer, v.25 n.7, p.10-22, July 1992 [doi>10.1109/2.144436]
• 14: George Nagy, Twenty Years of Document Image Analysis in PAMI, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.1, p.38-62, January 2000 [doi>10.1109/34.824820]
• 15: L. O'Gorman, The Document Spectrum for Page Layout Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.15 n.11, p.1162-1173, November 1993 [doi>10.1109/34.244677]
• 16: Theo Pavlidis , Jiangying Zhou, Page segmentation and classification, CVGIP: Graphical Models and Image Processing, v.54 n.6, p.484-496, Nov. 1992 [doi>10.1016/1049-9652(92)90068-9]
• 17: http://www.w3.org/DOM/
• 18: http://pdftohtml.sourceforge.net/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.6 Library Automation
          Subjects: Large text archives
      H.3.7 Digital Libraries

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Document analysis

General Terms:
Algorithms, Design, Experimentation, Performance

Keywords:
HTML document segmentation, document layout analysis, document object model (DOM), web information retrieval