"Inside the bible": segmentation, annotation and retrieval for a new browsing experience

ABSTRACT

In this paper we present a system for automatic segmentation, annotation and image retrieval based on content, focused on illuminated manuscripts and in particular the Borso D'Este Holy Bible. To enhance the interaction possibilities with this work, full of decorations and illustrations, we exploit some well known document analysis techniques in addition to some new approaches, in order to achieve good segmentation of pages into meaningful visual objects with the relative annotation. We wanted to extend the standard keyword-based retrieval approach in a commentary with a modern visual-based retrieval by appearance similarity: an entire software user interface for exploration and visual search of illuminated manuscripts.

REFERENCES

• 1: F. Le Bourgeois , H. Emptoz, DEBORA: Digital AccEss to BOoks of the RenAissance, International Journal on Document Analysis and Recognition, v.9 n.2, p.193-221, April 2007 [doi>10.1007/s10032-006-0030-0]
• 2: Ergina Kavallieratou, A Binarization Algorithm specialized on Document Images and Photos, Proceedings of the Eighth International Conference on Document Analysis and Recognition, p.463-467, August 31-September 01, 2005 [doi>10.1109/ICDAR.2005.1]
• 3: N. Jourmet , R. Mullot , V. Eglin , J. Y. Ramel, Dedicated Texture Based Tools for Characterisation of Old Books, Proceedings of the Second International Conference on Document Image Analysis for Libraries, p.60-69, April 27-28, 2006 [doi>10.1109/DIAL.2006.11]
• 4: Christopher M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics), Springer-Verlag New York, Inc., Secaucus, NJ, 2006
• 5: Prati A., Calderara S., Cucchiara R. 2008. Using Circular Statistics for Trajectory Analysis. In Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR 2008, Anchorage, Alaska June 24--26, 2008).
• 6: Geoffrey W. Hill, Evaluation and Inversion of the Ratios of Modified Bessel Functions, I₁(x) /I₀ (x) and I _1.5(x)/ I_0.5(x), ACM Transactions on Mathematical Software (TOMS), v.7 n.2, p.199-208, June 1981 [doi>10.1145/355945.355949]
• 7: Cecotti, H., Belaid, A. 2005. Hybrid OCR combination approach complemented by a specialized ICR applied on ancient documents, vol.2, pp. 1045--1049.
• 8: Yann LEYDIER , Frank Le BOURGEOIS , Hubert EMPTOZ, Omnilingual Segmentation-freeWord Spotting for Ancient Manuscripts Indexation, Proceedings of the Eighth International Conference on Document Analysis and Recognition, p.533-537, August 31-September 01, 2005 [doi>10.1109/ICDAR.2005.171]
• 9: Jing Huang , S. Ravi Kumar , Mandar Mitra , Wei-Jing Zhu , Ramin Zabih, Image Indexing Using Color Correlograms, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.762, June 17-19, 1997
• 10: L. Cinque , S. Levialdi , A. Pellicanò , K. A. Olsen, Color-Based Image Retrieval Using Spatial-Chromatic Histograms, Proceedings of the IEEE International Conference on Multimedia Computing and Systems Volume II-Volume 2, p.969, June 07-11, 1999
• 11: Costantino Grana , Roberto Vezzani , Rita Cucchiara, Enhancing HSV histograms with achromatic points detection for video retrieval, Proceedings of the 6th ACM international conference on Image and video retrieval, p.302-308, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282327]
• 12: Won C. S., Park D. K., Park S. J. 2002. Efficient Use of MPEG-7 Edge Histogram Descriptor, ETRI Journal, vol.24, no.1, pp.23--30
• 13: J. W. Sammon, A Nonlinear Mapping for Data Structure Analysis, IEEE Transactions on Computers, v.18 n.5, p.401-409, May 1969 [doi>10.1109/T-C.1969.222678]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.0 General

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.6 Segmentation
          Subjects: Pixel classification
  I.5 PATTERN RECOGNITION
      I.5.5 Implementation
          Subjects: Interactive systems

General Terms:
Algorithms, Design

Keywords:
document analysis, texture analysis, von mises distribution