Structuralizing digital ink for efficient selection

ABSTRACT

Raw digital ink is informal and unstructured. Its editing, especially its selection, is often inefficient. In this paper, we present approaches to structuralize raw digital ink as multiple hierarchies to facilitate its selection. First a link model is built to organize ink as a mesh-like structure. Based on the link model, the isolated stroke groups form patches. In each patch, textual and graphical areas are separated. Then, each textual area is segmented into text lines, and each text line is partitioned to words. We also design gestures for selecting structured ink. Experiments showed that our ink-structuralizing approaches are effective and selecting structured ink by our gestures considerably outperforms selecting raw ink.

REFERENCES

• 1: Christopher M. Bishop , Markus Svensen , Geoffrey E. Hinton, Distinguishing Text from Graphics in On-Line Handwritten Ink, Proceedings of the Ninth International Workshop on Frontiers in Handwriting Recognition (IWFHR'04), p.142-147, October 26-29, 2004 [doi>10.1109/IWFHR.2004.34]
• 2: Elisabetta Bruzzone , Meri Cristina Coffetti, An Algorithm for Extracting Cursive Text Lines, Proceedings of the Fifth International Conference on Document Analysis and Recognition, p.749, September 20-22, 1999
• 3: Eric W. Weisstein. "Delaunay Triangulation." http://mathworld.wolfram.com/DelaunayTriangulation.html
• 4: Hideaki Goto, Hirotomo Aso, Extracting curved text lines using local linearity of the text line, IJDAR (1999) 2: pp. 111--119.
• 5: T. Igarashi , S. Matsuoka , T. Masui, Adaptive recognition of implicit structures in human-organized layouts, Proceedings of the 11th International IEEE Symposium on Visual Languages, p.258, September 05-09, 1995
• 6: Jisheng Liang , Robert M. Haralick , Ihsin T. Phillips, A Statistically Based, Highly Accurate Text-Line Segmentation Method, Proceedings of the Fifth International Conference on Document Analysis and Recognition, p.551, September 20-22, 1999
• 7: KEISUKE MOCHIDA and MASAKI NAKAGAWA, Separating Figure, Mathematical Formula and Japanese Text from Free Handwriting In Mixed Online Documents. International Journal of Pattern Recognition and Artificial Intelligence Vol. 18, No. 7, 2004, pp.1173--1187.
• 8: Koffka, K., Perception: An introduction to Gestalt-theorie. Psychological Bulletin, 19: pp. 531--585.
• 9: L. O'Gorman, The Document Spectrum for Page Layout Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.15 n.11, p.1162-1173, November 1993 [doi>10.1109/34.244677]
• 10: Li, Y., Guan, Z.,Wang, H., Dai, G., and Ren, X. Structuralizing Freeform Notes by Implicit Sketch Understanding, In AAAI 2002 Spring Symposium on Sketch Understanding, AAAI TR.SS-02-08.
• 11: Line Detection and Segmentation in Historical Church Registers, Proceedings of the Sixth International Conference on Document Analysis and Recognition, p.743, September 10-13, 2001
• 12: Martin Wattenberg and Danyel Fisher. A Model of Multi-Scale Perceptual Organization in Information Graphics. In Proceedings of IEEE Symposium on Information Visualization, October 2003.
• 13: Thomas P. Moran , Patrick Chiu , William van Melle , Gordon Kurtenbach, Implicit structure for pen-based systems within a freeform interaction paradigm, Proceedings of the SIGCHI conference on Human factors in computing systems, p.487-494, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223970]
• 14: Pu Y. and Shi Z., A natural learning algorithm based on Hough transform for text lines extraction in handwritten documents, In Proceedings 6th IWFHR 1998, pp. 637--646.
• 15: Eric Saund , Thomas P. Moran, A perceptually-supported sketch editor, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.175-184, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192494]
• 16: Eric Saund , David Fleet , Daniel Larner , James Mahoney, Perceptually-supported image editing of text and graphics, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.183-192, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964717]
• 17: Saund, E., Mahoney, J., Fleet, D., Larner, D., and Lank, E., Perceptual Organization as a Foundation for Intelligent Sketch Editing, 2002 AAAI Spring Symposium on Sketch Understanding, pp. 118--125.
• 18: Seong-Whan Lee , Dae-Seok Ryu, Parameter-Free Geometric Document Layout Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.11, p.1240-1256, November 2001 [doi>10.1109/34.969115]
• 19: U. Pal, S. Sinha and B. B. Chaudhuri, Multi-Oriented Text lines Detection and Their Skew Estimation, Lecture Notes in Computer Science, Volume 2749 2003, Chapter: pp. 1146--1153.
• 20: Zhixin Shi , Venu Govindaraju, Skew Detection for Complex Document Images Using Fuzzy Runlength, Proceedings of the Seventh International Conference on Document Analysis and Recognition, p.715, August 03-06, 2003

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.6 Segmentation
          Subjects: Region growing, partitioning

General Terms:
Algorithms, Design, Human Factors

Keywords:
digital ink, selection gesture, structuralizing, text line extraction, text/graph separation