Reflowing digital ink annotations

ABSTRACT

Annotating paper documents with a pen is a familiar and indispensable activity across a wide variety of work and educational settings. Recent developments in pen-based computing promise to bring this experience to digital documents. However, digital documents are more flexible than their paper counterparts. When a digital document is edited, or displayed on different devices, its layout adapts to the new situation. Freeform digital ink annotations made on such a document must likewise adapt, or "reflow." But their unconstrained nature yields only vague guidelines for how these annotations should be transformed. Few systems have considered this issue, and still fewer have addressed it from a user's point of view. This paper reports the results of a study of user expectations for reflowing digital ink annotations. We explore user reaction to reflow in common cases, how sensitive users are to reflow errors, and how important it is that personal style survive reflow. Our findings can help designers and system builders support freeform annotation more effectively.

REFERENCES

• 1: aha! InkWriter Handbook. Microsoft Corp, aha! Software, Mountain View, CA, 1993
• 2: James Arvo , Kevin Novins, Fluid sketches: continuous recognition and morphing of simple hand-drawn shapes, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.73-80, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354413]
• 3: A. J. Bernheim Brush , David Bargeron , Anoop Gupta , J. J. Cadiz, Robust annotation positioning in digital documents, Proceedings of the SIGCHI conference on Human factors in computing systems, p.285-292, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365117]
• 4: Adam Finkelstein , David H. Salesin, Multiresolution curves, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.261-268, July 1994 [doi>10.1145/192161.192223]
• 5: Gene Golovchinsky , Laurent Denoue, Moving markup: repositioning freeform annotations, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571989]
• 6: Mark D. Gross , Ellen Yi-Luen Do, Ambiguous intentions: a paper-like interface for creative design, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.183-192, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237119]
• 7: Aaron Hertzmann , Nuria Oliver , Brian Curless , Steven M. Seitz, Curve analogies, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 8: Jason I. Hong , James A. Landay, SATIN: a toolkit for informal ink-based applications, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.63-72, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354412]
• 9: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 10: James A. Landay , Brad A. Myers, Sketching Interfaces: Toward More Human Interface Design, Computer, v.34 n.3, p.56-64, March 2001
• 11: Lin, J., Newman, M.W., Hong, J.I., and Landay, J.A, DENIM: Finding a Tighter Fit Between Tools and Practice for Web Site Design. CHI Letters: Human Factors in Computing Systems: CHI '99, 1999, p. 576--583.
• 12: Catherine C. Marshall , A.J. Bernheim Brush, From personal to shared annotations, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506610]
• 13: Thomas A. Phelps , Robert Wilensky, Robust intra-document locations, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.105-118, June 2000, Amsterdam, The Netherlands
• 14: Réjean Plamondon , Sargur N. Srihari, On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.1, p.63-84, January 2000 [doi>10.1109/34.824821]
• 15: Dean Rubine, Specifying gestures by example, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.329-337, July 1991
• 16: Bill N. Schilit , Gene Golovchinsky , Morgan N. Price, Beyond paper: supporting active reading with free form digital ink annotations, Proceedings of the SIGCHI conference on Human factors in computing systems, p.249-256, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274680]
• 17: Richard Zanibbi , Kevin Novins , James Arvo , Katherine Zanibbi, Aiding manipulation of handwritten mathematical expressions through style-preserving morphs, No description on Graphics interface 2001, p.127-134, June 07-09, 2001, Ottawa, Ontario, Canada
• 18: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing; Software psychology; Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design; Interaction styles (e.g., commands, menus, forms, direct manipulation)

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.1 Models
          Subjects: Structural; Statistical; Geometric
      I.5.5 Implementation
          Subjects: Interactive systems

General Terms:
Algorithms, Design, Human Factors

Keywords:
annotation, annotation system design, context, digital ink, documents, handwriting recognition, reflow