Moving markup: repositioning freeform annotations

ABSTRACT

Freeform digital ink annotation allows readers to interact with documents in an intuitive and familiar manner. Such marks are easy to manage on static documents, and provide a familiar annotation experience. In this paper, we describe an implementation of a freeform annotation system that accommodates dynamic document layout. The algorithm preserves the correct position of annotations when documents are viewed with different fonts or font sizes, with different aspect ratios, or on different devices. We explore a range of heuristics and algorithms required to handle common types of annotation, and conclude with a discussion of possible extensions to handle special kinds of annotations and changes to documents.

REFERENCES

• 1: Annette Adler , Anuj Gujar , Beverly L. Harrison , Kenton O'Hara , Abigail Sellen, A diary study of work-related reading: design implications for digital reading devices, Proceedings of the SIGCHI conference on Human factors in computing systems, p.241-248, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274679]
• 2: Adobe press release. Available on the web at http://www.adobe.com/aboutadobe/pressroom/pressreleases/200104/20010410umbrella.html
• 3: A. J. Bernheim Brush , David Bargeron , Anoop Gupta , J. J. Cadiz, Robust annotation positioning in digital documents, Proceedings of the SIGCHI conference on Human factors in computing systems, p.285-292, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365117]
• 4: Bay-Wei Chang , Jock D. Mackinlay , Polle T. Zellweger , Takeo Igarashi, A negotiation architecture for fluid documents, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.123-132, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288585]
• 5: Patrick Chiu , Lynn Wilcox, A dynamic grouping technique for ink and audio notes, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.195-202, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288605]
• 6: Levine, S.R. and S.F. Ehrlich, The Freestyle System: A Design Perspective. Human-Machine Interactive Systems, ed. A. Klinger. Plenum. pp. 3-21, 1991.
• 7: Magellan software. Available at htpp://www.bcl.com
• 8: Catherine C. Marshall, Toward an ecology of hypertext annotation, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.40-49, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276632]
• 9: Marshall, C.C., Price, M.N., Golovchinsky, G., Schilit B.N. Collaborating over Portable Reading Appliances. In Personal Technologies, Vol. 3, No. 1, 1999.
• 10: Catherine C. Marshall , Morgan N. Price , Gene Golovchinsky , Bill N. Schilit, Designing e-books for legal research, Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries, p.41-48, January 2001, Roanoke, Virginia, United States [doi>10.1145/379437.379445]
• 11: Thomas A. Phelps , Robert Wilensky, Robust intra-document locations, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.105-118, June 2000, Amsterdam, The Netherlands
• 12: Morgan N. Price , Gene Golovchinsky , Bill N. Schilit, Linking by inking: trailblazing in a paper-like hypertext, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.30-39, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276631]
• 13: Bill N. Schilit , Gene Golovchinsky , Morgan N. Price, Beyond paper: supporting active reading with free form digital ink annotations, Proceedings of the SIGCHI conference on Human factors in computing systems, p.249-256, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274680]
• 14: Bill N. Schilit , Morgan N. Price , Gene Golovchinsky, Digital library information appliances, Proceedings of the third ACM conference on Digital libraries, p.217-226, June 23-26, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276675.276700]
• 15: Raggett, D. Clean up your Web pages with HTML TIDY. (August 2000) Software available on the web at http://www.w3.org/People/Raggett/tidy/
• 16: W3C Recommendation. Document Object Model Level 1 Specification. Available on the web at http://www.w3.org/TR/1998/REC-DOM-Level-1-19981001/
• 17: W3C Working Draft. XML Pointer Language (XPointer) Version 1.0. Available on the web at http://www.w3.org/TR/2001/WD-xptr-20010108/

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Markup languages

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Screen design (e.g., text, graphics, color)
      H.5.4 Hypertext/Hypermedia
          Subjects: User issues

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Text analysis
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Text processing
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Format and notation

General Terms:
Documentation, Experimentation, Human Factors

Keywords:
annotation, dynamic document layout, freeform digital ink, repositioning annotations