Perceptual interpretation of ink annotations on line charts

ABSTRACT

Asynchronous collaborators often use freeform ink annotations to point to visually salient perceptual features of line charts such as peaks or humps, valleys, rising slopes and declining slopes. We present a set of techniques for interpreting such annotations to algorithmically identify the corresponding perceptual parts. Our approach is to first apply a parts-based segmentation algorithm that identifies the visually salient perceptual parts in the chart. Our system then analyzes the freeform annotations to infer the corresponding peaks, valleys or sloping segments. Once the system has identified the perceptual parts it can highlight them to draw further attention and reduce ambiguity of interpretation in asynchronous collaborative discussions.

REFERENCES

• 1: C. Ahlberg and B. Shneiderman. Visual information seeking: Tight coupling of dynamic query filters with starfield displays. In Proc. of CHI, pages 313--317, 1994.
• 2: D. Bargeron and T. Moscovich. Reflowing digital ink annotations. In Proc. of CHI, pages 385--393, 2003.
• 3: T. Baudel. A mark-based interaction paradigm for free-hand drawing. In Proc. of UIST, pages 185--192, 1994.
• 4: R.A. Becker and W.S. Cleveland. Brushing scatterplots. Technometrics, 29(2):127--142, 1987.
• 5: H.H. Clark and S.E. Brennan. Grounding in communication, chapter 7. Perspectives on socially shared cognition. APA Books, 1991.
• 6: H. Dehmeshki and W. Stuerzlinger. Intelligent Mouse-Based Object Group Selection. In Proc. of Smart Graphics, pages 33--44. Springer, 2008.
• 7: J. Heer, M. Agrawala, and W. Willett. Generalized selection via interactive query relaxation. In Proc. of CHI, pages 959--968, 2008.
• 8: J. Heer, F.B. Viégas, and M. Wattenberg. Voyagers and voyeurs: Supporting asynchronous collaborative information visualization. In Proc. of CHI, pages 1029--1038, 2007.
• 9: W.C. Hill and J.D. Hollan. Deixis and the future of visualization excellence. In Proc. of IEEE Visualization, pages 314--320, 431, 1991.
• 10: H. Hochheiser and B. Shneiderman. Dynamic query tools for time series data sets: timebox widgets for interactive exploration. Information Visualization, 3(1):1--18, 2004.
• 11: D.D. Hoffman and M. Singh. Salience of visual parts. Cognition, 63:29--78, 1997.
• 12: A.R. Martin and M.O. Ward. High dimensional brushing for interactive exploration of multivariate data. In Proc. of IEEE Visualization, page 271, 1995.
• 13: E. Saund and T.P. Moran. A perceptually-supported sketch editor. In Proc. of UIST, pages 175--184, 1994.
• 14: F.B. Viegas, M. Wattenberg, F. van Ham, J. Kriss, and M. McKeon. Manyeyes: A site for visualization at internet scale. IEEE Trans. on Vis. and Comp. Graphics, 13(6):1121--1128, 2007.
• 15: N. Watanabe, M. Washida, and T. Igarashi. Bubble clusters: An interface for manipulating spatial aggregation of graphical objects. In Proc. of UIST, pages 173--182, 2007.
• 16: M. Wattenberg. Sketching a graph to query a time-series database. In CHI Extended abstracts, pages 381--382, 2001.
• 17: M. Wertheimer. Laws of organization in perceptual forms. A source book of Gestalt psychology, pages 71--88, 1938.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Human Factors

Keywords:
deixis, freeform ink annotation, line charts, pointing, selection, visual perception, visualization