QuickSelect: history-based selection expansion

ABSTRACT

When editing a graphical document, it is common to apply a change to multiple items at once, and a variety of tools exist for selecting sets of items. However, directly selecting large sets can sometimes be cumbersome and repetitive. We propose a method for helping users reuse complex selections by expanding the set of currently selected items. We analyze a document's operation history to determine which items have been frequently edited together. When the user requests it, items that have been previously edited with the current selection can be added to it. The new selection can then be manipulated like any other selection. This approach does not require a semantic model of the document or relations between items. Rather, each expansion is based on what the user has done so far to create the document. We demonstrate this approach in the context of vector graphics editing. Results from a pilot study were encouraging. Reusing selections with pre-existing histories, users were more efficient at editing tasks with our QuickSelect tool. Subjective preferences from a usability study in a free drawing context indicate that selection expansion is easy for users to learn and to apply.

REFERENCES

• 1: Adobe Systems. Design Center Tutorials: How do I select just one kind of object from a design? http://adobe.com/designcenter/illustrator/articles/illcs2qaarselect.html.
• 2: Michel Beaudouin-Lafon, Novel interaction techniques for overlapping windows, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502371]
• 3: Benjamin B. Bederson, Fisheye menus, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.217-225, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354782]
• 4: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, August 02-06, 1993, Anaheim, CA [doi>10.1145/166117.166126]
• 5: Leah Findlater , Joanna McGrenere, A comparison of static, adaptive, and adaptable menus, Proceedings of the SIGCHI conference on Human factors in computing systems, p.89-96, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985704]
• 6: S. Greenberg and I. Witten. Adaptive personalized interfaces: A question of viability. Behaviour & Information Technology, 4(1):31--45, 1985.
• 7: Jeffrey Heer , Maneesh Agrawala , Wesley Willett, Generalized selection via interactive query relaxation, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357203]
• 8: Inkscape. http://www.inkscape.org.
• 9: Edward W. Ishak , Steven K. Feiner, Interacting with hidden content using content-aware free-space transparency, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029666]
• 10: Robert C. Miller , Brad A. Myers, Multiple selections in smart text editing, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502734]
• 11: J. Mitchell , B. Shneiderman, Dynamic versus static menus: an exploratory comparison, ACM SIGCHI Bulletin, v.20 n.4, p.33-37, April 1989 [doi>10.1145/67243.67247]
• 12: Open Clip Art Library. http://www.openclipart.org.
• 13: P. Pirolli and S. K. Card. Information foraging. Psychological Review, 106:643--675, 1999.
• 14: Gonzalo Ramos , George Robertson , Mary Czerwinski , Desney Tan , Patrick Baudisch , Ken Hinckley , Maneesh Agrawala, Tumble! Splat! helping users access and manipulate occluded content in 2D drawings, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133351]
• 15: Alan Ritter , Sumit Basu, Learning to generalize for complex selection tasks, Proceedings of the 13th international conference on Intelligent user interfaces, February 08-11, 2009, Sanibel Island, Florida, USA [doi>10.1145/1502650.1502676]
• 16: Eric Saund , David Fleet , Daniel Larner , James Mahoney, Perceptually-supported image editing of text and graphics, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.183-192, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964717]
• 17: Martin Schwarz , Tobias Isenberg , Katherine Mason , Sheelagh Carpendale, Modeling with rendering primitives: an interactive non-photorealistic canvas, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California [doi>10.1145/1274871.1274874]
• 18: Andrew Sears , Ben Shneiderman, Split menus: effectively using selection frequency to organize menus, ACM Transactions on Computer-Human Interaction (TOCHI), v.1 n.1, p.27-51, March 1994 [doi>10.1145/174630.174632]
• 19: Christopher G. Thomas , Mette Krogsæter, An adaptive environment for the user interface of Excel, Proceedings of the 1st international conference on Intelligent user interfaces, p.123-130, January 04-07, 1993, Orlando, Florida, United States [doi>10.1145/169891.169928]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Keywords:
2D drawing, grouping, operation history, selection