InkSeine: In Situ search for active note taking

ABSTRACT

Using a notebook to sketch designs, reflect on a topic, or capture and extend creative ideas are examples of active note taking tasks. Optimal experience for such tasks demands concentration without interruption. Yet active note taking may also require reference documents or emails from team members. InkSeine is a Tablet PC application that supports active note taking by coupling a pen-and-ink interface with an in situ search facility that flows directly from a user's ink notes (Fig. 1). InkSeine integrates four key concepts: it leverages preexisting ink to initiate a search; it provides tight coupling of search queries with application content; it persists search queries as first class objects that can be commingled with ink notes; and it enables a quick and flexible workflow where the user may freely interleave inking, searching, and gathering content. InkSeine offers these capabilities in an interface that is tailored to the unique demands of pen input, and that maintains the primacy of inking above all other tasks.

REFERENCES

• 1: Anand Agarawala , Ravin Balakrishnan, Keepin' it real: pushing the desktop metaphor with physics, piles and the pen, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124965]
• 2: Georg Apitz , François Guimbretière, CrossY: a crossing-based drawing application, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029635]
• 3: Benjamin B. Bederson, Interfaces for staying in the flow, Ubiquity, v.5 n.27, p.1-1, September 1 - September 7, 2004 [doi>10.1145/1074068.1074069]
• 4: Buxton, B., Designing User Experiences: Getting the Design Right and the Right Design. 2007: In press.
• 5: Robert K. Carr , Dan Shafer, The Power of PenPoint, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1991
• 6: Csikszentmihalyi, M., Flow: The Psychology of Optimal Experience. 1991: HarperCollins.
• 7: Edward Cutrell , Daniel Robbins , Susan Dumais , Raman Sarin, Fast, flexible filtering with phlat, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124812]
• 8: Richard C. Davis , James A. Landay , Victor Chen , Jonathan Huang , Rebecca B. Lee , Frances C. Li , James Lin , Charles B. Morrey, III , Ben Schleimer , Morgan N. Price , Bill N. Schilit, NotePals: lightweight note sharing by the group, for the group, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.338-345, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303107]
• 9: George Fitzmaurice , Azam Khan , Robert Pieké , Bill Buxton , Gordon Kurtenbach, Tracking menus, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.71-79, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964704]
• 10: George W. Furnas , Samuel J. Rauch, Considerations for information environments and the NaviQue workspace, Proceedings of the third ACM conference on Digital libraries, p.79-88, June 23-26, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276675.276684]
• 11: Gene Golovchinsky , Morgan N. Price , Bill N. Schilit, From reading to retrieval: freeform ink annotations as queries, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.19-25, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312637]
• 12: David G. Hendry , David J. Harper, An informal information-seeking environment, Journal of the American Society for Information Science, v.48 n.11, p.1036-1048, Nov. 1997 [doi>10.1002/(SICI)1097-4571(199711)48:11<1036::AID-ASI6>3.3.CO;2-E]
• 13: Ken Hinckley , Patrick Baudisch , Gonzalo Ramos , Francois Guimbretiere, Design and analysis of delimiters for selection-action pen gesture phrases in scriboli, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055035]
• 14: William P. Jones , Susan T. Dumais, The spatial metaphor for user interfaces: experimental tests of reference by location versus name, ACM Transactions on Information Systems (TOIS), v.4 n.1, p.42-63, Jan. 1986 [doi>10.1145/5401.5405]
• 15: David Kirsh, The intelligent use of space, Artificial Intelligence, v.73 n.1-2, p.31-68, Feb. 1995 [doi>10.1016/0004-3702(94)00017-U]
• 16: Gordon Kurtenbach , William Buxton, Issues in combining marking and direct manipulation techniques, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.137-144, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120797]
• 17: Kurtenbach, G., Moran, T., Buxton, W. Contextual Animation of Gestural Commands. Proc. Graphics Interface'94, 83--90.
• 18: Yang Li , Ken Hinckley , Zhiwei Guan , James A. Landay, Experimental analysis of mode switching techniques in pen-based user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055036]
• 19: Sachi Mizobuchi , Michiaki Yasumura, Tapping vs. circling selections on pen-based devices: evidence for different performance-shaping factors, Proceedings of the SIGCHI conference on Human factors in computing systems, p.607-614, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985769]
• 20: Thomas P. Moran , Patrick Chiu , William van Melle, Pen-based interaction techniques for organizing material on an electronic whiteboard, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.45-54, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263508]
• 21: Tomer Moscovich , John F. Hughes, Navigating documents with the virtual scroll ring, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029642]
• 22: Elizabeth D. Mynatt , Takeo Igarashi , W. Keith Edwards , Anthony LaMarca, Flatland: new dimensions in office whiteboards, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.346-353, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303108]
• 23: Morgan N. Price , Gene Golovchinsky , Bill N. Schilit, Linking by inking: trailblazing in a paper-like hypertext, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.30-39, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276631]
• 24: Ramana Rao , Stuart K. Card , Herbert D. Jellinek , Jock D. Mackinlay , George G. Robertson, The information grid: a framework for information retrieval and retrieval-centered applications, Proceedings of the 5th annual ACM symposium on User interface software and technology, p.23-32, November 15-18, 1992, Monteray, California, United States [doi>10.1145/142621.142625]
• 25: George Robertson , Mary Czerwinski , Kevin Larson , Daniel C. Robbins , David Thiel , Maarten van Dantzich, Data mountain: using spatial memory for document management, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.153-162, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288596]
• 26: Daniel M. Russell , Mark J. Stefik , Peter Pirolli , Stuart K. Card, The cost structure of sensemaking, Proceedings of the INTERCHI '93 conference on Human factors in computing systems, p.269-276, May 1993, Amsterdam, The Netherlands
• 27: Bill N. Schilit , Gene Golovchinsky , Morgan N. Price, Beyond paper: supporting active reading with free form digital ink annotations, Proceedings of the SIGCHI conference on Human factors in computing systems, p.249-256, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274680]
• 28: Michael Shilman , Desney S. Tan , Patrice Simard, CueTIP: a mixed-initiative interface for correcting handwriting errors, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166304]
• 29: Lisa Stifelman , Barry Arons , Chris Schmandt, The audio notebook: paper and pen interaction with structured speech, Proceedings of the SIGCHI conference on Human factors in computing systems, p.182-189, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365096]
• 30: Lynn D. Wilcox , Bill N. Schilit , Nitin Sawhney, Dynomite: a dynamically organized ink and audio notebook, Proceedings of the SIGCHI conference on Human factors in computing systems, p.186-193, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258700]
• 31: Yahoo! Messenger, http://messenger.yahoo.com/feat_search.php.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Human Factors

Keywords:
gestures, handwriting, ink, input, pen, search, tablet