Inky: a sloppy command line for the web with rich visual feedback

ABSTRACT

We present Inky, a command line for shortcut access to common web tasks. Inky aims to capture the efficiency benefits of typed commands while mitigating their usability problems. Inky commands have little or no new syntax to learn, and the system displays rich visual feedback while the user is typing, including missing parameters and contextual information automatically clipped from the target web site. Inky is an example of a new kind of hybrid between a command line and a GUI interface. We describe the design and implementation of two prototypes of this idea, and report the results of a preliminary user study.

REFERENCES

• 1: Michael Bernstein , Max Van Kleek , David Karger , M. C. Schraefel, Information scraps: How and why information eludes our personal information management tools, ACM Transactions on Information Systems (TOIS), v.26 n.4, p.1-46, September 2008 [doi>10.1145/1402256.1402263]
• 2: Michael Bolin , Matthew Webber , Philip Rha , Tom Wilson , Robert C. Miller, Automation and customization of rendered web pages, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095062]
• 3: Chris DiGiano , Mike Eisenberg, Self-disclosing design tools: a gentle introduction to end-user programming, Proceedings of the 1st conference on Designing interactive systems: processes, practices, methods, & techniques, p.189-197, August 23-25, 1995, Ann Arbor, Michigan, United States [doi>10.1145/225434.225455]
• 4: Enso. http://www.humanized.com. Accessed July 8, 2008.
• 5: Fishy. http://www.fishshell.org. Accessed July 8, 2008.
• 6: G. W. Furnas , T. K. Landauer , L. M. Gomez , S. T. Dumais, The vocabulary problem in human-system communication, Communications of the ACM, v.30 n.11, p.964-971, Nov. 1987 [doi>10.1145/32206.32212]
• 7: Google Search Features. http://www.google.com/intl/en/help/features.html. Accessed July 8, 2008.
• 8: Saul Greenberg , Michael Boyle, Generating custom notification histories by tracking visual differences between web page visits, Proceedings of Graphics Interface 2006, June 07-09, 2006, Quebec, Canada
• 9: Tovi Grossman , Pierre Dragicevic , Ravin Balakrishnan, Strategies for accelerating on-line learning of hotkeys, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240865]
• 10: Darris Hupp , Robert C. Miller, Smart bookmarks: automatic retroactive macro recording on the web, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294226]
• 11: Greg Little , Tessa A. Lau , Allen Cypher , James Lin , Eben M. Haber , Eser Kandogan, Koala: capture, share, automate, personalize business processes on the web, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240767]
• 12: Greg Little , Robert C. Miller, Translating keyword commands into executable code, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166275]
• 13: Greg Little , Robert C. Miller, Keyword programming in java, Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering, November 05-09, 2007, Atlanta, Georgia, USA [doi>10.1145/1321631.1321646]
• 14: Robert C. Miller , Brad A. Myers, Integrating a command shell into a web browser, Proceedings of the annual conference on USENIX Annual Technical Conference, p.15-15, June 18-23, 2000, San Diego, California
• 15: Quick Add: the faster way to create events. http://www.google.com/support/calendar/bin/answer.py?hl=en&answer=36604#text. Accessed July 8, 2008.
• 16: Quicksilver. http://www.blacktree.com. Accessed July 8, 2008.
• 17: Safari Features. http://www.apple.com/macosx/features/ safari.html. Accessed July 8, 2008.
• 18: Ben Shneiderman, Designing the user interface (videotape), University of Maryland at College Park, College Park, MD, 1987
• 19: Thad E. Starner , Cornelis M. Snoeck , Benjamin A. Wong , R. Martin McGuire, Use of mobile appointment scheduling devices, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986100]
• 20: Desney S. Tan , Brian Meyers , Mary Czerwinski, WinCuts: manipulating arbitrary window regions for more effective use of screen space, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986106]
• 21: Max Van Kleek , Michael Bernstein , David R. Karger , mc schraefel, Gui --- phooey!: the case for text input, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294247]
• 22: XMLterm. http://www.xmlterm.org. Accessed July 8, 2008.
• 23: Yahoo User Interface Library. http://developer.yahoo.com/yui. Accessed July 8, 2008.
• 24: YubNub. http://yubnub.org. Accessed July 8, 2008.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Algorithms, Design, Human Factors, Languages

Keywords:
command languages, natural language processing, web automation