|
ABSTRACT
This article introduces a new interaction model called Instrumental Interaction that extends and generalizes the principles of direct manipulation. It covers existing interaction styles, including traditional WIMP interfaces, as well as new interaction styles such as two-handed input and augmented reality. It defines a design space for new interaction techniques and a set of properties for comparing them. Instrumental Interaction describes graphical user interfaces in terms of domain objects and interaction instruments. Interaction between users and domain objects is mediated by interaction instruments, similar to the tools and instruments we use in the real world to interact with physical objects. The article presents the model, applies it to describe and compare a number of interaction techniques, and shows how it was used to create a new interface for searching and replacing text.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
 |
1
|
Christopher Ahlberg , Christopher Williamson , Ben Shneiderman, Dynamic queries for information exploration: an implementation and evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.619-626, May 03-07, 1992, Monterey, California, United States
[doi> 10.1145/142750.143054]
|
| |
2
|
|
 |
3
|
|
 |
4
|
Benjamin B. Bederson , James D. Hollan , Allison Druin , Jason Stewart , David Rogers , David Proft, Local tools: an alternative to tool palettes, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.169-170, November 06-08, 1996, Seattle, Washington, United States
[doi> 10.1145/237091.237116]
|
 |
5
|
|
| |
6
|
|
 |
7
|
|
| |
8
|
|
 |
9
|
Stuart K. Card , George G. Robertson , Jock D. Mackinlay, The information visualizer, an information workspace, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.181-186, April 27-May 02, 1991, New Orleans, Louisiana, United States
[doi> 10.1145/108844.108874]
|
| |
10
|
George W. Fitzmaurice , Hiroshi Ishii , William A. S. Buxton, Bricks: laying the foundations for graspable user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.442-449, May 07-11, 1995, Denver, Colorado, United States
[doi> 10.1145/223904.223964]
|
| |
11
|
|
| |
12
|
|
| |
13
|
Guiard, Y. Asymmetric division of labor in human skilled bimanual action' The kinematic chain as a model. Journal of Motor Behavior, 19:486-517, 1987.
|
| |
14
|
|
 |
15
|
|
| |
16
|
|
 |
17
|
|
| |
18
|
|
 |
19
|
|
 |
20
|
Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, The design of a GUI paradigm based on tablets, two-hands, and transparency, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-42, March 22-27, 1997, Atlanta, Georgia, United States
[doi> 10.1145/258549.258574]
|
 |
21
|
Gordon Kurtenbach , George W. Fitzmaurice , Russell N. Owen , Thomas Baudel, The Hotbox: efficient access to a large number of menu-items, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.231-237, May 15-20, 1999, Pittsburgh, Pennsylvania, United States
[doi> 10.1145/302979.303047]
|
| |
22
|
Michotte, A. La perception de la causalitd. Publications Universitaires de Louvain, 1946.
|
 |
23
|
|
 |
24
|
|
 |
25
|
|
| |
26
|
Shneiderman, B. Direct Manipulation : a Step Beyond Programming Languages. 1EEE Computer, 16(8), pp 57-69, 1983.
|
| |
27
|
Smith, D., Irby, C., Kimball, R., Verplank, B., Harslem E. Designing the Star User Interface. Byte, 7(4), p.242:282, 1982.
|
 |
28
|
|
 |
29
|
|
| |
30
|
Wellner, P., Mackay, M., Gold R. Computer- Augmented Environments. Special lssue of Communications of the ACM, 23(7).
|
CITED BY 65
|
|
George Fitzmaurice , Justin Matejka , Azam Khan , Mike Glueck , Gordon Kurtenbach, PieCursor: merging pointing and command selection for rapid in-place tool switching, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy
|
|
|
Wendy E. Mackay , Anne V. Ratzer , Paul Janecek, Video artifacts for design: bridging the Gap between abstraction and detail, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.72-82, August 17-19, 2000, New York City, New York, United States
|
|
|
Michel Beaudouin-Lafon , Henry Michael Lassen, The architecture and implementation of CPN2000, a post-WIMP graphical application, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.181-190, November 06-08, 2000, San Diego, California, United States
|
|
|
|
|
|
Yasuhiro Yamamoto , Kumiyo Nakakoji , Yoshiyuki Nishinaka , Mitsuhiro Asada , Ryouichi Matsuda, What is the space for?: the role of space in authoring hypertext representations, Proceedings of the sixteenth ACM conference on Hypertext and hypermedia, September 06-09, 2005, Salzburg, Austria
|
|
|
|
|
|
|
|
|
Michel Beaudouin Lafon , Wendy E. Mackay , Peter Andersen , Paul Janecek , Mads Jensen , Michael Lassen , Kasper Lund , Kjeld Mortensen , Stephanie Munck , Katrine Ravn , Anne Ratzer , Søren Christensen , Kurt Jensen, CPN/tools: revisiting the desktop metaphor with post-WIMP interaction techniques, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington
|
|
|
|
|
|
|
|
|
|
|
|
Stéphane Huot , Cédric Dumas , Pierre Dragicevic , Jean-Daniel Fekete , Gérard Hégron, The MaggLite post-WIMP toolkit: draw it, connect it and run it, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Rafael Ballagas , Meredith Ringel , Maureen Stone , Jan Borchers, iStuff: a physical user interface toolkit for ubiquitous computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Nicolas Plouznikoff , Alexandre Plouznikoff , Michel Desmarais , Jean-Marc Robert, Support mobile à la tâche: médiation utilisateur - monde réel par l'intermédiaire d'un ordinateur porté, Proceedings of the 18th international conference on Association Francophone d'Interaction Homme-Machine, p.107-114, April 18-21, 2006, Montreal, Canada
|
|
|
|
|
|
David Novick , Francisco Romero , Edgar Rene Saenz , Armando Sandoval, Extending direct manipulation in a text editor, Proceedings of the 20th annual international conference on Computer documentation, p.127-132, October 20-23, 2002, Toronto, Ontario, Canada
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Robert Jacob , Audrey Girouard , Leanne M. Hirshfield , Michael Horn , Orit Shaer , Erin Treacy Solovey , Jamie Zigelbaum, CHI2006: what is the next generation of human-computer interaction?, interactions, v.14 n.3, May + June 2007
|
|
|
|
|
|
Olav W. Bertelsen , Morten Breinbjerg , Søren Pold, Instrumentness for creativity mediation, materiality & metonymy, Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition, June 13-15, 2007, Washington, DC, USA
|
|
|
Robert J. K. Jacob , Audrey Girouard , Leanne M. Hirshfield , Michael S. Horn , Orit Shaer , Erin Treacy Solovey , Jamie Zigelbaum, Reality-based interaction: unifying the new generation of interaction styles, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA
|
|
|
|
|
|
|
|
|
Ehud Sharlin , Benjamin Watson , Yoshifumi Kitamura , Fumio Kishino , Yuichi Itoh, On tangible user interfaces, humans and spatiality, Personal and Ubiquitous Computing, v.8 n.5, p.338-346, September 2004
|
|
|
|
|
|
|
|
|
Robert J.K. Jacob , Audrey Girouard , Leanne M. Hirshfield , Michael S. Horn , Orit Shaer , Erin Treacy Solovey , Jamie Zigelbaum, Reality-based interaction: a framework for post-WIMP interfaces, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy
|
|
|
|
|
|
|
|
|
Pierre Dragicevic , Gonzalo Ramos , Jacobo Bibliowitcz , Derek Nowrouzezahrai , Ravin Balakrishnan , Karan Singh, Video browsing by direct manipulation, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Jason Alexander , Andy Cockburn , Stephen Fitchett , Carl Gutwin , Saul Greenberg, Revisiting read wear: analysis, design, and evaluation of a footprints scrollbar, Proceedings of the 27th international conference on Human factors in computing systems, April 04-09, 2009, Boston, MA, USA
|
|
|
|
|