Designing interaction, not interfaces

ABSTRACT

Although the power of personal computers has increased 1000-fold over the past 20 years, user interfaces remain essentially the same. Innovations in HCI research, particularly novel interaction techniques, are rarely incorporated into products. In this paper I argue that the only way to significantly improve user interfaces is to shift the research focus from designing interfaces to designing interaction. This requires powerful interaction models, a better understanding of both the sensory-motor details of interaction and a broader view of interaction in the context of use. It also requires novel interaction architectures that address reinterpretability, resilience and scalability.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.295-302, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258760]
• 2: Appert, C., Beaudouin-Lafon, M. & Mackay, W. E. (2003). Context matters: Evaluating Interaction Techniques with the CIS Model. Technical report 1372, Laboratoire de Recherche en Informatique, Université Paris-Sud, France.
• 3: Apple Computer Inc., MacIntosh Human Interface Guidelines, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992
• 4: Michel Beaudouin-Lafon, Instrumental interaction: an interaction model for designing post-WIMP user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.446-453, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332473]
• 5: Michel Beaudouin-Lafon , Henry Michael Lassen, The architecture and implementation of CPN2000, a post-WIMP graphical application, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.181-190, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354761]
• 6: Michel Beaudouin-Lafon , Wendy E. Mackay, Reification, polymorphism and reuse: three principles for designing visual interfaces, Proceedings of the working conference on Advanced visual interfaces, p.102-109, May 2000, Palermo, Italy [doi>10.1145/345513.345267]
• 7: Michel Beaudouin-Lafon , Wendy Mackay, Prototyping tools and techniques, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
• 8: Beaudoux, O. & Beaudouin-Lafon, M. (2001). DPI: A Conceptual Model Based on Documents and Interaction Instruments. People and Computer XV - Interaction without frontier (Joint proceedings of HCI 2001 and IHM 2001). Spring Verlag. pp. 247--263.
• 9: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, September 1993 [doi>10.1145/166117.166126]
• 10: Renaud Blanch, Programmer I'interaction avec des machines à états hiérarchiques, Proceedings of the 14th French-speaking conference on Human-computer interaction (Conférence Francophone sur l'Interaction Homme-Machine), p.129-136, November 26-29, 2002, Poitiers, France [doi>10.1145/777005.777023]
• 11: Renaud Blanch , Yves Guiard , Michel Beaudouin-Lafon, Semantic pointing: improving target acquisition with control-display ratio adaptation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.519-526, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985758]
• 12: Bregman, A. S. (1990). Auditory Scene Analysis: The Perceptual Organization of Sound. MIT Press.
• 13: J. Callahan , D. Hopkins , M. Weiser , B. Shneiderman, An empirical comparison of pie vs. linear menus, Proceedings of the SIGCHI conference on Human factors in computing systems, p.95-100, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57182]
• 14: Stuart K. Card , Jock D. Mackinlay , Ben Shneiderman, Readings in information visualization: using vision to think, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 15: Dragicevic, P. & Fekete J. D. (2001). Input Device Selection and Interaction Configuration with ICON. People and Computer XV - Interaction without frontier (Joint proceedings of HCI 2001 and IHM 2001). Spring Verlag. pp. 543--558.
• 16: Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47, 381--391.
• 17: Gibson, J. J. (1979). The Ecological Approach to Visual Perception. Boston: Houghton Mifflin.
• 18: Joan Greenbaum , Morten Kyng, Design at work: cooperative design of computer systems, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1992
• 19: Guiard, Y., Bourgeois, F., Mottet, D., & Beaudouin-Lafon, M. (2001). Beyond the 10-bit barrier: Fitts' law in multiscale electronic worlds. People and Computer XV - Interaction without frontier (Joint proceedings of HCI 2001 and IHM 2001). Spring Verlag. pp. 573--587.
• 20: Hick, W. E. (1952). On the Rate of Gain of Information. Quarterly Journal of Experimental Psychology, (4):11--26.
• 21: Jeff Johnson , Teresa L. Roberts , William Verplank , David C. Smith , Charles H. Irby , Marian Beard , Kevin Mackey, The Xerox Star: A Retrospective, Computer, v.22 n.9, p.11-26, 28-29, September 1989 [doi>10.1109/2.35211]
• 22: Mackay, W. E. (1990). Users and Customizable Software: A Co-Adaptive Phenomenon. Ph.D. Thesis. Massachusetts Institute of Technology.
• 23: Wendy E. Mackay , Anne V. Ratzer , Paul Janecek, Video artifacts for design: bridging the Gap between abstraction and detail, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.72-82, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347666]
• 24: Mackay, W. E. (2002). Which Interaction Technique Works When? Floating Palettes, Marking Menus and Toolglasses support different task strategies. Proc. Conference on Advanced Visual Interfaces, AVI'02. ACM Press. pp. 203--208.
• 25: MacKenzie, I. S. (1992). Fitts' law as a research and design tool in human-computer interaction. Human-Computer Interaction, 7, 91--139.
• 26: Michael McGuffin , Ravin Balakrishnan, Acquisition of expanding targets, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503388]
• 27: Brad A. Myers, Separating application code from toolkits: eliminating the spaghetti of call-backs, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.211-220, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120805]
• 28: Brad A. Myers , Mary Beth Rosson, Survey on user interface programming, Proceedings of the SIGCHI conference on Human factors in computing systems, p.195-202, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142789]
• 29: Donald A. Norman, Affordance, conventions, and design, interactions, v.6 n.3, p.38-43, May/June 1999 [doi>10.1145/301153.301168]
• 30: Shneiderman, B. (1983). Direct Manipulation, a Step Beyond Programming Languages. IEEE Computer, 16(8):57--69, August 1983.
• 31: Suchman, L. A. (1987). Plans and Situated Actions. Cambridge University Press.
• 32: Jason Stewart , Benjamin B. Bederson , Allison Druin, Single display groupware: a model for co-present collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.286-293, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303064]
• 33: Michael Terry , Elizabeth D. Mynatt, Side views: persistent, on-demand previews for open-ended tasks, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571996]
• 34: Ullmer, B. & Ishii, H. (2001). Emerging Frameworks for Tangible User Interfaces. In Carrol, J. M. (ed.) Human-Computer Interaction in the New Millenium. Addison-Wesley. pp. 579--601.
• 35: Colin Ware, Information visualization: perception for design, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000
• 36: Peter Wegner, Why interaction is more powerful than algorithms, Communications of the ACM, v.40 n.5, p.80-91, May 1997 [doi>10.1145/253769.253801]
• 37: Pierre Wellner , Wendy Mackay , Rich Gold, Back to the real world, Communications of the ACM, v.36 n.7, p.24-27, July 1993 [doi>10.1145/159544.159555]
• 38: Shumin Zhai , Stéphane Conversy , Michel Beaudouin-Lafon , Yves Guiard, Human on-line response to target expansion, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642644]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.3 Applications

General Terms:
Design, Human Factors, Theory

Keywords:
design principles, instrumental interaction, interaction architecture, interaction model, interaction paradigm, situated interaction