Characterizing tool use in an interactive drawing environment

ABSTRACT

The metaphor of tool use for describing the interaction between a human and a computer is pervasive in user interface design. The basic concept of tool use, however, is difficult to define precisely, for HCI purposes or in general. In this paper we argue that a close examination of physical tool use can improve the design of interactive software. We describe a drawing application, HabilisDraw, that incorporates some of the properties we associate with physical tools but are not commonly found in software: persistent tool objects that encapsulate behavior and information, that can be used in conjunction with one another, and that embody rich cues about their appropriate usage. Initial results from formative evaluation suggest that the approach has some promise.

REFERENCES

• 1: P. Agre and I. Horswill. Lifeworld analysis. Journal of Artificial Intelligence Research, 6:111-145, 1997.
• 2: B. B. Beck. Animal Tool Behavior: The Use and Manufacture of Tools. Garland Press, New York, NY, 1980.
• 3: Benjamin B. Bederson , James D. Hollan , Allison Druin , Jason Stewart , David Rogers , David Proft, Local tools: an alternative to tool palettes, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.169-170, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237116]
• 4: D. Chapman. Intermediate vision: Architecture, implementation, and use. Cognitive Science, 16(4):491-537, 1992.
• 5: Allen Cypher, Eager: programming repetitive tasks by demonstration, Watch what I do: programming by demonstration, MIT Press, Cambridge, MA, 1993
• 6: G. Fischer. Turning breakdowns into opportunities for creativity. Knowledge-Based Systems, 7(4):221-232, 1994.
• 7: Don Gentner , Jakob Nielsen, The Anti-Mac interface, Communications of the ACM, v.39 n.8, p.70-82, Aug. 1996 [doi>10.1145/232014.232032]
• 8: Saul Greenberg, The computer user as toolsmith: the use, reuse, and organization of computer-based tools, Cambridge University Press, New York, NY, 1993
• 9: E. Hutchins. Metaphors for interface design. In M. M. Taylor, F. Neel, and D. G. Bouwhuis, editors, The Structure of Multimodal Dialogue, pages 11-28. North-Holland, Elsevier Science Publishers, Amsterdam, 1989.
• 10: E. Hutchins. Cognition in the Wild. MIT Press, Cambridge, MA, 1995.
• 11: E. J. Ingmanson. Tool-using behavior in wild pan paniscus: Social and ecological considerations. In A. E. Russon, K. A. Bard, and S. T. Parker, editors, Reaching into Thought: The minds of the great apes, chapter 9, pages 190-210. Cambridge University Press, Cambridge, UK, 1996.
• 12: C. M. Keller and J. D. Keller. Cognition and tool use: The blacksmith at work. Cambridge University Press, Cambridge, UK, 1996.
• 13: David Kirsh, The intelligent use of space, Artificial Intelligence, v.73 n.1-2, p.31-68, Feb. 1995 [doi>10.1016/0004-3702(94)00017-U]
• 14: Your wish is my command: programming by example, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2001
• 15: Malcolm McCullough, Abstracting Craft: The Practiced Digital Hand, MIT Press, Cambridge, MA, 1996
• 16: W. C. McGrew. The intelligent use of tools: Twenty propositions. In K. R. Gibson and T. Ingold, editors, Tools, language, and cognition in human evolution, pages 151-170. Cambridge University Press, Cambridge, UK, 1993.
• 17: Donald A. Norman, Cognitive artifacts, Designing interaction: psychology at the human-computer interface, Cambridge University Press, New York, NY, 1991
• 18: D. Povinelli, editor. Folk Physics for Apes. Oxford University Press, NY, 2000.
• 19: B. Preston. Cognition and tool use. Mind and Language, 13(4):513-547, December 1998.
• 20: Roope Raisamo, An alternative way of drawing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.175-182, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303035]
• 21: Mark O. Riedl , Robert St. Amant, Toward automated exploration of interactive systems, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502738]
• 22: G. R. Semin. Cognition, language, and communication. In S. R. Fussell and R. J. Kreuz, editors, Social and Cognitive Approaches to Interpersonal Communication, pages 229-258. Lawrence Erlbaum, Mahwah, NJ, 1998.
• 23: A. W. Smitsman. The development of tool use: Changing boundaries between organism and environment. In C. Dent-Read and P. Zukow-Goldring, editors, Evolving explanations of development: Ecological approaches to organism-environment systems. American Psychological Association, Washington DC, 1997.
• 24: R. St. Amant. User interface affordances in a planning representation. Human Computer Interaction, 14(3):317-354, 1999.
• 25: Robert St. Amant , Thomas E. Horton, A tool-based interactive drawing environment, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506585]
• 26: Jason Stewart , Elaine M. Raybourn , Ben Bederson , Allison Druin, When two hands are better than one: enhancing collaboration using single display groupware, CHI 98 conference summary on Human factors in computing systems, p.287-288, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286766]
• 27: Maureen C. Stone , Ken Fishkin , Eric A. Bier, The movable filter as a user interface tool, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.306-312, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191774]
• 28: L. van Leeuwen, A. Smitsman, and C. van Leeuwen. Affordances, perceptual complexity, and the development of tool use. Journal of Experimental Psychology: Human Perception and Performance, 20(1):174-191, 1994.
• 29: J. Vauclair. Animal Cognition. Harvard University Press, Cambridge, MA, 1996.
• 30: E. Visalberghi and L. Limongelli. Acting and understanding: Tool use revisited through the minds of capuchin monkeys. In A. E. Russon, K. A. Bard, and S. T. Parker, editors, Reaching into Thought: The minds of the great apes, chapter 3, pages 57-79. Cambridge University Press, Cambridge, UK, 1996.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.0 General
          Subjects: Cognitive simulation

General Terms:
Human Factors

Keywords:
drawing, interface design, metaphors, tool use