Reflective physical prototyping through integrated design, test, and analysis

ABSTRACT

Prototyping is the pivotal activity that structures innovation, collaboration, and creativity in design. Prototypes embody design hypotheses and enable designers to test them. Framin design as a thinking-by-doing activity foregrounds iteration as a central concern. This paper presents d.tools, a toolkit that embodies an iterative-design-centered approach to prototyping information appliances. This work offers contributions in three areas. First, d.tools introduces a statechart-based visual design tool that provides a low threshold for early-stage prototyping, extensible through code for higher-fidelity prototypes. Second, our research introduces three important types of hardware extensibility - at the hardware-to-PC interface, the intra-hardware communication level, and the circuit level. Third, d.tools integrates design, test, and analysis of information appliances. We have evaluated d.tools through three studies: a laboratory study with thirteen participants; rebuilding prototypes of existing and emerging devices; and by observing seven student teams who built prototypes with d.tools.

REFERENCES

• 1: Java 2 Platform SDK: Java. Robot, 2006. Sun Microsystems. http://java.sun.com/j2se/1.5/docs/api/java/awt/Robot.html
• 2: LEGO Mindstorms Robotic Invention System. http://www.mindstorms.lego.com/
• 3: Maestro. Cybelius. http://www.cybelius.com/products
• 4: Max/MSP. Cycling '74. http://cycling74.com/products/maxmsp
• 5: Daniel Avrahami , Scott E. Hudson, Forming interactivity: a tool for rapid prototyping of physical interactive products, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England [doi>10.1145/778712.778735]
• 6: Badre, A. N., M. Guzdial, S. E. Hudson, and P. J. Santos. A user interface evaluation environment using synchronized video, visualizations and event trace data. Software Quality Journal 4(2): Springer Netherlands. pp. 101--13, 1995.
• 7: Michelle Q. Wang Baldonado , Allison Woodruff , Allan Kuchinsky, Guidelines for using multiple views in information visualization, Proceedings of the working conference on Advanced visual interfaces, p.110-119, May 2000, Palermo, Italy [doi>10.1145/345513.345271]
• 8: Rafael Ballagas , Meredith Ringel , Maureen Stone , Jan Borchers, iStuff: a physical user interface toolkit for ubiquitous computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642705]
• 9: Rafael Ballagas , Andy Szybalski , Armando Fox, Patch Panel: Enabling Control-Flow Interoperability in Ubicomp Environments, Proceedings of the Second IEEE International Conference on Pervasive Computing and Communications (PerCom'04), p.241, March 14-17, 2004
• 10: Barragan, H., Wiring: Prototyping Physical Interaction Design, Interaction Design Institute, Ivrea, Italy, 2004.
• 11: Marion Buchenau , Jane Fulton Suri, Experience prototyping, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.424-433, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347802]
• 12: Brandon Burr, VACA: a tool for qualitative video analysis, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125580]
• 13: Jerry Fails , Dan Olsen, A design tool for camera-based interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642690]
• 14: Saul Greenberg , Michael Boyle, Customizable physical interfaces for interacting with conventional applications, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571991]
• 15: Saul Greenberg , Chester Fitchett, Phidgets: easy development of physical interfaces through physical widgets, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502388]
• 16: Monty L. Hammontree , Jeffrey J. Hendrickson , Billy W. Hensley, Integrated data capture and analysis tools for research and testing on graphical user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.431-432, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142886]
• 17: David Harel, Statecharts: A visual formalism for complex systems, Science of Computer Programming, v.8 n.3, p.231-274, June 1, 1987 [doi>10.1016/0167-6423(87)90035-9]
• 18: David M. Hilbert , David F. Redmiles, Extracting usability information from user interface events, ACM Computing Surveys (CSUR), v.32 n.4, p.384-421, Dec. 2000 [doi>10.1145/371578.371593]
• 19: Ken Hinckley , Jeff Pierce , Mike Sinclair , Eric Horvitz, Sensing techniques for mobile interaction, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.91-100, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354417]
• 20: Houde, S. and C. Hill, What do Prototypes Prototype? in Handbook of Human-Computer Interaction, M. Helander, T.Ê. Landauer, and P. Prabhu, Editors. Elsevier Science B. V: Amsterdam, 1997.
• 21: J. F. Kelley, An iterative design methodology for user-friendly natural language office information applications, ACM Transactions on Information Systems (TOIS), v.2 n.1, p.26-41, Jan. 1984 [doi>10.1145/357417.357420]
• 22: Kelley, T., The Art of Innovation: Currency. 320 pp. 2001.
• 23: Kirsh, D. and P. Maglio. On distinguishing epistemic from pragmatic action. Cognitive Science 18. pp. 513--49, 1994.
• 24: Scott R. Klemmer , Björn Hartmann , Leila Takayama, How bodies matter: five themes for interaction design, Proceedings of the 6th ACM conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA [doi>10.1145/1142405.1142429]
• 25: Scott R. Klemmer , Anoop K. Sinha , Jack Chen , James A. Landay , Nadeem Aboobaker , Annie Wang, Suede: a Wizard of Oz prototyping tool for speech user interfaces, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.1-10, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354406]
• 26: Scott R. Klemmer , Bill Verplank , Wendy Ju, Teaching embodied interaction design practice, Proceedings of the 2005 conference on Designing for User eXperience, November 03-05, 2005, San Francisco, California
• 27: Johnny C. Lee , Daniel Avrahami , Scott E. Hudson , Jodi Forlizzi , Paul H. Dietz , Darren Leigh, The calder toolkit: wired and wireless components for rapidly prototyping interactive devices, Proceedings of the 2004 conference on Designing interactive systems: processes, practices, methods, and techniques, August 01-04, 2004, Cambridge, MA, USA [doi>10.1145/1013115.1013139]
• 28: W. E. Mackay, EVA: an experimental video annotator for symbolic analysis of video data, ACM SIGCHI Bulletin, v.21 n.2, p.68-71, Oct. 1989 [doi>10.1145/70609.70617]
• 29: Brad Myers , Scott E. Hudson , Randy Pausch, Past, present, and future of user interface software tools, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.3-28, March 2000 [doi>10.1145/344949.344959]
• 30: Ringel Morris, M., Supporting Effective Interaction with Tabletop Groupware, Unpublished PhD, Stanford University, Computer Science, Stanford, CA, 2006.
• 31: Schön, D. A., The Reflective Practitioner: How Professionals Think in Action. New York: Basic Books. 374 pp. 1983.
• 32: Donald Schön , John Bennett, Reflective conversation with materials, Bringing design to software, ACM Press, New York, NY, 1996 [doi>10.1145/229868.230044]
• 33: Michael Schrage, Cultures of prototyping, Bringing design to software, ACM Press, New York, NY, 1996 [doi>10.1145/229868.230045]
• 34: Schrage, M., Serious play - How the world's best companies simulate to innovate. Cambridge, MA: Harvard Business School Press. 245 pp. 2000.
• 35: Paul Weiler, Software for the usability lab: a sampling of current tools, Proceedings of the SIGCHI conference on Human factors in computing systems, p.57-60, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169076]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: State diagrams; User interfaces

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design; Interaction styles (e.g., commands, menus, forms, direct manipulation); Prototyping

General Terms:
Design, Human Factors

Keywords:
design thinking, design tools, information appliances, integrating physical & digital, prototyping, toolkits