Are informal tools better?: comparing DEMAIS, pencil and paper, and authorware for early multimedia design

ABSTRACT

DEMAIS is an informal design tool that we claim helps a multimedia designer explore and communicate temporal and interactive (behavioral) design ideas better than existing tools. This paper seeks to empirically validate our claim. We report on an evaluation comparing DEMAIS to pencil and paper and Authorware for the exploration and communication of behavior in early multimedia design. The main results are that (i) DEMAIS was better than Authorware for both exploring and communicating behavior, (ii) DEMAIS was better than pencil and paper for communicating behavior, and (iii) DEMAIS was able to capture most of a designer's behavioral design ideas. Our results show that DEMAIS bridges the early investment/communication gap that exists among current multimedia design tools.

REFERENCES

• 1: Brian Patrick Bailey , Joseph Andrew Konstan, Demais: a behavior-sketching tool for early multimedia design, 2002
• 2: Brian P. Bailey , Joseph A. Konstan , John V. Carlis, DEMAIS: designing multimedia applications with interactive storyboards, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500179]
• 3: Bailey, B.P., J.A. Konstan and J.V. Carlis. Supporting Multimedia Designers: Towards More Effective Design Tools. In Proceedings of Multimedia Modeling, 2001, pp. 267--286.
• 4: Bailey, B.P. and J.A. Konstan. Authoring Interactive Media. Encyc. Elec. and Electronics Eng., John Wiley & Sons, 2000.
• 5: Mark D. Gross , Ellen Yi-Luen Do, Ambiguous intentions: a paper-like interface for creative design, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.183-192, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237119]
• 6: James D. Herbsleb , Eiji Kuwana, Preserving knowledge in design projects: what designers need to know, Proceedings of the SIGCHI conference on Human factors in computing systems, p.7-14, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169061]
• 7: Scott R. Klemmer , Mark W. Newman , Ryan Farrell , Mark Bilezikjian , James A. Landay, The designers' outpost: a tangible interface for collaborative web site, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502350]
• 8: James A. Landay , Brad A. Myers, Interactive sketching for the early stages of user interface design, Proceedings of the SIGCHI conference on Human factors in computing systems, p.43-50, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223910]
• 9: Lewis, M., W. Clark and B. Devoto (Editor). The Journals of Lewis and Clark. Houghton Mifflin Co, 1997.
• 10: James Lin , Michael Thomsen , James A. Landay, A visual language for sketching large and complex interactive designs, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503431]
• 11: James Lin , Mark W. Newman , Jason I. Hong , James A. Landay, DENIM: finding a tighter fit between tools and practice for Web site design, Proceedings of the SIGCHI conference on Human factors in computing systems, p.510-517, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332486]
• 12: Wendy E. Mackay , Anne V. Ratzer , Paul Janecek, Video artifacts for design: bridging the Gap between abstraction and detail, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.72-82, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347666]
• 13: Mark W. Newman , James A. Landay, Sitemaps, storyboards, and specifications: a sketch of Web site design practice, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.263-274, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347758]
• 14: Rieber, L.P. Getting Interactive with Authorware: Building Simulations and Games. http://www.nowhereroad.com/authorware/index.html.
• 15: Jim Rudd , Ken Stern , Scott Isensee, Low vs. high-fidelity prototyping debate, interactions, v.3 n.1, p.76-85, Jan. 1996 [doi>10.1145/223500.223514]
• 16: Strothotte, T., B. Preim, A. Raab, J. Schumann and D.R. Forsey. How to Render Frames and Influence People. In Proc. Eurographics '94, pp. 455--466.
• 17: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Screen design (e.g., text, graphics, color); Prototyping

General Terms:
Design, Human Factors

Keywords:
sketching, storyboards, visual language