Developing and evaluating web multimodal interfaces - a case study with usability principles

ABSTRACT

In this paper we describe an approach to facilitate the design of Web multimodal interfaces aiming at improving the user experience and the user interface usability using speech recognition together with the usual graphical user interfaces. We present a proposal for usability evaluation based on the heuristic evaluation, which considers the multimodal principles identified during a case study. As a result of using the proposed approach in the case study and from literature review, we report our considerations for the design, development and improvement of the Web multimodal interfaces.

REFERENCES

• 1: Baranauskas, M. C. C.; Rocha, H. V. Design and Evaluation of Human-Computer Interfaces, ed. Campinas: Emopi Publisher, 2003. v. 1. 244 p.
• 2: Michael H. Cohen , James P. Giangola , Jennifer Balogh, Voice User Interface Design, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 2004
• 3: Frans Flippo , Allen Krebs , Ivan Marsic, A framework for rapid development of multimodal interfaces, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada [doi>10.1145/958432.958455]
• 4: Scott R. Klemmer , Anoop K. Sinha , Jack Chen , James A. Landay , Nadeem Aboobaker , Annie Wang, Suede: a Wizard of Oz prototyping tool for speech user interfaces, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.1-10, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354406]
• 5: Limbourg, Q.; Vanderdonckt, J.; Michotte, B.; Bouillon, L.; Lopez, V. USIXML: a Language Supporting Multi-Path Development of User Interfaces. In Proc. of 9th IFIP Working Conf. on Engineering for HCI jointly with 11th Int. Workshop on Design and Specification of Interactive Systems EHCI-DSVIS'2004 (Hamburg, July04). Kluwer Academic Press, Dordrecht, 2004.
• 6: Jeffrey Nichols , Brad Myers , Thomas K. Harris , Roni Rosenfeld , Stefanie Shriver , Michael Higgins , Joseph Hughes, Requirements for Automatically Generating Multi-Modal Interfaces for Complex Appliances, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.377, October 14-16, 2002 [doi>10.1109/ICMI.2002.1167024]
• 7: Nielsen, Jacob. How to Conduct a Heuristic Evaluation. http://www.useit.com/papers/heuristic/heuristic_evaluation.html.
• 8: Sharon Oviatt, Taming recognition errors with a multimodal interface, Communications of the ACM, v.43 n.9, p.45-51, Sept. 2000 [doi>10.1145/348941.348979]
• 9: Oviatt, S. Multimodal Interfaces. In: J. Jacko and A. Sears (eds) The HCI Mahwah, NJ: Lawrence Erlbaum and Associates, 2002.
• 10: Paiva, D. M. B.; Freire, A. P.; Fortes, R. P. M. Design Rationale in Academic Software Development: Requirements for a Representation Model. In: 18th Intl. Conf. on Software Engineering and Knowledge Engineering -- San Francisco, 2006, p. 469--472.
• 11: Fabio Paternò , Federico Giammarino, Authoring interfaces with combined use of graphics and voice for both stationary and mobile devices, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133335]
• 12: Angel Puerta , Jacob Eisenstein, XIML: a common representation for interaction data, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502763]
• 13: Raman, T. V. Design principles for multimodal interaction. In MMI Workshop, Computer Human Interfaces (CHI-03), p. 5--10, Fort Lauderdale, USA.
• 14: Leah M. Reeves , Jennifer Lai , James A. Larson , Sharon Oviatt , T. S. Balaji , Stéphanie Buisine , Penny Collings , Phil Cohen , Ben Kraal , Jean-Claude Martin , Michael McTear , TV Raman , Kay M. Stanney , Hui Su , Qian Ying Wang, Guidelines for multimodal user interface design, Communications of the ACM, v.47 n.1, January 2004 [doi>10.1145/962081.962106]
• 15: Adrian Stanciulescu , Quentin Limbourg , Jean Vanderdonckt , Benjamin Michotte , Francisco Montero, A transformational approach for multimodal web user interfaces based on UsiXML, Proceedings of the 7th international conference on Multimodal interfaces, October 04-06, 2005, Torento, Italy [doi>10.1145/1088463.1088508]
• 16: Stanciulescu, A., Vanderdonckt, J., Design Options for Multimodal Web Applications, Proc. of 6th Int. Conf. on Computer-Aided Design of User Interfaces CADUT06 (Bucharest, June06), Chapter 4, Springer-Verlag, Berlin, 2006, pp. 41--56.
• 17: Americo Talarico Neto , Renata Pontin M. Fortes , Adalberto G. da Silva Filho, Multimodal interfaces design issues: the fusion of well-designed voice and graphical user interfaces, Proceedings of the 26th annual ACM international conference on Design of communication, September 22-24, 2008, Lisbon, Portugal [doi>10.1145/1456536.1456597]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Documentation, Human Factors

Keywords:
evaluation of multimodal interfaces, multimodal user interfaces, voice user interfaces, web