OpenWizard: une approche pour la création et l'évaluation rapide de prototypes multimodaux

ABSTRACT

We present OpenWizard, a wizard of oz component-based approach for rapidly prototyping and testing multimodal applications. OpenWizard allows the designer and the developer to rapidly test a non-fully functional multimodal prototype by replacing one modality or a composition of modalities that are not yet available by wizard of oz techniques. We illustrate OpenWizard using a multimodal map navigator.

REFERENCES

• 1: Buxton, W. (1983). Lexical and pragmatic considerations of input structures. ACM SIGGRAPH CG, 17(1), pp. 31--37.
• 2: H. Cheng, et al. (2004). A Wizard of Oz Framework for Collecting Spoken Human-Computer Dialogs. Proc. Intl. Conf. on Spoken Language Processing, Jeju, Korea.
• 3: Coaiana, M., Conconi, A., Nigay, L., Ortega, M. (2008). Test-Bed for Multimodal Games on Mobile Devices. In Proceedings of Fun&Games'08, Springer, pp. 75--87.
• 4: Dahlback, N., Jonsson, A., Ahrenberg, L. (1993). Wizard of Oz Studies -- Why and How. In Proceedings of Intelligent User Interfaces'93 (Orlando, FL), pp. 193--200.
• 5: Davis, R., Saponas, T., Shilman, M., Landay, J. (2007). SketchWizard: Wizard of Oz Prototyping of Pen-Based User Interfaces. Proc of UIST'07, ACM Press, pp. 119--128.
• 6: Dietz, P. and Leigh, D. (2001). DiamondTouch: a multi-user touch technology. Proc. of UIST'01, ACM Press, pp. 219--226.
• 7: Dumas, B., Lalanne, D., Guinard, D., Koenig, R., Ingold, R. (2008). Strenghts and Weaknesses of Software Architectures for the Rapid Creation of Tangible and Multimodal Interfaces. In Proc. of TEI'08, ACM Press, pp. 47--54.
• 8: EJB. http://java.sun.com/products/ejb/.
• 9: Eye-toy by Sony, http://www.eyetoy.com/.
• 10: Gray, P., Ramsay, A., Serrano, M. (2007). A demonstration of the OpenInterface Interaction Development Environment. UIST'07 Adjunct Proc., ACM Press, pp. 39--40.
• 11: Höysniemi, J., Hämäläinen, P., Turkki, L. (2004). Wizard of Oz Prototyping of Computer Vision Based Action Games for Children. Proceedings of IDC'04, ACM Press, pp. 27--34.
• 12: Interface-Z, www.interface-z.com.
• 13: iPhone, www.apple.com/iphone.
• 14: Klein, A. et al. (2001). Evaluating Multi-modal Input Modes in a Wizard-of-Oz Study for the Domain of Web Search. People and Computers XV, Springer, pp. 475--483.
• 15: Klemmer, S. R., Sinha, A., Chen, J., Landay, J., Aboobaker, N., Wang, A. (2000). Suede, a Wizard of Oz Prototyping Tool for Speech user Interfaces. In Proc. of UIST'00, pp. 1--10.
• 16: Lee, M., Billinghurst, M. (2008). A Wizard of Oz Study for an AR Multimodal Interface. In Proceedings of ICMI'08 (Chania, Creete, Grece), pp. 249--256.
• 17: Li, Y., Hong, J., Landay, J. (2007). Design Challenges and Principles for Wizard of Oz Testing of Location-Enhanced Applications, In Proc. of Pervasive Computing, pp. 70--75.
• 18: Nigay, L., Coutaz, J. (1997). Multifeature systems: the CARE properties and their impact on software design. intelligence and multimodality in multimedia interfaces, AAAI Press.
• 19: OMG - CORBA. www.corba.org
• 20: OpenInterface European project. IST Framework 6 STREP funded by the European Commission (FP6-35182). www.oi-project.org.
• 21: Oviatt, S. (1999). Ten Myths of Multimodal Interaction. Communicatinos of the ACM, ACM Press, Volume 42, Issu 11, pp. 74--81
• 22: Serrano, M., Nigay, L. (2008). A Three-dimensional Characterization Space of Software Components for Rapidly Developing Multimodal Interfaces. Proc. of ICMI'08, ACM Press, pp. 149--156.
• 23: Serrano, M., Nigay, L., Demumieux, R., Descos, J., Losquin, P. (2006). Multimodal Interaction on Mobile Phones: Development and Evaluation Using ACICARE. In Proceedings of MobileHCI'06, ACM Press, pp. 129--136.
• 24: Salber, D. & Coutaz, J. (1996). NEIMO, a Multiworkstation Usability Lab for Observing and Analyzing Multimodal Interaction, Proc. of CHI'96, pp 402--403.s
• 25: Wang, S. et al. (2006). Face Tracking as an Augmented Input in Video Games: Enhancing Presence, Role-playing and Control. In Proceedings of CHI'06, ACM Press, pp. 1097--1106.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User interface management systems (UIMS); Prototyping; Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Algorithms, Design, Human Factors, Standardization, Theory

Keywords:
Wizard of Oz, component-based approach, design and implementation tool, multimodal interaction model