Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Home environment is an exciting application domain for multimodal mobile interfaces. Instead of multiple remote controls, personal mobile devices could be used to operate home entertainment systems. This paper reports a subjective evaluation of multimodal inputs and outputs for controlling a home media center using a mobile phone. A within-subject evaluation with 26 participants revealed significant differences on user expectations on and experiences with different modalities. Speech input was received extremely well, even surpassing expectations in some cases, while gestures and haptic feedback were almost failing to meet the lowest expectations. The results can be applied for designing similar multimodal applications in home environments.

REFERENCES

• 1: Alois Ferscha , Simon Vogl , Bernadette Emsenhuber , Bernhard Wally, Physical shortcuts for media remote controls, Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINment, January 08-10, 2008, Cancun, Mexico
• 2: Hartikainen, M., Salonen, E.-P., Turunen, M., 2004. Subjective evaluation of spoken dialogue systems using SERVQUAL method. In Proceedings of the 7th International Conference on Spoken Language Processing (ICSLP'04), 2273--2276.
• 3: Eve Hoggan , Stephen Brewster, Designing audio and tactile crossmodal icons for mobile devices, Proceedings of the 9th international conference on Multimodal interfaces, November 12-15, 2007, Nagoya, Aichi, Japan [doi>10.1145/1322192.1322222]
• 4: Ibrahim, A., and Johansson, P. 2003. Multimodal Dialogue Systems: A Case Study for Interactive TV. Carbonell, Noelle; Stephanidis, Constantine (Eds.) Universal Access. Theoretical Perspectives, Practice, and Experience, 7th ERCIM International Workshop on User Interfaces for All, Revised Papers. Springer, LNCS, Vol. 2615. 209--218.
• 5: Aleksi Melto , Markku Turunen , Anssi Kainulainen , Jaakko Hakulinen , Tomi Heimonen , Ville Antila, Evaluation of predictive text and speech inputs in a multimodal mobile route guidance application, Proceedings of the 10th international conference on Human computer interaction with mobile devices and services, September 02-05, 2008, Amsterdam, The Netherlands [doi>10.1145/1409240.1409287]
• 6: Thomas Schlömer , Benjamin Poppinga , Niels Henze , Susanne Boll, Gesture recognition with a Wii controller, Proceedings of the 2nd international conference on Tangible and embedded interaction, February 18-20, 2008, Bonn, Germany [doi>10.1145/1347390.1347395]
• 7: Soronen, H., Turunen, M., and Hakulinen, J. 2008. Voice Commands in Home Environment - a Consumer Survey. In Proceedings of Interspeech 2008, 2078--2081.
• 8: Turunen, M., Hakulinen, J., Melto, A., Heimonen, T., Laivo, T., and Hella, J. 2009. SUXES -- User Experience Evaluation Method for Spoken and Multimodal Interaction. In Proceedings of Interspeech 2009.
• 9: Turunen, M., Hakulinen, J., Melto, A., Hella, J., Rajaniemi, J.-P., Mäkinen, E., Rantala, J., Heimonen, T., Laivo, T., Soronen, H., Hansen, M., Valkama, P., Miettinen, T., Raisamo, R. 2009. Speech-based and Multimodal Media Center for Different User Groups. In Proceedings of Interspeech 2009.
• 10: Kent Wittenburg , Tom Lanning , Derek Schwenke , Hal Shubin , Anthony Vetro, The prospects for unrestricted speech input for TV content search, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133338]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O; Interaction styles (e.g., commands, menus, forms, direct manipulation); Haptic I/O

General Terms:
Experimentation, Human Factors, Measurement, Performance

Keywords:
SUXES, gestures, haptic feedback, speech recognition