Multimodal user interfaces for smart environments: the multi-access service platform

ABSTRACT

User interface modeling is a well accepted approach to handle increasing user interface complexity. The approach presented in this paper utilizes user interface models at runtime to provide a basis for user interface distribution and synchronization. Task and domain model synchronize workflow and dynamic content across devices and modalities. A cooking assistant serves as example application to demonstrate multimodality and distribution. Additionally a debugger allows the inspection of the underlying user interface models at runtime.

REFERENCES

• 1: Blumendorf, M., Feuerstack, S. Albayrak, S. Multimodal user interaction in smart environments: Delivering distributed user interfaces. European Conference on Ambient Intelligence: Workshop proceedings, 2007.
• 2: Gaelle Calvary , Joëlle Coutaz , David Thevenin, A Unifying Reference Framework for the Development of Plastic User Interfaces, Proceedings of the 8th IFIP International Conference on Engineering for Human-Computer Interaction, p.173-192, May 11-13, 2001
• 3: Tim Clerckx , Chris Vandervelpen , Kris Luyten , Karin Coninx, A task-driven user interface architecture for ambient intelligent environments, Proceedings of the 11th international conference on Intelligent user interfaces, January 29-February 01, 2006, Sydney, Australia [doi>10.1145/1111449.1111520]
• 4: Feuerstack, S., Blumendorf, M. and Albayrak, S. Prototyping of multimodal interactions for smart environments based on task models. European Conference on Ambient Intelligence: Workshop proceedings, 2007.
• 5: Limbourg, Q., Vanderdonckt, J., Michotte, B., Bouillon, L., and López-Jaquero, V. Usixml: A language supporting multi-path development of user interfaces. In EHCI/DS-VIS, volume 3425 of Lecture Notes in Computer Science, 2004.
• 6: Fabio Paterno, Model-Based Design and Evaluation of Interactive Applications, Springer-Verlag, London, 1999

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Human Factors

Keywords:
human-computer interaction, interface design, model-based user interfaces, multimodal interaction, runtime interpretation, smart home environments, ubiquitous computing, usability