EVAL - an evaluation component for mobile interfaces

ABSTRACT

The Eval Tool is a usability evaluation environment which can be used to evaluate users an their behaviour while they interact with their pervasive computing environment via a mobile phone interface. The tool supports audio-visual recordings of several users and automatically annotates and synchronizes them with context data emerging from the pervasive environment. The annotation of video material with contextual information is important for the analysis of user studies and the detection of usability issues. The EVAL Tool consists of a recorder and a analyzer component. Using the recorder component the capturing of the videos and the logging of the context can be controlled whereas the analyzer components helps to interpret the user study.

REFERENCES

• 1: Ghassan Al-Qaimari , Darren McRostie, KALDI: a computer-aided usability engineering tool for supporting testing and analysis of human-computer interaction, Proceedings of the third international conference on Computer-aided design of user interfaces, p.337-355, October 1999, Louvain-la-Neuve, Belgium
• 2: M. Kipp. Anvil - a generic annotation tool for multimodal dialogue. In Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech), pages 1367--1370, Aalborg, September 2001.
• 3: M. Macleod and R. Rengger. The development of drum: A software tool for video-assisted usability evaluation. In HCI'93: Proceedings of the HCI conference, pages 293--309, 1993.
• 4: Dana L. Uehling , Karl Wolf, User action graphing effort (UsAGE), Conference companion on Human factors in computing systems, p.290-291, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223679]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); Interaction styles (e.g., commands, menus, forms, direct manipulation); User-centered design

General Terms:
Design, Experimentation, Human Factors

Keywords:
context, evaluation tool, usability, user study