Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

This article details experience feedback resulting from a user experience study in the wild (i.e. in-situ). The system under test was a mobile device for skiers, which aimed at improving their users' experience. The skiers were equipped with a mini-camera, an accelerometer and a geo-localization system. Thanks to a smartphone, they could replay, on trails, theirs best performances (video, maximum speed, ...). The article focuses both on the methodological and the technological issues encountered during these experimentations, and proposes recommendations.

REFERENCES

• 1: Kjeldskov, J. and Graham, C. A Review of Mobile HCI Research Methods, in Proc. Mobile Human-Computer Interaction -- MobileHCI'2003 (Udine, Italy, 2003), Lecture Notes in Computer Science, Berlin, Springer-Verlag, pp. 317--335.
• 2: Henry Been-Lirn Duh , Gerald C. B. Tan , Vivian Hsueh-hua Chen, Usability evaluation for mobile device: a comparison of laboratory and field tests, Proceedings of the 8th conference on Human-computer interaction with mobile devices and services, September 12-15, 2006, Helsinki, Finland [doi>10.1145/1152215.1152254]
• 3: Kaikkonen, A., Kekäläinen, A., Cankar, M., Kallio, T. and Kankainen, A. Usability Testing of Mobile Applications: A Comparison between Laboratory and Field Testing. Journal of Usability Studies. 1, 1 (2005), pp. 4--17.
• 4: Kjeldskov, J., Skov, M., Als, B. and Høegh, R. Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field, in Proc. Mobile Human-Computer Interaction -- MobileHCI'2004 (Glasgow, UK, 13--16 September, 2004), Lecture Notes in Computer Science, Springer-Verlag, 3160, pp. 61--73.
• 5: Jambon, F. User Evaluation of Mobile Devices: In-Situ versus Laboratory Experiments. International Journal of Mobile Computer-Human Interaction. 1, 2 (2009), pp. 56--71. In Press.
• 6: Melanie Kellar , Derek Reilly , Kirstie Hawkey , Malcolm Rodgers , Bonnie MacKay , David Dearman , Vicki Ha , W. Joseph MacInnes , Michael Nunes , Karen Parker , Tara Whalen , Kori M. Inkpen, It's a jungle out there: practical considerations for evaluation in the city, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056959]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

General Terms:
Experimentation

Keywords:
in-situ evaluation, mobile devices, user experience, user tests