Exploring multimodality in the laboratory and the field

ABSTRACT

There are new challenges to us, as researchers, on how to design and evaluate new mobile applications because they give users access to powerful computing devices through small interfaces, which typically have limited input facilities. One way of overcoming these shortcomings is to utilize the possibilities of multimodality. We report in this paper how we designed, developed, and evaluated a multimodal mobile application through a combination of laboratory and field studies. This is the first time, as far as we know, that a multimodal application has been developed in such a way. We did this so that we would understand more about where and when users envisioned using different modes of interaction and what problems they may encounter when using an application in context.

REFERENCES

• 1: Niels E. Andersen , Finn Kensing , Jette Lundin , Lars Mathiassen , Andreas Munk-Madsen , Monika Rasbech , Pål Sørgaard, Professional systems development: experience, ideas and action, Prentice-Hall, Inc., Upper Saddle River, NJ, 1990
• 2: Baillie, L., Benyon, D.R., Macaulay, C., Petersen, M.G. Investigating Design Issues in Household Environments. Cognition, Technology and Work, 1, 33--43, 2003.
• 3: Bell, D. Flirt project (Flexible Information and Recreation for Mobile Users). Available from: http://www.research.philips.com/Assets/Downloadablefile/passw4_22(1)-1048.pdf
• 4: Beck, E.T., Christiansen, M.K., and Kjeldskov, J. Experimental Evaluation of Techniques for Usability testing of Mobile Systems in a Laboratory Setting. In Proceedings of OzCHI'2003. Brisbane Austriala, 2003.
• 5: Victoria Bellotti , Ian Smith, Informing the design of an information management system with iterative fieldwork, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.227-237, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347728]
• 6: Bødker, S. Scenarios in User-centered Design-Setting the stage for reflection and action. Interacting with computers. Elsevier, 13, 2000, 61--75.
• 7: Susanne Bødker , Jacob Buur, The design collaboratorium: a place for usability design, ACM Transactions on Computer-Human Interaction (TOCHI), v.9 n.2, p.152-169, June 2002 [doi>10.1145/513665.513670]
• 8: Stephen Brewster, Overcoming the Lack of Screen Space on Mobile Computers, Personal and Ubiquitous Computing, v.6 n.3, p.188-205, May 2002 [doi>10.1007/s007790200019]
• 9: John M. Carroll, Making Use: Scenario-Based Design of Human-Computer Interactions, MIT Press, Cambridge, MA, 2000
• 10: Alan Dix , Janet Finlay , Gregory Abowd , Russell Beale, Human-computer interaction, Prentice-Hall, Inc., Upper Saddle River, NJ, 1997
• 11: Allison Druin, Cooperative inquiry: developing new technologies for children with children, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.592-599, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303166]
• 12: Joseph F. Dumas , Janice C. Redish, A Practical Guide to Usability Testing, Greenwood Publishing Group Inc., Westport, CT, 1993
• 13: William Gaver , Anthony Dunne, Projected realities: conceptual design for cultural effect, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.600-607, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303168]
• 14: Goodman, J. Gray, P., Khammampad, K., and Brewster, S. Using Landmarks to Support Older People in Navigation. In Proceedings of Mobile HCI 2004 (Glasgow, Scotland, Sept 13-16, 2004). Springer-Verlag, Berlin, Heidelberg, 2004, 38--48.
• 15: Howard, S., Carroll, J., Murphy, J., Peck, J., and Vetere, F. Provoking Innovation: Acting-out in Contextual Scenarios. In Proceedings of HF2002 Human Factors Conference (Melbourne, Australia, 2002).
• 16: Giulio Iacucci , Kari Kuutti , Mervi Ranta, On the move with a magic thing: role playing in concept design of mobile services and devices, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.193-202, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347715]
• 17: Kjeldskov, J., Skov, M.B., Als, B.S., and Hoegh, R.T. Is it Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field. In Proceedings of Mobile HCI 2004 (Glasgow, Scotland, Sept 13-16, 2004). Springer-Verlag, Berlin, Heidelberg, 2004, 61--73.
• 18: Jennifer Lai, Facilitating mobile communication with multimodal access to email messages on a cell phone, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986038]
• 19: James R. Lewis, IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use, International Journal of Human-Computer Interaction, v.7 n.1, p.57-78, Jan.-March 1995 [doi>10.1080/10447319509526110]
• 20: Ann Mäkelä , Verena Giller , Manfred Tscheligi , Reinhard Sefelin, Joking, storytelling, artsharing, expressing affection: a field trial of how children and their social network communicate with digital images in leisure time, Proceedings of the SIGCHI conference on Human factors in computing systems, p.548-555, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332499]
• 21: Ji-Ye Mao , Karel Vredenburg , Paul W. Smith , Tom Carey, The state of user-centered design practice, Communications of the ACM, v.48 n.3, p.105-109, March 2005 [doi>10.1145/1047671.1047677]
• 22: McKim, R.H. Experiences in Visual Thinking. Boston Massachussettes, PWS Publishers, 1972.
• 23: Monk, A.F. Wright, P., Haber, J., Davenport, L. Improving your Human-Computer Interface: A Practical Approach. Prentice Hall International, Hemel Hempstead, 1993.
• 24: Mikko Nikkanen, User-centered development of a browser-agnostic mobile e-mail application, Proceedings of the third Nordic conference on Human-computer interaction, p.53-56, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028021]
• 25: Jon O'Brien , Tom Rodden , Mark Rouncefield , John Hughes, At home with the technology: an ethnographic study of a set-top-box trial, ACM Transactions on Computer-Human Interaction (TOCHI), v.6 n.3, p.282-308, Sept. 1999 [doi>10.1145/329693.329698]
• 26: Leysia Palen , Marilyn Salzman, Beyond the handset: designing for wireless communications usability, ACM Transactions on Computer-Human Interaction (TOCHI), v.9 n.2, p.125-151, June 2002 [doi>10.1145/513665.513669]
• 27: Jeffrey Rubin , Theresa Hudson, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, John Wiley & Sons, Inc., New York, NY, 1994
• 28: Sperschneider, W., and Bagger, K. Ethnographic Fieldwork Under Industrial Constraints: Towards Design-in-Context. In Proceedings of NordiCHI2000 (Stockholm, Sweden, 2000).
• 29: Lucy Suchman, Making work visible, Communications of the ACM, v.38 n.9, p.56-ff., Sept. 1995 [doi>10.1145/223248.223263]
• 30: Tamminen, S., Oulasvirta, A., Toiskallio, K., and Kankainen, A. Understanding Mobile Contexts. In Proceedings of Mobile HCI2003 (Udine, Italy, 2003), 2003, 17--31.
• 31: Konrad Tollmar , Stefan Junestrand , Olle Torgny, Virtually living together, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.83-91, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347670]
• 32: D. A. Tyldesley, Employing usability engineering in the development of office products, The Computer Journal, v.31 n.5, p.431-436, Oct. 1988 [doi>10.1093/comjnl/31.5.431]
• 33: Weilenmann, A. and Larsson, C. Collaborative Use of Mobile Telephones: A Field Study of Swedish Teenagers. In Proceedings of NordChi2000 (Stockholm, Sweden, 2000).

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design

General Terms:
Design, Experimentation, Human Factors, Theory

Keywords:
action scenarios, mobile applications and devices, multimodal interaction