Testing interactive products with the robot intervention method

ABSTRACT

This paper introduces robot intervention, a novel approach to usability testing with children. A social robot is used as a proxy for a test administrator who conducts an active intervention session remotely in a Wizard of Oz fashion. The motivation of the technique is that children will feel at ease and enjoy interacting with the social robot, and thus produce more frequent and informative verbalizations regarding their interaction with the product under test. First experiences regarding this method are positive with regards to the feasibility of the method and with regards to how well it is received by children.

REFERENCES

• 1: Ester Baauw , Panos Markopoulous, A comparison of think-aloud and post-task interview for usability testing with children, Proceedings of the 2004 conference on Interaction design and children: building a community, p.115-116, June 01-03, 2004, Maryland [doi>10.1145/1017833.1017848]
• 2: Boren, T., Ramey, J. Thinking aloud: reconciling theory and practice. Professional Communication, IEEE Transactions on, 43, 3, (2000), 261--278.
• 3: Bartneck C., and Forlizzi, J. (2004). A design centered framework for social human-robot interaction, Proceedings Ro-Man 2004, 591--594
• 4: Albert van Breemen , Xue Yan , Bernt Meerbeek, iCat: an animated user-interface robot with personality, Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems, July 25-29, 2005, The Netherlands [doi>10.1145/1082473.1082823]
• 5: Markopoulos, P., Bekker, M. M. (2003) On assessing usability testing methods for children. Interacting with Computers, 15 (2), Elsevier, 141--149.
• 6: Monk A, Wright P, Haber J and Davenport L (1993) Improving your human-computer.interface. Prentice-Hall.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
Wizard of Oz, active intervention, children, evaluation, social robot, think-aloud, usability test