Human to robot demonstrations of routine home tasks: exploring the role of the robot's feedback

ABSTRACT

In this paper, we explore some conceptual issues, relevant for the design of robotic systems aimed at interacting with humans in domestic environments. More specifically, we study the role of the robot's feedback (positive or negative acknowledgment of understanding) on a human teacher's demonstration of a routine home task (laying a table). Both the human and the system's perspectives are considered in the analysis and discussion of results from a human-robot user study, highlighting some important conceptual and practical issues. These include the lack of explicitness and consistency on people's demonstration strategies. Furthermore, we discuss the need to investigate design strategies to elicit people's knowledge about the task and also successfully advertize the robot's abilities in order to promote people's ability to provide appropriate demonstrations.

REFERENCES

• 1: A. Alissandrakis, C. Nehaniv, and K. Dautenhahn, "Correspondence Mapping Induced State and Action Metrics for Robot Imitation," IEEE Transactions On Systems Man And Cybernetics Part B--Cybernetics, vol. 37, pp. 299--307, 2007.
• 2: A. Alissandrakis, C. Nehaniv, K. Dautenhahn, and J. Saunders, "An approach for programming robots by demonstration to manipulate objects: Considerations on metrics to achieve corresponding effects," in Proc. 6th IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA '05), 2005, pp. 61--66.
• 3: Phil Barnard, The contributions of applied cognitive psychology to the study of human-computer interaction, Human factors for informatics usability, Cambridge University Press, New York, NY, 1991
• 4: Harold Bekkering , Wolfgang Prinz, Goal representations in imitative actions, Imitation in animals and artifacts, MIT Press, Cambridge, MA, 2002
• 5: A. Billard, Y. Epars, S. Calinon, G. Cheng, and S. Schaal, "Discovering optimal imitation strategies," Robotics and Autonomous Systems, vol. 47, pp. 2--3, 2004.
• 6: G. Butterworth, "Pointing is the royal road to language for babies," in Pointing: Where Language, Culture, and Cognition Meet, S. Kita, Ed.: Lawrence Erlbaum Assoc Inc., 2003, pp. 9--26.
• 7: Josep Call , Malinda Carpenter, Three sources of information in social learning, Imitation in animals and artifacts, MIT Press, Cambridge, MA, 2002
• 8: J. Cassell, "A Framework For Gesture Generation And Interpretation," in Computer Vision in Human-Machine Interaction, R. Cipolla and A. Pentland, Eds. New York: Cambridge University Press, 1998, pp. 191--215.
• 9: Justine Cassell, Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 10: J. Cassell and K. R. Thorisson, "The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agents," Applied Artificial Intelligence, vol. 13, pp. 519--538, 1999.
• 11: Nils Dahlbäck , Arne Jönsson , Lars Ahrenberg, Wizard of Oz studies: why and how, Proceedings of the 1st international conference on Intelligent user interfaces, p.193-200, January 04-07, 1993, Orlando, Florida, United States [doi>10.1145/169891.169968]
• 12: K. Dautenhahn, "The Art of Designing Socially Intelligent Agents: Science, Fiction, and the Human in the Loop," Applied Artificial Intelligence, vol. 12, pp. 573--617, 1998.
• 13: Kerstin Dautenhahn , Chrystopher L. Nehaniv, Imitation in animals and artifacts, MIT Press, Cambridge, MA, 2002
• 14: B. du Boulay, "Fallible, Distractible, Forgetful, Willful and Irrational Learners," in Computer as Cognitive Tools: no more walls, S. Lajoie, Ed. NJ: Lawrence Erlbaum, 2000, pp. 339--376.
• 15: T. Fong, I. Nourbakhsh, and K. Dautenhahn, "A survey of socially interactive robots," Robotics and Autonomous Systems, vol. 42, pp. 143, 2003.
• 16: Saeed Shiry Ghidary , Yasushi Nakata , Hiroshi Saito , Motofumi Hattori , Toshi Takamori, Multi-Modal Interaction of Human and Home Robot in the Context of Room Map Generation, Autonomous Robots, v.13 n.2, p.169-184, September 2002 [doi>10.1023/A:1019689509522]
• 17: B. M. Hard, S. Lozano, and B. Tversky, "Hierarchical Encoding of Behavior: Translating Perception Into Action," Journal of Experimental Psychology, vol. 135, pp. 588--608, 2006.
• 18: A. Kendon, "Gesture," Annual Review Of Anthropology, vol. 26, pp. 109--128, 1997.
• 19: M. Kipp, Gesture Generation by Imitation: From Human Behaviour to Computer Character Animation. Boca Raton, Florida: Dissertation.com, 2004.
• 20: S. Koop, P. Tepper, K. Ferriman, and J. Cassell, "Trading Spaces: How Humans and Humanoids use Speech and Gesture to Give Directions," Spatial Cognition and Computation, in press.
• 21: D. McNeill, Hand and Mind. Chicago: Chicago University Press, 1992.
• 22: D. McNeill, Gesture and Thought. Chicago: University of Chicago Press, 2005.
• 23: R. Moratz, K. Fischer, and T. Tenbrink, "Cognitive modelling of spatial reference for human-robot interaction," International Journal on Artificial Intelligence Tools, vol. 10, pp. 589--611, 2001.
• 24: J. G. Neal , C. Y. Thielman , Z. Dobes , S. M. Haller , S. C. Shapiro, Natural language with integrated deictic and graphic gestures, Proceedings of the workshop on Speech and Natural Language, October 15-18, 1989, Cape Cod, Massachusetts [doi>10.3115/1075434.1075499]
• 25: C. Nehaniv and K. Dautenhahn, "Mapping between dissimilar bodies: Affordances and the algebraic foundations of imitation," in Proceedings European Workshop on Learning Robots 1998 (EWLR-7), J. Demiris and A. Birk, Eds. Edinburgh, 1998, pp. 64--72.
• 26: Chrystopher L. Nehaniv , Kerstin Dautenhahn, The correspondence problem, Imitation in animals and artifacts, MIT Press, Cambridge, MA, 2002
• 27: C. Nehaniv and K. Dautenhahn, Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions. Cambridge: Cambridge Universtiy Press, 2007.
• 28: C. Nehaniv, K. Dautenhahn, J. Kubacki, M. Haegele, C. Parlitz, and R. Alami, "A methodological approach relating the classification of gesture to identification of human intent in the context of human-robot interaction," in Proc. IEEE Ro-Man, 2005, pp. 371--377.
• 29: J. Y. Oh, C. W. Lee, and B. J. You, "Gesture recognition by attention control method for intelligent humanoid robot," in Knowledge-Based Intelligent Information And Engineering Systems, Pt 1, Proceedings, vol. 3681, Lecture Notes In Artificial Intelligence, 2005, pp. 1139--1145.
• 30: N. Otero, S. Knoop, C. Nehaniv, D. S. Syrdal, K. Dautenhahn, and R. Dillman, "Distribution and Recognition of Gestures in Human-Robot Interaction," in Proceedings of Ro-man 2006, 2006, pp. 103--110.
• 31: N. Otero, C. Nehaniv, D. S. Syrdal, and K. Dautenhahn, "Naturally Occurring Gestures in a Human-Robot Teaching Scenario," in Proc. The 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN06), 2006, pp. 533--540.
• 32: N. Otero, C. Nehaniv, D. S. Syrdal, and K. Dautenhahn, "Naturally Occurring Gestures in a Human-Robot Teaching Scenario," in Proceeding of Ro--Man 2006, 2006, pp. 533--540.
• 33: Joe Saunders , Chrystopher L. Nehaniv , Kerstin Dautenhahn, Teaching robots by moulding behavior and scaffolding the environment, Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, March 02-03, 2006, Salt Lake City, Utah, USA [doi>10.1145/1121241.1121263]
• 34: J. Saunders, N. Otero, and C. Nehaniv, "Issues in Human/Robot Task structuring and Teaching," in Proceedings of Ro-Man 2007, in press.
• 35: B. Scassellati, "Imitation and mechanisms of joint attention: A developmental structure for building social skills," in Computation for Metaphors, Analogy and Agents, C. Nehaniv, Ed.: Springer Lecture Notes in Artificial Intelligence, vol. 1562, 1999, pp. 176--195.
• 36: K. Severinson-Eklundh, A. Green, and H. Huttenrauch, "Social and collaborative aspects of interaction with a service robot," Robotics and Autonomous Systems, vol. 42, pp. 223, 2003.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics
          Subjects: Operator interfaces

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics
          Subjects: Operator interfaces

General Terms:
Design, Human Factors

Keywords:
correspondence problem, effect metrics, gestures, human-robot interaction, routine home tasks, social learning, spatial configuration tasks