A framework for human-robot interaction

ABSTRACT

This work recommends an architecture for the dialogue system of robots that serve as guides in art collections. Such robots interact with visitors providing information about the exhibits or the educational programmes of a museum. The interaction takes place in natural language in the form of a dialogue session during which, the robot provides suggestions or explanations about programmes or exhibits; furthermore the robot leads the visitors to the room of the desired exhibit. Past research projects have led us to suggest a cognitive based dialogue architecture that is based on four modules: a reactive, a delibetative, a reflective, and an affective one. The cognitive model, allows great flexibility, comprehensibility, facility to revise certain modules as desired and a high degree of naturalness in dialogue and behaviour with humans. In addition the dialogue system relies on resources such as OWL domain ontologies, user types, user interaction history and a robotic personality.

REFERENCES

• 1: Gediminas Adomavicius , Alexander Tuzhilin, Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions, IEEE Transactions on Knowledge and Data Engineering, v.17 n.6, p.734-749, June 2005 [doi>10.1109/TKDE.2005.99]
• 2: E. André, L. Dybkjær, W. Minker, and P. Heisterkamp, editors. Affective Dialogue Systems. Springer, 2004.
• 3: I. Androutsopoulos, J. Oberlander, and V. Karkaletsis. Source authoring for multilingual generation of personalised object descriptions. Natural Language Engineering, 13(3):191--233, 2007.
• 4: M. Bennewitz, F. Faber, M. Schreiber, and S. Behnke. Towards a humanoid museum guide robot that interacts with multiple persons. In Proceedings of the 2005 5th IEEE-RAS International Conference on Humanoid Robots, 2005.
• 5: Dimitris Bilidas , Maria Theologou , Vangelis Karkaletsis, Enriching OWL Ontologies with Linguistic and User-Related Annotations: The ELEON System, Proceedings of the 19th IEEE International Conference on Tools with Artificial Intelligence - Vol.2 (ICTAI 2007), p.464-467, October 29-31, 2007 [doi>10.1109/ICTAI.2007.94]
• 6: C. Chiu. The Bryn Mawr Tour Guide Robot. PhD thesis, Bryn Mawr College, 2004.
• 7: P. T. Costa and R. R. McCrae. Normal Personality Assessment in Clinical Practice: The NEO Personality Inventory. Psycological Assessment, 4(1), 1992.
• 8: AnHai Doan , Jayant Madhavan , Pedro Domingos , Alon Halevy, Learning to map between ontologies on the semantic web, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511532]
• 9: A. Egges, X. Zhang, S. Kshiragar, and N. M. Thalmann. Emotional communication with virtual humans. In Proceedings of the 9th International Conference on Multimedia Modelling, 2003.
• 10: D. Galanis and I. Androutsopoulos. Generating multilingual descriptions from linguistically annotated owl ontologies: the NaturalOWL system. In Proceedings of the 11th European Workshop on Natural Language Generation, Schloss Dagstuhl, Germany, 2007.
• 11: P. Langley, J. E. Laird, and S. Rogers. Cognitive architectures: Research issues and challenges. Technical report, Computational Learning Laboratory, Stanford University, 2006.
• 12: B. McEleney and G. O. Hare. Efficient dialogue using a probabilistic nested user model. In Nineteenth International Joint Conference on Artificial Intelligence, Edinburgh, Scotland, 2005.
• 13: Michael F. McTear, Spoken Dialogue Technology, SpringerVerlag, 2004
• 14: D. Milward and M. Beveridge. Ontology-based dialogue systems. In Proceedings of IJCAI-03 Workshop on Knowledge and Reasoning in Practical Dialogue Systems, 2003.
• 15: M. Minsky. The Emotion Machine. Simon and Shuster, 2006.
• 16: A. Ortony, G. Glore, and A. Collins. The Cognitive Structure of Emotions. Cambridge University Press, 1988.
• 17: G. Paliouras, A. Mouzakidis, C. Ntoutsis, A. Alexopoulos, and C. Skourlas. PNS: Personalized Multi-Source News Delivery. In Proceedings of the 10th International Conference on Knowledge-Based & Intelligent Information & Engineering Systems (KES), UK, 2006.
• 18: R. W. Piccard. Affective Computing. MIT press, 1997.
• 19: A. Sloman. Requiremnts for a fully-deliberative architecture (or component of an architecture. http://www.cs.bham.ac.uk/research/projects/cosy/papers/#dp0604, COSY-DP-0604 (HTML), 2006.
• 20: S. Thrun, M. Bennewitz, W. Burgard, A. B. Cremers, F. Dellaert, D. Fox, D. Haehnel, C. Rosenberg, N. Roy, J. Schulte, and D. Schulz. MINERVA: A second generation mobile tour-guide robot. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), 1999.
• 21: D. Vernon, G. Metta, and G. Sandini. A Survey of Artificial Cogntive Systems: Implications for the Autonomous Development of Mental Capabilities in Computational Agents. IEEE, Transactions on evalutionary computation, special issue on autonomus mental develpment, 2006.
• 22: G. Xydas and G. Kouroupetroglou. The DEMOSTHENES Speech Composer. In Proceedings of the 4th ISCA Tutorial and Workshop on Speech Synthesis, SSW4, Perthshire, Scotland, 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Natural language

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Discourse

Keywords:
HCI, cognitive architecture, dialogue system