Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

This paper presents a reasoning system for a multi-modal service robot with human-robot interaction. The reasoning system uses partially observable Markov decision processes (POMDPs) for decision making and an intermediate level for bridging the gap of abstraction between multi-modal real world sensors and actuators on the one hand and POMDP reasoning on the other. A filter system handles the abstraction of multi-modal perception while preserving uncertainty and model-soundness. A command sequencer is utilized to control the execution of symbolic POMDP decisions on multiple actuator components. By using POMDP reasoning, the robot is able to deal with uncertainty in both observation and prediction of human behavior and can balance risk and opportunity. The system has been implemented on a multi-modal service robot and is able to let the robot act autonomously in modeled human-robot interaction scenarios. Experiments evaluate the characteristics of the proposed algorithms and architecture.

REFERENCES

• 1: K. J. Aström. Optimal control of markov decision processes with incomplete state estimation. Journal of Mathematical Analysis and Applications, 10, 1965.
• 2: Anthony R. Cassandra , Leslie Pack Kaelbling , Michael L. Littman, Acting optimally in partially observable stochastic domains, Proceedings of the twelfth national conference on Artificial intelligence (vol. 2), p.1023-1028, October 1994, Seattle, Washington, United States
• 3: E. Gat. On three--layer architectures. Artificial Intelligence and Mobile Robots. MIT/AAAI Press, 1997.
• 4: Alan Genz, Numerical computation of rectangular bivariate and trivariate normal and t probabilities, Statistics and Computing, v.14 n.3, p.251-260, August 2004 [doi>10.1023/B:STCO.0000035304.20635.31]
• 5: R. Jaulmes, J. Pineau, and D. Precup. Active learning in partially observable markov decision processes. In ECML, 2005.
• 6: Leslie Pack Kaelbling , Michael L. Littman , Anthony R. Cassandra, Planning and acting in partially observable stochastic domains, Artificial Intelligence, v.101 n.1-2, p.99-134, May 1998 [doi>10.1016/S0004-3702(98)00023-X]
• 7: S. Knoop, S. R. Schmidt--Rohr, and R. Dillmann. A Flexible Task Knowledge Representation for Service Robots. In The 9th International Conference on Intelligent Autonomous Systems (IAS--9), Kashiwa New Campus, The University of Tokyo, Tokyo, Japan, March 2006.
• 8: M. Lösch, S. Schmidt--Rohr, S. Knoop, S. Vacek, and R. Dillmann. Feature set selection and optimal classifier for human activity recognition. In Robot and Human Interactive Communication 2007 (ROMAN, 16th IEEE International Symposium on, Jeju Island, Korea, Aug 26--29 2007.
• 9: J. Pineau, G. Gordon, and S. Thrun. Point-based value iteration: An anytime algorithm for POMDPs. In International Joint Conference on Artificial Intelligence (IJCAI), pages 1025--1032, August 2003.
• 10: Reid Simmons , Richard Goodwin , Karen Zita Haigh , Sven Koenig , Joseph O'Sullivan, A layered architecture for office delivery robots, Proceedings of the first international conference on Autonomous agents, p.245-252, February 05-08, 1997, Marina del Rey, California, United States [doi>10.1145/267658.267723]
• 11: T. Smith and R. Simmons. Focused real-time dynamic programming for mdps: Squeezing more out of a heuristic. In Nat. Conf. on Artificial Intelligence (AAAI), 2006.
• 12: E. J. Sondik. The optimal control of partially observable Markov Decision Processes. PhD thesis, Stanford university, 1971.
• 13: M. Spaan and N. Vlassis. Perseus: Randomized point-based value iteration for pomdps. Journal of Artificial Intelligence Research, 24:195--220, 2005.
• 14: J. D. Williams, P. Poupart, and S. Young. Using factored partially observable markov decision processes with continuous observations for dialogue management. Technical report, Cambridge University Engineering Department Technical Report: CUED/F-INFENG/TR.520, March 2005.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.0 General

General Terms:
Algorithms, Design, Experimentation, Human Factors

Keywords:
HRI, pomdp, robot decision making