Integrated planning of robotic and computer vision based spatial reasoning tasks

ABSTRACT

This paper describes research that is designed to integrate computer vision with complex robot planning in order to achieve a system capable of autonomously reasoning in spatially reconfigurable environments. In its basic form, the computer vision based spatial reasoning system provides the capability to view objects of known structure and kinematic design and to reason about their spatial locations and orientations relative to a robotic manipulator. For the case of the specific robotic task panel to be discussed, the spatial reasoning system has knowledge of the structure and allowable motions of each of the substructures such as the movable doors, a drawer and a circular latch. This model based knowledge is used to direct an intelligent robot path planner toward accomplishing a final goal in which one of the substructures is manipulated or toward an intermediate goal such as repositioning the visual sensor for the purpose of obtaining better viewpoints so that more accurate visual reasoning can take place.

REFERENCES

• 1: Y. Hung, P. Yeh and D. Harwood, "Passive Ranging To Known Planar Point Sets", Proceedings of the IEEE International Conference On Robotics And Automation, St. Louis, Missouri, March 25-28, 1985.
• 2: R. A. Brooks, "Symbolic Reasoning Among 3-D Models and 2-D Images", Artificial Intelligence 1 7, August, 1981, pp. 285-348.
• 3: R. A. Brooks, "Model-Based Three-Dimensional Interpretations of Two-Dimensional Images", 1 E E E Transactions on Pattern Analysis and Machine Intelligence, PAMI-5, No. 2, March, 1983, pp. 140-149.
• 4: C. R. Weisbin , G. de Saussure , J. R. Einstein , F. G. Pin , E. Heer, Autonomous Mobile Robot Navigation and Learning, Computer, v.22 n.6, p.29-35, June 1989 [doi>10.1109/2.30718]
• 5: M. Goldstein, F. G. Pin, G. de Saussure and C. R. Weisbin, "3-D World Modeling Based on Combinatorial Geometry for Autonomous Robot Navigation", Proceedings of the 1987 IEEE International Conference on Robotics and A u t o m a t i o n,Raleigh, North Carolina, pp. 727-733.
• 6: M. Magee, W. J. Wolfe and B. Bloom, "Autonomous State Determination Using Vision Based Spatial Reasoning", Cybernetics and Systems Research, Kluwer Academic Press, London, 1988, pp. 909-916.
• 7: M. Magee, W. J. Wolfe, D. Mathis, and C. Weber-Sklair, "Model Based Spatial Reasoning for Hierarchically Organized Structured Objects", to appear in Advances in Spatial Reasoning, S. S. Chen (editor).
• 8: Michael Magee , William Hoff , Lance Gatrell , Martin Marietta , William Wolfe, Adaptive camera calibration in an industrial robotic environment, Proceedings of the 3rd international conference on Industrial and engineering applications of artificial intelligence and expert systems, p.242-251, June 1990, Charleston, South Carolina, United States [doi>10.1145/98784.98825]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Computer vision

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Modeling and recovery of physical attributes; Motion
      I.2.9 Robotics
          Subjects: Sensors

General Terms:
Design