Vision based GUI for interactive mobile robots

ABSTRACT

Interactive mobile robots are an active area of research. This paper presents a framework for designing a real-time vision based hand-body gesture user interface for such robots. The said framework works in real world lighting conditions, with complex background, and can handle intermittent motion of the camera. The input signal is captured by using a singular monocular color camera. Vision is the only feedback sensor being used. It is assumed that the gesturer is wearing clothes that are slightly different from the background. We have tested this framework on a gesture database consisting of 11 hand-body gestures and have recorded recognition accuracy up to 90%.

REFERENCES

• 1: Ying Wu , Thomas S. Huang, Vision-Based Gesture Recognition: A Review, Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction, p.103-115, March 17-19, 1999
• 2: Billard, A., "Robota: Clever Toy and Educational Tool," Robotics & Autonomous Systems, 42, pp. 259--269, 2003.
• 3: Kim J. G., Chang H., Kim J. W., and Kim H., "Efficient camera motion characterization for mpeg video indexing," Proceedings of 2000 IEEE International Conference on Multimedia and Expo., pp. 1171--1174, New York, NY, July 2000.
• 4: S. Birchfield, Elliptical Head Tracking Using Intensity Gradients and Color Histograms, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.232, June 23-25, 1998
• 5: Gary R. Bradski , James W. Davis, Motion segmentation and pose recognition with motion history gradients, Machine Vision and Applications, v.13 n.3, p.174-184, July 2002 [doi>10.1007/s001380100064]
• 6: Mohammed Waleed Kadous, Temporal classification: extending the classification paradigm to multivariate time series, 2002

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

General Terms:
Algorithms, Design

Keywords:
gesture user interaction (GUI), interactive robots