Wearable virtual tablet: fingertip drawing on a portable plane-object using an active-infrared camera

ABSTRACT

We propose the Wearable Virtual Tablet (WVT), where a user can draw a locus on a common object with a plane surface (e.g., a notebook and a magazine) with a fingertip. Our previous WVT[1], however, could not work on a plane surface with complicated texture patterns: Since our WVT employs an active-infrared camera and the reflected infrared rays vary depending on patterns on a plane surface, it is difficult to estimate the motions of a fingertip and a plane surface from an observed infrared-image. In this paper, we propose a method to detect and track their motions without interference from colored patterns on a plane surface. (1) To find the region of a plane object in the observed image, four edge lines that compose a rectangular object can be easily extracted by employing the properties of an active-infrared camera. (2) To precisely determine the position of a fingertip, we utilize a simple finger model that corresponds to a finger edge independent of its posture. (3) The system can distinguish whether or not a fingertip touches a plane object by analyzing image intensities in the edge region of the fingertip.

REFERENCES

• 1: A. Terabe, N. Ukita, Y. Kono, and M. Kidode, "Wearable Virtual Tablet: Fingertip Drawing Interface using an Active-Infrared Camera", Proc. of Workshop on Machine Vision Applications 2002, pp.98--101, 2002.
• 2: Masaaki Fukumoto , Yoshinobu Tonomura, “Body coupled FingerRing”: wireless wearable keyboard, Proceedings of the SIGCHI conference on Human factors in computing systems, p.147-154, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258636]
• 3: Andrew Vardy , John Robinson , Li-Te Cheng, The WristCam as Input Device, Proceedings of the 3rd IEEE International Symposium on Wearable Computers, p.199, October 18-19, 1999
• 4: H. Sasaki, T. Kuroda, Y. Manabe and K. Chihara, "HIT-Wear: A Menu System Superimposing on a Human Hand for Wearable Computers", in Proc. of International Conference on Artificial Reality and Teleexistence (ICAT 99), pp.146--153, 1999.
• 5: Maribeth Gandy , Thad Starner , Jake Auxier , Daniel Ashbrook, The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring, Proceedings of the 4th IEEE International Symposium on Wearable Computers, p.87, October 18-21, 2000
• 6: Y. Yamamoto and I. Shiio, "A Simple AR System for Casual Communication", in Proc. of Workshop on Interactive Systems and Software (WISS 2000), pp.117--124, 2000. (Written in Japanese)
• 7: Y. Muraoka and T. Sonoda, "A Letter Input System of HandWriting Gesture - A User Interface for Wearable Computers -", in Proc of Interaction 2001, pp.3--10, 2001. (Written in Japanese)
• 8: Robert W. Lindeman , John L. Sibert , James K. Hahn, Towards usable VR: an empirical study of user interfaces for immersive virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.64-71, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302995]
• 9: H. Koshimizu and M. Numada, "On a Basic Consideration of the Warp Model of Hough Transform", in Proc of Machine Vision Application (MVA'92), pp.7--9, 1992.
• 10: R. Y. Tsai: "A efficient and accurate camera calibration technique for 3D machine vision", in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 86), pp.364--374, 1986.
• 11: Kenji Oka , Yoichi Sato , Hideki Koike, Real-Time Tracking of Multiple Fingertips and Gesture Recognition for Augmented Desk Interface Systems, Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, p.429, May 20-21, 2002
• 12: N. Guil and E. L. Zapata: "Lower order circle and ellipse Hough Transform", Pattern Recognition, Vol.30, No.10, pp. 1729--1744, 1997.
• 13: N. Otsu: "A Threshold Selection Method from Gray-Level Histograms", IEEE Transaction on Systems, Man and Cybernetics, SMC-9, No.1, pp. 62--66, 1979.
• 14: S. Kumar and J. Segen: "Shadow Gestures: 3D Hand Pose Estimation using a Single Camera", in Proc. of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR99), pp.479--485, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Algorithms

Keywords:
active-infrared camera, finger-drawing interface, wearable computer