Interactive 3D pointing device using mirror reflections

ABSTRACT

We propose a system that uses a camera and a mirror to input behaviour of a pointer in 3D space. Using direct and reflection images of the pointer obtained from single directional camera input, the system computes the 3D positions and the normal vector of the mirror simultaneously. Although the system can only input the "relative positions" of the pointer, in terms of 3D locations without scale factor, calibration of the mirror orientation is not needed. Thus, the system presents a very simple and inexpensive way of implementing an interaction device.

REFERENCES

• 1: Branco, V., Costa, A., and Ferriera, F. N. 1994. Sketching 3d models with 2d interaction devices. In Proceedings of Eurographics'94, vol. 13, 489--502.
• 2: Olivier Faugeras, Three-dimensional computer vision: a geometric viewpoint, MIT Press, Cambridge, MA, 1993
• 3: Jobson, D. J., Rahman, Z., and Woodell, G. A. 1995. Retinex image processing: Improved fidelity to direct visual observation. In Proceedings of the IS&T Fourth Color Imaging Conference: Color Science, Systems, and Applications, vol. 4, 124--125.
• 4: Kenneth, J., and Massie, T. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of ASME International Mechanical Engineering Expotion and Congress Chicago.
• 5: James Lane , Vali Lalioti, Interacting with reflections in virtual environments, Proceedings of the 1st international conference on Computer graphics, virtual reality and visualisation, November 05-07, 2001, Camps Bay, Cape Town, South Africa [doi>10.1145/513867.513887]
• 6: Longuet-Higgins, H. C. 1981. A computer algorithm for reconstructing a scene from two projections. Nature 293, 133--135.
• 7: Shoichi Hasegawa , Masahiro Ishii , Makoto Sato , Yasuharu Koike, Process Division in Haptic Display System, Proceedings of the Seventh International Conference on Parallel and Distributed Systems: Workshops, p.219, July 04-07, 2000
• 8: J. R. Smith, Field mice: extracting hand geometry from electric field measurements, IBM Systems Journal, v.35 n.3-4, p.587-608, 1996
• 9: Sugishita, S., Kondo, K., S., and H., Shimada, S. 1996. Sketch interpreter for geometric modelling. In Annals of Numerical Mathematics 3, 361--372.
• 10: Efraim Turban , Louis E. Frenzel, Expert Systems and Applied Artificial Intelligence, Prentice Hall Professional Technical Reference, 1992
• 11: Gang Xu , Zhengyou Zhang, Epipolar Geometry in Stereo, Motion, and Object Recognition: A Unified Approach, Kluwer Academic Publishers, Norwell, MA, 1996
• 12: Yonemoto, S., and Taniguchi, R. 2002. High-level human figure action control for vision-based real-time interaction. In Proceedings of Asian Conf. on Computer Vision.
• 13: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Primary Classification:
  B. Hardware
  B.4 INPUT/OUTPUT AND DATA COMMUNICATIONS
      B.4.2 Input/Output Devices
          Subjects: Channels and controllers

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Camera calibration

Keywords:
3D input, interactive pointing device, motion tracking, reflections