iProCam: a lens-sharing projector-camera system for augmented reality applications

ABSTRACT

Projector-based augmented reality techniques are expected to become a practical display solution for hand-held devices in the near future. A new problem in the new environment is that neither a projector nor a projection surface is fixed in space . This means that calibration between the two coordinate systems of a projector and a camera will have to be no more a one-time setup procedure but a dynamic process. The best solution will be to remove the need for calibration from the beginning by having a projector and a camera share the same lens system. The iProCam is a projector-camera system that realized this idea using a beam splitter and a time-multiplexing scheme. Sharing the same lens system also makes it possible to keep a projector in focus by keeping a camera in focus. This paper presents the implementation details of an iProCam prototype and the results of experiments conducted to verify the concept.

REFERENCES

• 1: Berard, F. The Magic Table: computer-vision based augmentation of a whiteboard for creative meeting. CD--ROM Proc. of ICCV, IEEE Computer Society (2003).
• 2: Borkowski, S., Riff, O., and Corwley, J. L. Projecting rectified images in an augmented environment. CD--ROM Proc. of ICCV, IEEE Computer Society (2003).
• 3: Choi, K., and Lee, G. LaserPen: a new pointing device for a beam projector. In Proc. of VECIMS 2003, IEEE Computer Society (2003), 132--137.
• 4: Choi, K., Lee, J., and Ko. S. New autofocus technique using the frequency selective weighted median filter for video cameras, IEEE Trans. On Consumer Electronics,all45, 3 (1999), 820--827.
• 5: James L. Crowley , Joëlle Coutaz , François Bérard, Perceptual user interfaces: things that see, Communications of the ACM, v.43 n.3, p.54-ff., March 2000 [doi>10.1145/330534.330540]
• 6: Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system, ACM Transactions on Computer-Human Interaction (TOCHI), v.8 n.4, p.307-322, December 2001 [doi>10.1145/504704.504706]
• 7: Tek-Jin Nam , Woohun Lee, Integrating hardware and software: augmented reality based prototyping method for digital products, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766092]
• 8: Claudio S. Pinhanez, The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces, Proceedings of the 3rd international conference on Ubiquitous Computing, p.315-331, September 30-October 02, 2001, Atlanta, Georgia, USA
• 9: Ramesh Raskar , Jeroen van Baar , Paul Beardsley , Thomas Willwacher , Srinivas Rao , Clifton Forlines, iLamps: geometrically aware and self-configuring projectors, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 10: Ramesh Raskar , Paul Beardsley , Jeroen van Baar , Yao Wang , Paul Dietz , Johnny Lee , Darren Leigh , Thomas Willwacher, RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 11: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 12: John Underkoffler , Brygg Ullmer , Hiroshi Ishii, Emancipated pixels: real-world graphics in the luminous room, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.385-392, July 1999 [doi>10.1145/311535.311593]
• 13: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.m MISCELLANEOUS

General Terms:
Design

Keywords:
autofocusing, calibration, lens-sharing, projector-camera system