Geometrically correct imagery for teleconferencing

ABSTRACT

Current camera-monitor teleconferencing applications produce unrealistic imagery and break any sense of presence for the participants. Other capture/display technologies can be used to provide more compelling teleconferencing. However, complex geometries in capture/display systems make producing geometrically correct imagery difficult. It is usually impractical to detect, model and compensate for all effects introduced by the capture/display system. Most applications simply ignore these issues and rely on the user acceptance of the camera-monitor paradigm. This paper presents a new and simple technique for producing geometrically correct imagery for teleconferencing environments. The necessary image transformations are derived by finding a mapping between a capture and display device for a fixed viewer location. The capture/display relationship is computed directly in device coordinates and completely avoids the need for any intermediate, complex representations of screen geometry, capture and display distortions, and viewer location. We describe our approach and demonstrate it via several prototype implementations that operate in real-time and provide a substantially more compelling sense of presence than the standard teleconferencing paradigm.

REFERENCES

• 1: C_Jruz-Neria C., D.J. Sandin, and T.A. DeFanti. Surround-screen projection-based virtal reality: The design and implementation of the CAVE. Computer Graphics, SIC GRAPH Annual Conference Proceedings, 1994.
• 2: Hans Eriksson, MBONE: the multicast backbone, Communications of the ACM, v.37 n.8, p.54-60, Aug. 1994 [doi>10.1145/179606.179627]
• 3: Jefferson Han , Brian Smith, CU-SeeMe VR immersive desktop teleconferencing, Proceedings of the fourth ACM international conference on Multimedia, p.199-207, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244199]
• 4: Hewitt K. Desktop video conferencing product survey. http ://www3. ncsu. ~du/dox/video.
• 5: Kimiya Yamaashi , Jeremy R. Cooperstock , Tracy Narine , William Buxton, Beating the limitations of camera-monitor mediated telepresence with extra eyes, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.50-57, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238402]
• 6: Trimensions Ltd. http://www.trimension-inc.com.
• 7: Altschuler M.D., B.R. Altschuler. and J. Taboada. Measuring surfaces space-coded bv a laser-projected dot matrix. Imaging Application for Automated Industrial Inspection, 1979.
• 8: Ramesh Raskar , Greg Welch , Matt Cutts , Adam Lake , Lev Stesin , Henry Fuchs, The office of the future: a unified approach to image-based modeling and spatially immersive displays, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.179-188, July 1998 [doi>10.1145/280814.280861]
• 9: Ramesh Raskar , Michael S. Brown , Ruigang Yang , Wei-Chao Chen , Greg Welch , Herman Towles , Brent Seales , Henry Fuchs, Multi-projector displays using camera-based registration, Proceedings of the conference on Visualization '99: celebrating ten years, p.161-168, October 1999, San Francisco, California, United States
• 10: Raskar R., G. Welch, and H. Fuchs. Seamless projection overlaps using image warping and intensity blending. In dth Annual Conference on Visual Systems and Mttltimedia, November 1998.
• 11: Shree K. Nayar, Catadioptric Omnidirectional Camera, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.482, June 17-19, 1997
• 12: Steven McCanne , Van Jacobson, vic: a flexible framework for packet video, Proceedings of the third ACM international conference on Multimedia, p.511-522, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215315]
• 13: Kawanishi T., K. Yamazawa, H. lwasa, H. Takemura, and N. Yokoya. Generation of high resolution stereo panoramic images by omnidirectional sensor using hexagonal pyramidal mirrors. In ICPR 'gg, 1994.
• 14: Nalwa Vic. His camera won't turn heads. http ://www.lucent. com/ideas 2/in novat ions/docs/nalwa.html.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS

General Terms:
Design, Experimentation, Theory

Keywords:
graphics, immersive display, real-time, teleconference, telepresence, video conference