iLamps: geometrically aware and self-configuring projectors

ABSTRACT

Projectors are currently undergoing a transformation as they evolve from static output devices to portable, environment-aware, communicating systems. An enhanced projector can determine and respond to the geometry of the display surface, and can be used in an ad-hoc cluster to create a self-configuring display. Information display is such a prevailing part of everyday life that new and more flexible ways to present data are likely to have significant impact. This paper examines geometrical issues for enhanced projectors, relating to customized projection for different shapes of display surface, object augmentation, and co-operation between multiple units.We introduce a new technique for adaptive projection on non-planar surfaces using conformal texture mapping. We describe object augmentation with a hand-held projector, including interaction techniques. We describe the concept of a display created by an ad-hoc cluster of heterogeneous enhanced projectors, with a new global alignment scheme, and new parametric image transfer methods for quadric surfaces, to make a seamless projection. The work is illustrated by several prototypes and applications.

REFERENCES

• 1: Agarwal, P., Amenta, N., Aronov, B., and Sharir, M. 1996. Largest Placements and Motion Planning of a Convex Polygon. In 2nd International Workshop on Algorithmic Foundation of Robotics, 1996, 28--37.
• 2: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, September 1993 [doi>10.1145/166117.166126]
• 3: Oliver Bimber , Stephen M. Gatesy , Lawrence M. Witmer , Ramesh Raskar , L. Miguel Encarnação, Merging Fossil Specimens with Computer-Generated Information, Computer, v.35 n.9, p.25-30, September 2002 [doi>10.1109/MC.2002.1033024]
• 4: Michael S. Brown , W. Brent Seales, A Practical and Flexible Tiled Display System, Proceedings of the 10th Pacific Conference on Computer Graphics and Applications, p.194, October 09-11, 2002
• 5: Canesta, 2002. Miniature Laser Projector Keyboard. http://www.canesta.com, Cited December 2002.
• 6: Yuqun Chen , Douglas W. Clark , Adam Finkelstein , Timothy C. Housel , Kai Li, Automatic alignment of high-resolution multi-projector display using an un-calibrated camera, Proceedings of the conference on Visualization '00, p.125-130, October 2000, Salt Lake City, Utah, United States
• 7: Han Chen , Rahul Sukthankar , Grant Wallace , Kai Li, Scalable alignment of large-format multi-projector displays using camera homography trees, Proceedings of the conference on Visualization '02, October 27-November 01, 2002, Boston, Massachusetts
• 8: Geoffrey Cross , Andrew Zisserman, Quadric Reconstruction from Dual-Space Geometry, Proceedings of the Sixth International Conference on Computer Vision, p.25, January 04-07, 1998
• 9: James L. Crowley , Joëlle Coutaz , François Bérard, Perceptual user interfaces: things that see, Communications of the ACM, v.43 n.3, p.54-ff., March 2000 [doi>10.1145/330534.330540]
• 10: J. Davis, Mosaics of Scenes with Moving Objects, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.354, June 23-25, 1998
• 11: Mark Hereld , Ivan R. Judson , Rick L. Stevens, Tutorial: Introduction to Building Projection-based Tiled Display Systems, IEEE Computer Graphics and Applications, v.20 n.4, p.22-28, July 2000 [doi>10.1109/38.851746]
• 12: Greg Humphreys , Matthew Eldridge , Ian Buck , Gordan Stoll , Matthew Everett , Pat Hanrahan, WireGL: a scalable graphics system for clusters, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.129-140, August 2001 [doi>10.1145/383259.383272]
• 13: Jarvis, K. 1997. Real Time 60Hz Distortion Correction on a Silicon Graphics IG. Real Time Graphics 5, 7 (Feb.), 6--7.
• 14: Christopher Jaynes , Stephen Webb , R. Matt Steele , Michael Brown , W. Brent Seales, Dynamic shadow removal from front projection displays, Proceedings of the conference on Visualization '01, October 21-26, 2001, San Diego, California
• 15: Jenoptik, 2002. Laser Projector. http://www.jenoptik.com, Cited December 2002.
• 16: Jacob Hartman , Tony Levas, Interacting with Steerable Projected Displays, Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, p.402, May 20-21, 2002
• 17: Bruno Lévy , Sylvain Petitjean , Nicolas Ray , Jérome Maillot, Least squares conformal maps for automatic texture atlas generation, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 18: Chien-Ping Lu , Gregory D. Hager , Eric Mjolsness, Fast and Globally Convergent Pose Estimation from Video Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.6, p.610-622, June 2000 [doi>10.1109/34.862199]
• 19: Majumder, A., He, Z., Towles, H., and Welch, G. 2000. Color Calibration of Projectors for Large Tiled Displays. In IEEE Visualization 2000, 102--108.
• 20: Claudio S. Pinhanez, The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces, Proceedings of the 3rd international conference on Ubiquitous Computing, p.315-331, September 30-October 02, 2001, Atlanta, Georgia, USA
• 21: Raskar, R., and Beardsley, P. 2001. A Self Correcting Projector. In IEEE Computer Vision and Pattern Recognition (CVPR), 626--631.
• 22: Ramesh Raskar , Greg Welch , Matt Cutts , Adam Lake , Lev Stesin , Henry Fuchs, The office of the future: a unified approach to image-based modeling and spatially immersive displays, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.179-188, July 1998 [doi>10.1145/280814.280861]
• 23: Ramesh Raskar , Michael S. Brown , Ruigang Yang , Wei-Chao Chen , Greg Welch , Herman Towles , Brent Seales , Henry Fuchs, Multi-projector displays using camera-based registration, Proceedings of the conference on Visualization '99: celebrating ten years, p.161-168, October 1999, San Francisco, California, United States
• 24: Ramesh Raskar , Greg Welch , Kok-Lim Low , Deepak Bandyopadhyay, Shader Lamps: Animating Real Objects With Image-Based Illumination, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.89-102, June 25-27, 2001
• 25: Raskar, R., VanBaar, J., and Chai, X. 2002. A Low Cost Projector Mosaic with Fast Registration. In Fifth Asian Conference on Computer Vision, 114--119.
• 26: Ramesh Raskar, Immersive Planar Display Using Roughly Aligned Projectors, Proceedings of the IEEE Virtual Reality 2000 Conference, p.109, March 18-22, 2000
• 27: Jun Rekimoto , Katashi Nagao, The world through the computer: computer augmented interaction with real world environments, Proceedings of the 8th annual ACM symposium on User interface and software technology, p.29-36, November 15-17, 1995, Pittsburgh, Pennsylvania, United States [doi>10.1145/215585.215639]
• 28: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 29: Jun Rekimoto, A multiple device approach for supporting whiteboard-based interactions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.344-351, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274692]
• 30: Rudrajit Samanta , Jiannan Zheng , Thomas Funkhouser , Kai Li , Jaswinder Pal Singh, Load balancing for multi-projector rendering systems, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware, p.107-116, August 08-09, 1999, Los Angeles, California, United States [doi>10.1145/311534.311584]
• 31: Amnon Shashua , Sebastian Toelg, The Quadric Reference Surface: Theory and Applications, International Journal of Computer Vision, v.23 n.2, p.185-198, June 1997 [doi>10.1023/A:1007962930529]
• 32: Siemens, 2002. Siemens Mini Beamer. http://w4.siemens.de/en2/html/press//newsdesk_archive/2002/-foe02121b.html, Cited December 2002.
• 33: Sukthankar, R., Stockton, R., and Mullin, P. 2001. Smarter Presentations: Exploiting Homography in Camera-Projector Systems. In International Conference on Computer Vision, 82--87.
• 34: Symbol, 2002. Laser Projection Display. http://www.symbol.com/products/oem/lpd.html, Cited December 2002.
• 35: Travis, A., Payne, F., Zhong, J., and Moore, J. 2002. Flat panel display using projection within a wedge-shaped waveguide. http://ds.dial.pipex.com/cam3d/technology/technology01.html, Cited December 2002.
• 36: Trimension Systems Ltd, 2002. http://www.trimension-inc.com/, Cited Dec 2002.
• 37: John Underkoffler , Brygg Ullmer , Hiroshi Ishii, Emancipated pixels: real-world graphics in the luminous room, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.385-392, July 1999 [doi>10.1145/311535.311593]
• 38: Watson, B., and Hodges, L. 1989. A Fast Algorithm for Rendering Quadratic Curves on Raster Displays. In Proc. 27th Annual SE ACM Conference, 160--165.
• 39: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]
• 40: Wexler, Y., and Shashua, A. 1999. Q-warping: Direct Computation of Quadratic Reference Surfaces. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June, 1999, 333--338.
• 41: Ruigang Yang , David Gotz , Justin Hensley , Herman Towles , Michael S. Brown, PixelFlex: a reconfigurable multi-projector display system, Proceedings of the conference on Visualization '01, October 21-26, 2001, San Diego, California
• 42: Yotsukura, T., Morishima, S., Nielsen, F., Binsted, K., and Pinhanez, C. 2002. Hyper Mask - Talking Head Projected onto Real Object. The Visual Computer 18, 2, 111--120.

INDEX TERMS

Primary Classification:
  B. Hardware
  B.4 INPUT/OUTPUT AND DATA COMMUNICATIONS
      B.4.2 Input/Output Devices
          Subjects: Image display

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Imaging geometry

Keywords:
ad-hoc clusters, augmented reality, calibration, projector, quadric transfer, seamless display