Life-sized projector-based dioramas

ABSTRACT

We introduce an idea and some preliminary results for a new projector-based approach to re-creating real and imagined sites. Our goal is to achieve re-creations that are both visually and spatially realistic, providing a small number of relatively unencumbered users with a strong sense of immersion as they jointly walkaround the virtual site.Rather than using head-mounted or general-purpose projector-based displays, our idea builds on previous projector-based work on spatially-augmented realityand shader lamps. Using simple white building blocks we construct a static physical model that approximates the size, shape, and spatial arrangementof the site. We then project dynamic imagery onto the blocks, transforming the lifeless physical model into a visually faithful reproduction of the actual site. Some advantages of this approach include wide field-of-view imagery, real walking around the site, reduced sensitivity to tracking errors, reduced sensitivity to system latency, auto-stereoscopic vision, the natural addition of augmented virtualityand the provision of haptics.In addition to describing the major challenges to (and limitations of) this vision, in this paper we describe some short-term solutions and practical methods, and we present some proof-of-concept results.

REFERENCES

• 1: http://www.3rdtech.com
• 2: Patricia L. Alfano and George F. Michel. Restricting the field of view: perceptual and performance effects. Perceptual and Motor Skills, 70(1):35-45, 1990.
• 3: Kevin Wayne Arthur , Frederick P. Brooks, Jr., Effects of field of view on performance with head-mounted displays, 2000
• 4: Frederick P. Brooks, What's Real About Virtual Reality?, IEEE Computer Graphics and Applications, v.19 n.6, p.16-27, November 1999 [doi>10.1109/38.799723]
• 5: Frederick P. Brooks, Jr. Static Haptics. Personal communication, 1999.
• 6: Carolina Cruz-Neira , Daniel J. Sandin , Thomas A. DeFanti, Surround-screen projection-based virtual reality: the design and implementation of the CAVE, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.135-142, September 1993 [doi>10.1145/166117.166134]
• 7: Brian Curless , Marc Levoy, A volumetric method for building complex models from range images, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.303-312, August 1996 [doi>10.1145/237170.237269]
• 8: Hubert Dolezal. Living in a world transformed: perceptual and performatory adaptation to visual distortion. Academic Press, 1982.
• 9: Shachar Fleishman , Daniel Cohen-Or , Dani Lischinski, Automatic Camera Placement for Image-Based Modeling, Proceedings of the 7th Pacific Conference on Computer Graphics and Applications, p.12, October 05-07, 1999
• 10: Olivier Faugeras, Three-dimensional computer vision: a geometric viewpoint, MIT Press, Cambridge, MA, 1993
• 11: Michael Garland , Paul S. Heckbert, Surface simplification using quadric error metrics, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.209-216, August 1997 [doi>10.1145/258734.258849]
• 12: Mark Hereld , Ivan R. Judson , Rick L. Stevens, Tutorial: Introduction to Building Projection-based Tiled Display Systems, IEEE Computer Graphics and Applications, v.20 n.4, p.22-28, July 2000 [doi>10.1109/38.851746]
• 13: Brent Edward Insko , Frederick P. Brooks, Jr., Passive haptics significantly enhances virtual environments, 2001
• 14: H. W. Leibowitz. Recent advances in our understanding of peripheral vision and some implications. Proceedings of the 30th Annual Meeting of the Human Factors Society, pp. 605- 607, 1986.
• 15: Marc Levoy , Kari Pulli , Brian Curless , Szymon Rusinkiewicz , David Koller , Lucas Pereira , Matt Ginzton , Sean Anderson , James Davis , Jeremy Ginsberg , Jonathan Shade , Duane Fulk, The digital Michelangelo project: 3D scanning of large statues, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.131-144, July 2000 [doi>10.1145/344779.344849]
• 16: Aditi Majumder , Zhu He , Herman Towles , Greg Welch, Achieving color uniformity across multi-projector displays, Proceedings of the conference on Visualization '00, p.117-124, October 2000, Salt Lake City, Utah, United States
• 17: David K. McAllister, Lars Nyland, Voicu Popescu, Anselmo Lastra, Chris McCue. Real-Time Rendering of Real World Environments. Proceedings of the 10th Eurographics Workshop on Rendering, 1999.
• 18: M. Naimark. Displacements. An exhibit at the San Francisco Museum of Modern Art, San Francisco, CA (USA), 1984.
• 19: Ramesh Raskar , Greg Welch , Kok-Lim Low , Deepak Bandyopadhyay, Shader Lamps: Animating Real Objects With Image-Based Illumination, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.89-102, June 25-27, 2001
• 20: Ramesh Raskar , Greg Welch , Matt Cutts , Adam Lake , Lev Stesin , Henry Fuchs, The office of the future: a unified approach to image-based modeling and spatially immersive displays, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.179-188, July 1998 [doi>10.1145/280814.280861]
• 21: Ramesh Raskar, Matt Cutts, Greg Welch, Wolfgang Stuerzlinger. Efficient Image Generation for Multiprojector and Multisurface Displays. Proceedings of the 9th Eurographics Workshop on Rendering, 1998.
• 22: Ramesh Raskar , Michael S. Brown , Ruigang Yang , Wei-Chao Chen , Greg Welch , Herman Towles , Brent Seales , Henry Fuchs, Multi-projector displays using camera-based registration, Proceedings of the conference on Visualization '99: celebrating ten years, p.161-168, October 1999, San Francisco, California, United States
• 23: http://www.reddiform.com/
• 24: Anthony Steed , Emmanuel Frécon , Anneli Avatare , Duncan Pemberton , Gareth Smith, The London Travel Demonstrator, Proceedings of the ACM symposium on Virtual reality software and technology, p.50-57, December 20-22, 1999, London, United Kingdom [doi>10.1145/323663.323671]
• 25: Wolfgang Stuerzlinger, Imaging all visible surfaces, Proceedings of the 1999 conference on Graphics interface '99, p.115-122, September 1999, Kingston, Ontario, Canada
• 26: Susuma Tachi, T. Maeda, R. Hirata, H. Hoshion. A Construction Method of Virtual Haptic Space. Proceedings of the 4th International Conference on Artificial Reality and Tele- Existence (ICAT'94), 1994.
• 27: Martin Usoh , Kevin Arthur , Mary C. Whitton , Rui Bastos , Anthony Steed , Mel Slater , Frederick P. Brooks, Jr., Walking > walking-in-place > flying, in virtual environments, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.359-364, July 1999 [doi>10.1145/311535.311589]
• 28: Greg Welch , Henry Fuchs , Ramesh Raskar , Herman Towles , Michael S. Brown, Projected Imagery in Your "Office of the Future", IEEE Computer Graphics and Applications, v.20 n.4, p.62-67, July 2000 [doi>10.1109/38.851752]
• 29: Daniel N. Wood , Daniel I. Azuma , Ken Aldinger , Brian Curless , Tom Duchamp , David H. Salesin , Werner Stuetzle, Surface light fields for 3D photography, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.287-296, July 2000 [doi>10.1145/344779.344925]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.8 Applications

Keywords:
augmented virtuality, diorama, immersive visualization, multiprojector display system, shader lamp, spatially-augmented reality, user interface, virtual environment, virtual reality