The design and implementation of a VR-architecture for smooth motion

ABSTRACT

We introduce an architecture for smooth motion in virtual environments. The system performs forward depth image warping to produce images at video refresh rates. In addition to color and depth, our 3D warping approach records per-pixel motion information during rendering of the three-dimensional scene. These enhanced depth images are used to perform per-pixel advection, which considers object motion and view changes. Our dual graphics card architecture is able to render the 3D scene at the highest possible frame rate on one graphics card, while doing the depth image warping on a second graphics engine at video refresh rate.

This architecture allows us to compensate for visual artifacts, also called motion judder, arising when the rendering frame rate is lower than the video refresh rate. The evaluation of our method shows motion judder can be effectively removed.

REFERENCES

• 1: Allen Bierbaum , Christopher Just , Patrick Hartling , Kevin Meinert , Albert Baker , Carolina Cruz-Neira, VR Juggler: A Virtual Platform for Virtual Reality Application Development, Proceedings of the Virtual Reality 2001 Conference (VR'01), p.89, March 13-17, 2001
• 2: Bles, W., and Wertheim, A. 2000. Appropriate use of virtual environments to minimise motion sickness. RTO MP58, 7.1--7.9.
• 3: Liere, R., and Mulder, J. 1999. PVR - an architecture for portable VR applications. In EGVE '99 Conference Proceedings, 125--135.
• 4: Marsh, D. 2001. Temporal rate conversion. Microsoft archived paper: http://www.microsoft.com/whdc/archive/TempRate.mspx.
• 5: Chris Shaw , Mark Green , Jiandong Liang , Yunqi Sun, Decoupled simulation in virtual reality with the MR toolkit, ACM Transactions on Information Systems (TOIS), v.11 n.3, p.287-317, July 1993 [doi>10.1145/159161.173948]
• 6: Ziegler, G., Tevs, A., Theobalt, C., and Seidel, H.-P. 2006. On-the-fly point clouds through histogram pyramids. In 11th International Fall Workshop on Vision, Modeling and Visualization 2006 (VMV2006), Eurographics, 137--144.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Motion

Keywords:
VR, dual-GPU, judder, motion estimation, smooth motion, video refresh rate, warping