The effects of virtual reality, augmented reality, and motion parallax on egocentric depth perception

ABSTRACT

As the use of virtual and augmented reality applications becomes more common, the need to fully understand how observers perceive spatial relationships grows more critical. One of the key requirements in engineering a practical virtual or augmented reality system is accurately conveying depth and layout. This requirement has frequently been assessed by measuring judgments of egocentric depth. These assessments have shown that observers in virtual reality (VR) perceive virtual space as compressed relative to the real-world, resulting in systematic underestimations of egocentric depth. Previous work has indicated that similar effects may be present in augmented reality (AR) as well.

This paper reports an experiment that directly measured egocentric depth perception in both VR and AR conditions; it is believed to be the first experiment to directly compare these conditions in the same experimental framework. In addition to VR and AR, two control conditions were studied: viewing real-world objects, and viewing real-world objects through a head-mounted display. Finally, the presence and absence of motion parallax was crossed with all conditions. Like many previous studies, this one found that depth perception was underestimated in VR, although the magnitude of the effect was surprisingly low. The most interesting finding was that no underestimation was observed in AR.

REFERENCES

• 1: Barnett, V., and Lewis, T. 1994. Outliers in Statistical Data, 3rd ed. Wiley Series in Probability & Statistics. John Wiley & Sons.
• 2: Beall, A. C., Loomis, J. M., Philbeck, J. W., and Fikes, T. G. 1995. Absolute motion parallax weakly determines visual scale in real and virtual environments. In Proceedings SPIE Human Vision, Visual Processing, and Digital Display, SPIE, 288--297.
• 3: Durgin, F. H., Fox, L. F., Lewis, J., and Walley, K. A. 2002. Perceptuomotor adaptation: More than meets the eye. Abstracts of the Psychonomic Society 7, 103--104.
• 4: Helen H. Hu , Amy A. Gooch , William B. Thompson , Brian E. Smits , John J. Rieser , Peter Shirley, Visual cues for imminent object contact in realistic virtual environment, Proceedings of the conference on Visualization '00, p.179-185, October 2000, Salt Lake City, Utah, United States
• 5: Victoria Interrante , Brian Ries , Lee Anderson, Distance Perception in Immersive Virtual Environments, Revisited, Proceedings of the IEEE conference on Virtual Reality, p.3-10, March 25-29, 2006 [doi>10.1109/VR.2006.52]
• 6: Knapp, J. M. 1999. The Visual Perception of Egocentric Distance in Virtual Environments. PhD thesis, University of California, Santa Barbara, Department of Psychology.
• 7: Catherine Zanbaka , J. Edward Swan II , Harvey S. Smallman, Objective Measures for the Effectiveness of Augmented Reality, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.287-288, March 12-16, 2005 [doi>10.1109/VR.2005.59]
• 8: Loomis, J. M., and Knapp, J. M. 2003. Visual perception of egocentric distance in real and virtual environments. In Virtual and Adaptive Environments: Applications, Implications, and Human Performance Issues, L. J. Hettinger and J. W. Haas, Eds. Lawrence Erlbaum Associates, Mahwah, NJ, USA, 21--46.
• 9: Ross Messing , Frank H. Durgin, Distance Perception and the Visual Horizon in Head-Mounted Displays, ACM Transactions on Applied Perception (TAP), v.2 n.3, p.234-250, July 05 [doi>10.1145/1077399.1077403]
• 10: Jodie M. Plumert , Joseph K. Kearney , James F. Cremer , Kara Recker, Distance perception in real and virtual environments, ACM Transactions on Applied Perception (TAP), v.2 n.3, p.216-233, July 05 [doi>10.1145/1077399.1077402]
• 11: Rolland, J. P., Gibson, W., and Ariely, D. 1995. Towards quantifying depth and size perception in virtual environments. Presence: Teleoperators and Virtual Environments 4, 1, 24--49.
• 12: Sekuler, R., and Blake, R. 2001. Perception, 4th ed. McGraw-Hill.
• 13: J. Edward II Swan , Mark A. Livingston , Harvey S. Smallman , Dennis Brown , Yohan Baillot , Joseph L. Gabbard , Deborah Hix, A Perceptual Matching Technique for Depth Judgments in Optical, See-Through Augmented Reality, Proceedings of the IEEE conference on Virtual Reality, p.19-26, March 25-29, 2006 [doi>10.1109/VR.2006.13]
• 14: J. Edward Swan II , Adam Jones , Eric Kolstad , Mark A. Livingston , Harvey S. Smallman, Egocentric Depth Judgments in Optical, See-Through Augmented Reality, IEEE Transactions on Visualization and Computer Graphics, v.13 n.3, p.429-442, May 2007 [doi>10.1109/TVCG.2007.1035]
• 15: William B. Thompson , Peter Willemsen , Amy A. Gooch , Sarah H. Creem-Regehr , Jack M. Loomis , Andrew C. Beall, Does the quality of the computer graphics matter when judging distances in visually immersive environments, Presence: Teleoperators and Virtual Environments, v.13 n.5, p.560-571, October 2004 [doi>10.1162/1054746042545292]
• 16: Peter Willemsen , Amy A. Gooch, Perceived Egocentric Distances in Real, Image-Based, and Traditional Virtual Environments, Proceedings of the IEEE Virtual Reality Conference 2002, p.275, March 24-28, 2002
• 17: Peter Willemsen , Mark B. Colton , Sarah H. Creem-Regehr , William B. Thompson, The effects of head-mounted display mechanics on distance judgments in virtual environments, Proceedings of the 1st Symposium on Applied perception in graphics and visualization, August 07-08, 2004, Los Angeles, California [doi>10.1145/1012551.1012558]
• 18: Witmer, B. G., and Sadowski, W. 1998. Nonvisually guided locomotion to a previously viewed target in real and virtual environments. Human Factors 40, 3, 478--488.
• 19: Christine Ziemer , Jodie Plumert , James Cremer , Joseph Kearney, Making distance judgments in real and virtual environments: does order make a difference?, Proceedings of the 3rd symposium on Applied perception in graphics and visualization, July 28-29, 2006, Boston, Massachusetts [doi>10.1145/1140491.1140530]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Keywords:
augmented reality, depth perception, motion parallax, virtual reality