The benefits of using a walking interface to navigate virtual environments

ABSTRACT

Navigation is the most common interactive task performed in three-dimensional virtual environments (VEs), but it is also a task that users often find difficult. We investigated how body-based information about the translational and rotational components of movement helped participants to perform a navigational search task (finding targets hidden inside boxes in a room-sized space). When participants physically walked around the VE while viewing it on a head-mounted display (HMD), they then performed 90% of trials perfectly, comparable to participants who had performed an equivalent task in the real world during a previous study. By contrast, participants performed less than 50% of trials perfectly if they used a tethered HMD (move by physically turning but pressing a button to translate) or a desktop display (no body-based information). This is the most complex navigational task in which a real-world level of performance has been achieved in a VE. Behavioral data indicates that both translational and rotational body-based information are required to accurately update one's position during navigation, and participants who walked tended to avoid obstacles, even though collision detection was not implemented and feedback not provided. A walking interface would bring immediate benefits to a number of VE applications.

REFERENCES

• 1: Alfano, P. L. and Michel, G. F. 1990. Restricting the field of view: Perceptual and performance effects. Perceptual Motor Skills 70, 35--45.
• 2: Niels H. Bakker , Peter J. Werkhoven , Peter O. Passenier, The Effects of Proprioceptive and Visual Feedback on Geographical Orientation in Virtual Environments, Presence: Teleoperators and Virtual Environments, v.8 n.1, p.36-53, February 1999 [doi>10.1162/105474699566035]
• 3: Doug A. Bowman , Ernst Kruijff , Joseph J. LaViola , Ivan Poupyrev, 3D User Interfaces: Theory and Practice, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 2004
• 4: Frederick P. Brooks, Jr. , John Airey , John Alspaugh , Andrew Bell , Randolph Brown , Curtis Hill , Uwe Nimscheck , Penny Rheingans , John Rohlf , Dana Smith , Douglass Turner , Amitabh Varshney , Yulan Wang , Hans Weber , Xialin Yuan, Six Generations of Building Walkthrough: Final Technical Report to the National Science Foundation, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1992
• 5: Jorge R. Brotons-Mas , Shane O'Mara , Maria V. Sanchez-Vives, Neural processing of spatial information: what we know about place cells and what know about place cells and what they can tell us about presence, Presence: Teleoperators and Virtual Environments, v.15 n.5, p.485-499, October 2006 [doi>10.1162/pres.15.5.485]
• 6: Sarah S. Chance , Florence Gaunet , Andrew C. Beall , Jack M. Loomis, Locomotion Mode Affects the Updating of Objects Encountered During Travel: The Contribution of Vestibular and Proprioceptive Inputs to Path Integration, Presence: Teleoperators and Virtual Environments, v.7 n.2, p.168-178, April 1998 [doi>10.1162/105474698565659]
• 7: Sue V. G. Cobb , Sarah Nichols , Amanda Ramsey , John R. Wilson, Virtual Reality-Induced Symptoms and Effects (VRISE), Presence: Teleoperators and Virtual Environments, v.8 n.2, p.169-186, April 1999 [doi>10.1162/105474699566152]
• 8: Mary Czerwinski , Desney S. Tan , George G. Robertson, Women take a wider view, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503412]
• 9: Rudolph P. Darken , William R. Cockayne , David Carmein, The omni-directional treadmill: a locomotion device for virtual worlds, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.213-221, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263550]
• 10: De Luca, A., Mattone, R., and Robuffo Giordano, P. 2007. Acceleration-level control of the CyberCarpet. In Proceedings of the IEEE International Conference on Robotics and Automation. IEEE Press, Los Alamitos, CA, 2330--2335.
• 11: Foo, P., Warren, W. H., Duchon, A., and Tarr, M. J. 2005. Do humans integrate routes into a cognitive map? Map versus landmark-based navigation of novel shortcuts. J. Exper. Psych. Learn. Memory Cognition 31, 195--215.
• 12: Grant, S. C. and Magee, L. E. 1998. Contributions of proprioception to navigation in virtual environments. Human Factors 40, 489--497.
• 13: Wayne D. Gray , Wai-Tat Fu, Ignoring perfect knowledge in-the-world for imperfect knowledge in-the-head, Proceedings of the SIGCHI conference on Human factors in computing systems, p.112-119, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365061]
• 14: John M. Hollerbach , Damaso Checcacci , Haruo Noma , Yasuyuki Yanagida , Nobuji Tetsutani, Simulating Side Slopes on Locomotion Interfaces Using Torso Forces, Proceedings of the 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS'03), p.91, March 22-23, 2003
• 15: Hiroo Iwata , Hiroaki Yano , Hiroyuki Fukushima , Haruo Noma, CirculaFloor: A Locomotion Interface Using Circulation of Movable Tiles, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.223-230, March 12-16, 2005 [doi>10.1109/VR.2005.11]
• 16: Klatzky, R. L., Loomis, J. M., Beall, A. C., Chance, S. S., and Golledge, R. G. 1998. Spatial updating of self-position and orientation during real, imagined, and virtual locomotion. Psych. Science 9, 293--298.
• 17: William B. Lathrop , Mary K. Kaiser, Perceived orientation in physical and virtual environments: changes in perceived orientation as a function of idiothetic information available, Presence: Teleoperators and Virtual Environments, v.11 n.1, p.19-32, February 2002 [doi>10.1162/105474602317343631]
• 18: Simon Lessels , Roy A. Ruddle, Movement around real and virtual cluttered environments, Presence: Teleoperators and Virtual Environments, v.14 n.5, p.580-596, October 2005 [doi>10.1162/105474605774918778]
• 19: Lessels, S. and Ruddle, R. A. 2004. Changes in navigational behaviour produced by a wide field of view and a high fidelity visual scene. In Proceedings of the Workshop on Virtual Environments. S. Coquillart et al. Eds., Eurographics Association, 71--78.
• 20: Levenshtein, V. I. 1966. Binary codes capable of correcting deletions, insertions and reversal. Soviet Physics Doklady 10, 707--710.
• 21: Loomis, J. M., Klatzky, R. L., Golledge, R. G., and Philbeck, J. W. 1999. Human navigation by path integration. In Wayfinding: Cognitive Mapping and Other Spatial Processes, R. G. Golledge Ed., John Hopkins Press, Baltimore, MD, 125--151.
• 22: Randy Pausch , Dennis Proffitt , George Williams, Quantifying immersion in virtual reality, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.13-18, August 1997 [doi>10.1145/258734.258744]
• 23: Adar Pelah , Jan J. Koenderink, Editorial: Walking in real and virtual environments, ACM Transactions on Applied Perception (TAP), v.4 n.1, p.1-es, January 2007 [doi>10.1145/1227134.1227135]
• 24: Péruch, P., Borel, L., Magnan, J., and Lacour, M. 2005. Direction and distance deficits in path integration after unilateral vestibular loss depend on task complexity. Cognitive Brain Research 25, 862--872.
• 25: Presson, C. C. and Montello, D. R. 1994. Updating after rotational and translational body movements: Coordinate structure of perspective space. Perception 23, 1447--1455.
• 26: Sharif Razzaque , David Swapp , Mel Slater , Mary C. Whitton , Anthony Steed, Redirected walking in place, Proceedings of the workshop on Virtual environments 2002, May 30-31, 2002, Barcelona, Spain
• 27: Bernhard E. Riecke , Heinrich H. Bülthoff, Spatial updating in real and virtual environments: contribution and interaction of visual and vestibular cues, Proceedings of the 1st Symposium on Applied perception in graphics and visualization, August 07-08, 2004, Los Angeles, California [doi>10.1145/1012551.1012553]
• 28: Roy A. Ruddle , Patrick Péruch, Effects of proprioceptive feedback and environmental characteristics on spatial learning in virtual environments, International Journal of Human-Computer Studies, v.60 n.3, p.299-326, March 2004 [doi>10.1016/j.ijhcs.2003.10.001]
• 29: Bernhard E. Riecke , Henricus A. H. C. van Veen , Heinrich H. Bülthoff, Visual homing is possible without landmarks: a path integration study in virtual reality, Presence: Teleoperators and Virtual Environments, v.11 n.5, p.443-473, October 2002 [doi>10.1162/105474602320935810]
• 30: Rieser, J. J. 1989. Access to knowledge of spatial structure at novel points of observation. J. Exper. Psych. Learn. Memory Cognition 15, 1157--1165.
• 31: Ruddle, R. A. and Lessels, S. 2006. For efficient navigational search humans require full physical movement but not a rich visual scene. Psych. Science 17, 460--465.
• 32: The Effect of Trails on First-time and Subsequent Navigation in a Virtual Environment, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.115-122, 321, March 12-16, 2005 [doi>10.1109/VR.2005.76]
• 33: Roy A. Ruddle , Dylan M. Jones, Movement in Cluttered Virtual Environments, Presence: Teleoperators and Virtual Environments, v.10 n.5, p.511-524, October 2001 [doi>10.1162/105474601753132687]
• 34: Ruddle, R. A. 2001. Navigation: Am I really lost or virtually there? In Engineering Psychology and Cognitive Ergonomics vol. 6, D. Harris Ed., Ashgate, Burlington, VT, 135--142.
• 35: Roy A. Ruddle , Stephen J. Payne , Dylan M. Jones, Navigating Large-Scale Virtual Environments: What Differences Occur Between Helmet-Mounted and Desk-Top Displays?, Presence: Teleoperators and Virtual Environments, v.8 n.2, p.157-168, April 1999 [doi>10.1162/105474699566143]
• 36: Ruddle, R. A., Payne, S. J., and Jones, D. M. 1997. Navigating buildings in “desk-top” virtual environments: Experimental investigations using extended navigational experience. J. Exper. Psycho. Appl. 3, 143--159.
• 37: Mel Slater , Martin Usoh , Anthony Steed, Taking steps: the influence of a walking technique on presence in virtual reality, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.3, p.201-219, Sept. 1995 [doi>10.1145/210079.210084]
• 38: Sibylle D. Steck , Hanspeter A. Mallot, The Role of Global and Local Landmarks in Virtual Environment Navigation, Presence: Teleoperators and Virtual Environments, v.9 n.1, p.69-83, February 2000 [doi>10.1162/105474600566628]
• 39: James N. Templeman , Patricia S. Denbrook , Linda E. Sibert, Virtual Locomotion: Walking in Place through Virtual Environments, Presence: Teleoperators and Virtual Environments, v.8 n.6, p.598-617, December 1999 [doi>10.1162/105474699566512]
• 40: Martin Usoh , Kevin Arthur , Mary C. Whitton , Rui Bastos , Anthony Steed , Mel Slater , Frederick P. Brooks, Jr., Walking > walking-in-place > flying, in virtual environments, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.359-364, July 1999 [doi>10.1145/311535.311589]
• 41: Abhijeet Vijayakar , John Hollerbach, Effect of turning strategy on maneuvering ability using the treadport locomotion interface, Presence: Teleoperators and Virtual Environments, v.11 n.3, p.247-258, June 2002 [doi>10.1162/105474602317473204]
• 42: Waller, D. 2000. Individual differences in spatial learning from computer-simulated environments. J. Exper. Psych. Appl. 6, 307--321.
• 43: David Waller , Earl Hunt , David Knapp, The Transfer of Spatial Knowledge in Virtual Environment Training, Presence: Teleoperators and Virtual Environments, v.7 n.2, p.129-143, April 1998 [doi>10.1162/105474698565631]
• 44: Waller, D., Loomis, J. M., and Haun, D. B. M. 2004. Body-based senses enhance knowledge of directions in large-scale environments. Psychonomic Bull. Rev. 11, 157--163.
• 45: Joseph V. Cohn , Jeff Feasel , Sarah J. Poulton , Brandi McLeod , Frederick P. Brooks, Jr., Comparing VE Locomotion Interfaces, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.123-130, March 12-16, 2005 [doi>10.1109/VR.2005.25]
• 46: Winter, D. A. 1990. Biomechanics and Motor Control of Human Movement 2nd Ed. Wiley-Interscience, New York.
• 47: Bob G. Witmer , John H. Bailey , Bruce W. Knerr , Kimberley C. Parsons, Virtual spaces and real world places: transfer of route knowledge, International Journal of Human-Computer Studies, v.45 n.4, p.413-428, Oct. 1996 [doi>10.1006/ijhc.1996.0060]
• 48: Bob G. Witmer , Paul B. Kline, Judging Perceived and Traversed Distance in Virtual Environments, Presence: Teleoperators and Virtual Environments, v.7 n.2, p.144-167, April 1998 [doi>10.1162/105474698565640]
• 49: Bob G. Witmer , Wallace J. Sadowski , Neal M. Finkelstein, VE-based training strategies for acquiring survey knowledge, Presence: Teleoperators and Virtual Environments, v.11 n.1, p.1-18, February 2002 [doi>10.1162/105474602317343622]
• 50: Catherine A. Zanbaka , Benjamin C. Lok , Sabarish V. Babu , Amy C. Ulinski , Larry F. Hodges, Comparison of Path Visualizations and Cognitive Measures Relative to Travel Technique in a Virtual Environment, IEEE Transactions on Visualization and Computer Graphics, v.11 n.6, p.694-705, November 2005 [doi>10.1109/TVCG.2005.92]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Experimentation, Human Factors, Performance

Keywords:
Virtual reality, locomotion, navigation, visual fidelity