Hand-held virtual reality: a feasibility study

ABSTRACT

Hand-held computing devices are ubiquitous and have become part of our lives these days. Moreover, hand-held devices are also increasingly being equipped with special sensors and non-traditional displays. As such, it raises the question of whether such a "small" and "reduced" device could serve as an effective virtual reality (VR) platform and provide sufficient immersion and presence, e.g. through multimodal interaction. In this paper, we address this question by comparing the perceived field of view (FOV) and level of immersion and presence among the users' of VR platforms, varied in the sizes of physical/software FOV and in styles of interaction. In particular, we consider a motion based interaction, a style of interaction uniquely suitable for the "hand-held" devices. Our experimental study has revealed that when a motion based interaction was used, the FOV perceived by the user for the small hand held device was significantly greater than (around 50%) the actual. Other displays using the button or mouse/keyboard interface did not exhibit such a phenomenon. In addition, the level of user felt presence was higher than even that from a large projection based VR platform. The paper demonstrates the distinct possibility of realizing reasonable virtual reality even with devices with a small visual field of view and limited processing power.

REFERENCES

• 1: Rafael Ballagas , Michael Rohs , Jennifer G. Sheridan, Sweep and point and shoot: phonecam-based interactions for large public displays, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056876]
• 2: Bouguet, J. Y. Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm. OpenCV Technical Document, 2000.
• 3: Doug A. Bowman , Joseph L. Gabbard , Deborah Hix, A survey of usability evaluation in virtual environments: classification and comparison of methods, Presence: Teleoperators and Virtual Environments, v.11 n.4, p.404-424, August 2002 [doi>10.1162/105474602760204309]
• 4: Doug A. Bowman , Larry F. Hodges, An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.35-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253301]
• 5: Clifford, M. and Gomez, L. Measuring Tilt with Low-g Accelerometers. Application Note AN3107, Freescale Semiconductor, Inc., 2005.
• 6: George W. Fitzmaurice , Shumin Zhai , Mark H. Chignell, Virtual reality for palmtop computers, ACM Transactions on Information Systems (TOIS), v.11 n.3, p.197-218, July 1993 [doi>10.1145/159161.159160]
• 7: Hachet, M. and Kitamura, Y. 3D interaction with and from handheld computers. In Proceedings of IEEE VR Workshop: New Directions in 3D User Interfaces, 2005.
• 8: Martin Hachet , Joachim Pouderoux , Pascal Guitton, A camera-based interface for interaction with mobile handheld computers, Proceedings of the 2005 symposium on Interactive 3D graphics and games, April 03-06, 2005, Washington, District of Columbia [doi>10.1145/1053427.1053438]
• 9: Paul Keir , John Payne , Jocelyn Elgoyhen , Martyn Horner , Martin Naef , Paul Anderson, Gesture-recognition with Non-referenced Tracking, Proceedings of the 3D User Interfaces (3DUI'06), p.151-158, March 25-29, 2006
• 10: Kukimoto, N., et al. PDA-based visualization control and annotation interface for virtual environment. In Proceeding of 3rd IASTED International Conference Visualization, Image and Image Processing, 2003.
• 11: Lee, S., et al. Formation of spatial presence: by form or content?. In Proceedings of 7th Annual International Presence Workshop, Valencia, Spain, 2004.
• 12: James Jeng-Weei Lin , Henry B. L. Duh , Habib Abi-Rached , Donald E. Parker , Thomas A. Furness Iii, Effects of Field of View on Presence, Enjoyment, Memory, and Simulator Sickness in a Virtual Environment, Proceedings of the IEEE Virtual Reality Conference 2002, p.164, March 24-28, 2002
• 13: Manolis I. A. Lourakis , Antonis A. Argyros, Efficient, causal camera tracking in unprepared environments, Computer Vision and Image Understanding, v.99 n.2, p.259-290, August 2005 [doi>10.1016/j.cviu.2005.02.001]
• 14: Maringelli, F., et al. The Influence of Body Movement on Subjective Presence in Virtual Environments. Human Factors, 40, 3, pp. 469--477, 1998.
• 15: Volker Paelke , Christian Reimann , Dirk Stichling, Foot-based mobile interaction with games, Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, p.321-324, June 03-05, 2005, Singapore [doi>10.1145/1067343.1067390]
• 16: Nicholas F. Polys , Seonho Kim , Doug A. Bowman, Effects of information layout, screen size, and field of view on user performance in information-rich virtual environments, Proceedings of the ACM symposium on Virtual reality software and technology, November 07-09, 2005, Monterey, CA, USA [doi>10.1145/1101616.1101626]
• 17: Ivan Poupyrev , Jun Rekimoto , Shigeaki Maruyama, TouchEngine: a tactile display for handheld devices, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506525]
• 18: Prinz, W. and Bridgeman, B. Handbook of Perception and Action, Vol 1: Perception. Academic Press, San Diego, CA, 1995.
• 19: Shi, J. and Tomasi, C. Good features to track. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Seattle, USA, 1994.
• 20: Slater, M. A Note on Presence Terminology. Presence-Connect. 3, Jan. 2003.
• 21: Slater, M. Measuring Presence: A Response to the Witmer and Singer Presence Questionnaire. Presence: Teleoperators and Virtual Environments, 8, 5, pp. 560--565, 1999.
• 22: Wagner, D., et al. Towards massively multi-user augmented reality on handheld devices. In Proceedings of the Third International Conference on Pervasive Computing (Pervasive '05), 2005.
• 23: Daniel Wagner , Dieter Schmalstieg, First Steps Towards Handheld Augmented Reality, Proceedings of the 7th IEEE International Symposium on Wearable Computers, p.127, October 21-23, 2003
• 24: Watsen, K., et al. A handheld computer as an interaction device to a virtual environment. In Proceedings of the International Projection Technologies Workshop, 1999.
• 25: Witmer, B. G. and Singer, M. J. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoperators and Virtual Environments, 7, 3, pp. 225--240, 1998.
• 26: Ungyeon Yang , Gerard Jounghyun Kim, Increasing the Effective Egocentric Field of View with Proprioceptive and Tactile Feedback, Proceedings of the IEEE Virtual Reality 2004 (VR'04), p.27, March 27-31, 2004 [doi>10.1109/VR.2004.44]
• 27: Open Source Computer Vision Library, http://www.intel.com/technology/computing/opencv
• 28: Coin3D, http://www.coin3d.org

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Experimentation, Human Factors

Keywords:
field of view, hand-held devices, immersion, motion based interface, presence, task performance, virtual reality