Overcoming eye-hand visibility mismatch in 3D pointing selection

ABSTRACT

Most pointing techniques for 3D selection on virtual environments rely on a ray originating at the user's hand whose direction is controlled by the hand orientation. In this paper we study the potential mismatch between visible objects (those which appear unoccluded from the user's eye position) and selectable objects (those which appear unoccluded from the user's hand position). We study the impact of such eye-hand visibility mismatch on selection performance, and propose a new technique for ray control which attempts to overcome this problem. We present an experiment to compare our ray control technique with classic raycasting in selection tasks with complex 3D scenes. Our user studies show promising results of our technique in terms of speed and accuracy.

REFERENCES

• 1: Ravin Balakrishnan, "Beating" Fitts' law: virtual enhancements for pointing facilitation, International Journal of Human-Computer Studies, v.61 n.6, p.857-874, December 2004 [doi>10.1016/j.ijhcs.2004.09.002]
• 2: Andrew Forsberg , Kenneth Herndon , Robert Zeleznik, Aperture based selection for immersive virtual environments, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.95-96, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237105]
• 3: Liang, J., and Green, M. 1994. Jdcad: A highly interactive 3d modeling system. Computers & Graphics 18, 4, 499--506.
• 4: Mark R. Mine , Frederick P. Brooks, Jr. , Carlo H. Sequin, Moving objects in space: exploiting proprioception in virtual-environment interaction, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.19-26, August 1997 [doi>10.1145/258734.258747]
• 5: Mark R. Mine, Virtual Environment Interaction Techniques, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1995
• 6: Olwal, A., and Feiner, S. 2003. The Flexible Pointer: An Interaction Technique for Augmented and Virtual Reality. In ACM UIST'03, 81--82.
• 7: Hans Peter Wyss , Roland Blach , Matthias Bues, iSith - Intersection-based Spatial Interaction for Two Hands, Proceedings of the 3D User Interfaces, p.59-61, March 25-29, 2006
• 8: Jeffrey S. Pierce , Andrew S. Forsberg , Matthew J. Conway , Seung Hong , Robert C. Zeleznik , Mark R. Mine, Image plane interaction techniques in 3D immersive environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.39-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253303]
• 9: Steinicke, F., Ropinski, T., and Hinrichs, K. 2004. Object selection in virtual environments with an improved virtual pointer metaphor. ICCVG'2004.
• 10: Vanacken, L., Grossman, T., and Coninx, K. 2007. Exploring the effects of environment density and target visibility on object selection in 3d virtual environments. In IEEE Symposium on 3D User Interfaces, 115--122.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Keywords:
3D selection, raycasting, virtual pointer