Multi-finger gestural interaction with 3d volumetric displays

ABSTRACT

Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive direct manipulation of objects with a 3D volumetric display. Motion tracking of the user's fingers provides for direct gestural interaction with the virtual objects, through manipulations on and around the display's hemispheric enclosure. Our techniques leverage the unique features of volumetric displays, including a 360° viewing volume that enables manipulation from any viewpoint around the display, as well as natural and accurate perception of true depth information in the displayed 3D scene. We demonstrate our techniques within a prototype 3D geometric model building application.

REFERENCES

• 1: Ravin Balakrishnan , George W. Fitzmaurice , Gordon Kurtenbach, User Interfaces for Volumetric Displays, Computer, v.34 n.3, p.37-45, March 2001 [doi>10.1109/2.910892]
• 2: Thomas Baudel , Michel Beaudouin-Lafon, Charade: remote control of objects using free-hand gestures, Communications of the ACM, v.36 n.7, p.28-35, July 1993 [doi>10.1145/159544.159562]
• 3: Doug A. Bowman , Larry F. Hodges, An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.35-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253301]
• 4: Doug A. Bowman , Donald B. Johnson , Larry F. Hodges, Testbed evaluation of virtual environment interaction techniques, Proceedings of the ACM symposium on Virtual reality software and technology, p.26-33, December 20-22, 1999, London, United Kingdom [doi>10.1145/323663.323667]
• 5: Buxton, W., & Fitzmaurice, G.W. (1998). HMD's, Caves, & Chameleon: A human-centric analysis of interaction in virtual space... p. 64--68.
• 6: Conner, B., Snibbe, S.S., Herndon, K.P., Robbins, D., Zeleznik, R., & Dam, A.v. (1992). Three dimensional widgets. Computer Graphics. 22(4). p. 121--129.
• 7: David Ebert , Edward Bedwell , Stephen Maher , Laura Smoliar , Elizabeth Downing, Realizing 3D visualization using crossed-beam volumetric displays, Communications of the ACM, v.42 n.8, p.100-107, Aug. 1999 [doi>10.1145/310930.310979]
• 8: Tovi Grossman , Ravin Balakrishnan, Pointing at trivariate targets in 3D environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.447-454, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985749]
• 9: Ken Hinckley , Randy Pausch , John C. Goble , Neal F. Kassell, A survey of design issues in spatial input, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.213-222, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192501]
• 10: Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, The design of a GUI paradigm based on tablets, two-hands, and transparency, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-42, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258574]
• 11: Liang, J., & Green, M. (1994). JDCAD: A highly interactive 3D modelingsystem. Computers and Graphics. 18(4). p. 499--506.
• 12: Mark Lucente, Interactive three-dimensional holographic displays: seeing the future in depth, ACM SIGGRAPH Computer Graphics, v.31 n.2, p.63-67, May 1997 [doi>10.1145/271283.271312]
• 13: Michael E. McCauley , Thomas J. Sharkey, Cybersickness: perception of self-motion in virtual environments, Presence: Teleoperators and Virtual Environments, v.1 n.3, p.311-318, Summer 1992
• 14: Mark R. Mine, ISAAC: A Virtual Environment Tool for the Interactive Construction of Virtual Worlds, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1995
• 15: Mark R. Mine, Virtual Environment Interaction Techniques, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1995
• 16: Patterson, R., & Martin, W. Human Stereopsis. Human Factors. 34(6). p. 669--692.
• 17: Ivan Poupyrev , Mark Billinghurst , Suzanne Weghorst , Tadao Ichikawa, The go-go interaction technique: non-linear mapping for direct manipulation in VR, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.79-80, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237102]
• 18: Colin Ware , Ravin Balakrishnan, Reaching for objects in VR displays: lag and frame rate, ACM Transactions on Computer-Human Interaction (TOCHI), v.1 n.4, p.331-356, Dec. 1994 [doi>10.1145/198425.198426]
• 19: Colin Ware , Kathy Lowther, Selection using a one-eyed cursor in a fish tank VR environment, ACM Transactions on Computer-Human Interaction (TOCHI), v.4 n.4, p.309-322, Dec. 1997 [doi>10.1145/267135.267136]
• 20: Zhai, S. (1995). Human performance in six degree-of-freedom input control. Ph.D. thesis. University of Toronto.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Keywords:
3d interaction, multi-finger and two-handed gestural input, volumetric display