Mixed-dimension interaction in virtual environments

ABSTRACT

In this paper, we present a study to show that matching the dimensionality of interaction techniques with the dimensional demands of the task results in an interface that facilitates superior performance on interaction tasks without sacrificing performance on 2D tasks in favor of 3D tasks and vice versa. We describe the concept of dimensional congruence and how to identify the dimensional characteristics of a task so that appropriate interaction techniques can be applied. We constructed a prototypical application in a Virtual Environment Enclosure (VEE) using a hand-held device to show how this might be done in this type of apparatus. We then describe a study that evaluates both 2D and 3D tasks as performed using typical 2D and 3D interaction techniques. Results show that an appropriate mix of 2D and 3D interaction techniques is preferred over exclusive use of one or the other. The challenge lies not in selecting independent interaction techniques for specific tasks, but rather in constructing an overall interface that mixes 2D and 3D interactions appropriately.

REFERENCES

• 1: I.G. Angus and H.A. Sowizral, "Embedding the 2D Interaction Metaphor in a Real 3D Virtual Environment," Proceedings of SPIE, vol. 2409, pp. 282--293, 1995.
• 2: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, Proceedings of the 7th annual conference on Computer graphics and interactive techniques, p.262-270, July 14-18, 1980, Seattle, Washington, United States
• 3: Doug A. Bowman , Chris North , Jian Chen , Nicholas F. Polys , Pardha S. Pyla , Umur Yilmaz, Information-rich virtual environments: theory, tools, and research agenda, Proceedings of the ACM symposium on Virtual reality software and technology, October 01-03, 2003, Osaka, Japan [doi>10.1145/1008653.1008669]
• 4: W. Buxton, "There's More to Interaction Than Meets the Eye: Some Issues in Manual Input", In D.A. Norman and S.W. Draper (Eds) User Centered Design: New Perspectives on Human-Computer Interaction. Lawrence Erlbaum Associates, Hillsdale, N.J., 319--337.
• 5: James D. Foley , Victor L. Wallace , Peggy Chan, The human factors of computer graphics interaction techniques, IEEE Computer Graphics and Applications, v.4 n.11, p.13-48, Nov. 1984
• 6: Tovi Grossman , Daniel Wigdor , Ravin Balakrishnan, Multi-finger gestural interaction with 3d volumetric displays, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029644]
• 7: Beverly L. Harrison , Kim J. Vicente, An experimental evaluation of transparent menu usage, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.391-398, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238583]
• 8: Ken Hinckley , Randy Pausch , Dennis Proffitt , Neal F. Kassell, Two-handed virtual manipulation, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.3, p.260-302, Sept. 1998 [doi>10.1145/292834.292849]
• 9: Robert J. K. Jacob , Linda E. Sibert , Daniel C. McFarlane , M. Preston Mullen, Jr., Integrality and separability of input devices, ACM Transactions on Computer-Human Interaction (TOCHI), v.1 n.1, p.3-26, March 1994 [doi>10.1145/174630.174631]
• 10: R. H. Jacoby and S. R. Ellis, "Using Virtual Menus in a Virtual Environment," Proceedings of SPIE Technical Conference 1666, 1992.
• 11: Robert W. Lindeman , John L. Sibert , James K. Hahn, Hand-Held Windows: Towards Effective 2D Interaction in Immersive Virtual Environments, Proceedings of the IEEE Virtual Reality, p.205, March 13-17, 1999
• 12: Mark R. Mine, Virtual Environment Interaction Techniques, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1995
• 13: Jeffrey S. Pierce , Andrew S. Forsberg , Matthew J. Conway , Seung Hong , Robert C. Zeleznik , Mark R. Mine, Image plane interaction techniques in 3D immersive environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.39-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253303]
• 14: Ivan Poupyrev , Mark Billinghurst , Suzanne Weghorst , Tadao Ichikawa, The go-go interaction technique: non-linear mapping for direct manipulation in VR, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.79-80, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237102]
• 15: I. Poupyrev , N. Tomokazu , S. Weghorst, Virtual Notepad: Handwriting in Immersive VR, Proceedings of the Virtual Reality Annual International Symposium, p.126, March 14-18, 1998

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Design, Experimentation, Human Factors, Performance

Keywords:
human factors, interaction technique, virtual environments