The Grappl 3D interaction technique library

ABSTRACT

One of the obstacles to the widespread use of interactive 3D applications is the lack of good tools for developing them. The development of these tools has been complicated by the wide range of hardware configurations used in 3D applications. Also, there is a lack of common software platforms for developing the tools required for 3D user interfaces. As a result, many groups develop their own set of interaction techniques without taking advantage of the work of others, wasting a considerable amount of development time. The Grappl project aims to solve these problems by providing software tools that adapt to the hardware configuration and automatically design most of the user interface. One of the main components of this project is an interaction technique library that supports a wide range of input and output devices. This library provides an open platform for the development of 3D interaction techniques that encourages further development in this area. Interaction techniques developed using this toolkit can be used in our user interface design system, so application developers can easily take advantage of new interaction techniques. The design and implementation of this library is described in this paper.

REFERENCES

• 1: Jon Barrilleaux, 3D user interfaces with Java 3D, Manning Publications Co., Greenwich, CT, 2000
• 2: Doug A. Bowman , Larry F. Hodges, An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.35-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253301]
• 3: Doug A. Bowman , Ernst Kruijff , Joseph J. LaViola , Ivan Poupyrev, 3D User Interfaces: Theory and Practice, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 2004
• 4: Brookshire D. Conner , Scott S. Snibbe , Kenneth P. Herndon , Daniel C. Robbins , Robert C. Zeleznik , Andries van Dam, Three-dimensional widgets, Proceedings of the 1992 symposium on Interactive 3D graphics, p.183-188, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147199]
• 5: Forsberg, A., LaViola, J., Zeleznik, R., ErgoDesk: A Framework For Two and Three Dimensional Interaction at the ActiveDesk. Proceedings of Second International Immersive Projection Technology Workshop. 1998.
• 6: Green M., Towards the Automatic Construction of 3D User Interfaces, ICAT'2004 Proceedings, 2004.
• 7: Robert J. K. Jacob , Leonidas Deligiannidis , Stephen Morrison, A software model and specification language for non-WIMP user interfaces, ACM Transactions on Computer-Human Interaction (TOCHI), v.6 n.1, p.1-46, March 1999 [doi>10.1145/310641.310642]
• 8: Liang J. M. Green, JDCAD: A Highly Interactive 3D Modeling System, Computers and Graphics, vol. 18, no. 4, p. 499--506, 1994.
• 9: Chris D. Shaw , Mark Green, THRED: a two-handed design system, Multimedia Systems, v.5 n.2, p.126-139, March 1997 [doi>10.1007/s005300050048]
• 10: Mark R. Mine , Frederick P. Brooks, Jr. , Carlo H. Sequin, Moving objects in space: exploiting proprioception in virtual-environment interaction, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.19-26, August 1997 [doi>10.1145/258734.258747]
• 11: Ivan Poupyrev , Mark Billinghurst , Suzanne Weghorst , Tadao Ichikawa, The go-go interaction technique: non-linear mapping for direct manipulation in VR, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.79-80, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237102]
• 12: Chris Shaw , Mark Green , Jiandong Liang , Yunqi Sun, Decoupled simulation in virtual reality with the MR toolkit, ACM Transactions on Information Systems (TOIS), v.11 n.3, p.287-317, July 1993 [doi>10.1145/159161.173948]
• 13: Marc P. Stevens , Robert C. Zeleznik , John F. Hughes, An architecture for an extensible 3D interface toolkit, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.59-67, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192449]
• 14: Robert C. Zeleznik , Kenneth P. Herndon , Daniel C. Robbins , Nate Huang , Tom Meyer , Noah Parker , John F. Hughes, An interactive 3D toolkit for constructing 3D widgets, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.81-84, September 1993 [doi>10.1145/166117.166127]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Design, Human Factors

Keywords:
3D user interfaces, interaction techniques