Digital foam interaction techniques for 3D modeling

ABSTRACT

Digital Foam is a new input sensor developed to support clay like sculpting and modeling operations. We present techniques facilitating navigation and manipulation operations performed using Spherical Digital Foam as a sole input device. Our free-form sculpting technique allows manipulation of new and existing 3D models using accumulated sculpting like motions. Digital Foam's multi-point pressure sensitive surface captures the separate locations of a user's fingertips allowing controlled manipulation of multiple model vertices simultaneously. Additionally, we developed a technique that allows the camera view and zoom to be controlled by applying varying pressure to the Digital Foam surface. Furthermore, we have designed a menu system tailored for operation using Spherical Digital Foam as a sole input device using both the internal orientation sensor and the pressure sensitive surface.

A new higher resolution Spherical Digital Foam input device with 162 unique pressure sensors is presented. This is a significant improvement in comparison to the previous Spherical Digital Foam version with only 21 sensors. We discuss the design issues and how an increased resolution affects the operation and design of the algorithms used. We propose a new dynamic button allocation technique made possible using the new high resolution Spherical Digital Foam. Finally, we performed a trial study using the new 162 sensor Spherical Digital Foam input device to evaluate elements of the menu system.

REFERENCES

• 1: G. Blaskó, A Menu Interface for Wearable Computing, Proceedings of the 6th IEEE International Symposium on Wearable Computers, p.164, October 07-10, 2002
• 2: Doug A. Bowman , Chadwick A. Wingrave, Design and Evaluation of Menu Systems for Immersive Virtual Environments, Proceedings of the Virtual Reality 2001 Conference (VR'01), p.149, March 13-17, 2001
• 3: Brady, S., Diamond, D., and Lau, K.-T. 2005. Inherently conducting polymer modified polyurethane smart foam for pressure sensing. Sensors and Actuators A: Physical 119, 2 (Apr), 398--404.
• 4: Buxton, W. 1995. "Touch, Gesture, and Marking" Readings in Human Computer Interaction: Toward the Year 2000.
• 5: Michael F. Deering, HoloSketch: a virtual reality sketching/animation tool, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.3, p.220-238, Sept. 1995 [doi>10.1145/210079.210087]
• 6: Bernd Fröhlich , John Plate, The cubic mouse: a new device for three-dimensional input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.526-531, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332491]
• 7: Gerber, D., and Bechmann, D. 2004. Design and evaluation of the ring menu in virtual environments. In Immersive projection technologies.
• 8: D. Gerber , D. Bechmann, The Spin Menu: A Menu System for Virtual Environments, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.271-272, March 12-16, 2005 [doi>10.1109/VR.2005.81]
• 9: Ken Hinckley , Mike Sinclair, Touch-sensing input devices, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.223-230, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303045]
• 10: Ken Hinckley , Randy Pausch , John C. Goble , Neal F. Kassell, Passive real-world interface props for neurosurgical visualization, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.452-458, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191821]
• 11: Ken Hinckley , Randy Pausch , Dennis Proffitt , Neal F. Kassell, Two-handed virtual manipulation, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.3, p.260-302, Sept. 1998 [doi>10.1145/292834.292849]
• 12: Jung, H.-k., Nam, T.-j., Lee, H.-s., and Han, S.-y. 2004. Spray modeling: Augmented reality based 3d modeling interface for intuitive and evolutionary form development. In In Proceedings of International Conference on Artifical Reality and Telexistence.
• 13: Jung, H.-k., Nam, T.-j., and Lee, H.-s. 2005. 3d modeling interface with air spray: Field study of 3d model making and prototype development. In Conference On Human Factors In Computing Systems.
• 14: Kazuto Kamiyama , Hiroyuki Kajimoto , Kevin Vlack , Naoki Kawakami , Terukazu Mizota , Susumu Tachi, GelForce, ACM SIGGRAPH 2004 Emerging technologies, August 08-12, 2004, Los Angeles, California [doi>10.1145/1186155.1186161]
• 15: David R. Koller , Mark R. Mine , Scott E. Hudson, Head-tracked orbital viewing: an interaction technique for immersive virtual environments, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.81-82, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237103]
• 16: Wolfgang Krueger , Bernd Froehlich, The Responsive Workbench, IEEE Computer Graphics and Applications, v.14 n.3, p.12-15, May 1994 [doi>10.1109/38.279036]
• 17: Kulik, A., Blach, R., and Fröehlich, B. 2006. "two - 4 - six" - a handheld device for 3D-presentations. In IEEE Symposium on 3D User Interfaces, 167--170.
• 18: Liang, J., and Green, M. 1993. Geometric modeling using siz degrees of fredom input devices. In Proc. 3rd International Conference on CAD and Computer Graphics, 217--222.
• 19: Massie, T. H., and Salisbury, J. K. 1994. The phantom haptic interface: A device for probing virtual objects. In ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.
• 20: Kevin T. McDonnell , Hong Qin , Robert A. Wlodarczyk, Virtual clay: a real-time sculpting system with haptic toolkits, Proceedings of the 2001 symposium on Interactive 3D graphics, p.179-190, March 2001 [doi>10.1145/364338.364395]
• 21: Milczynski, M., Hermann, T., Bovermann, T., and Ritter, H. 2006. A malleable device with applications to sonification-based data exploration. In Proceedings of the 12th Meeting of the International Conference on Auditory Display.
• 22: Piekarski, W., and Smith, R. 2006. Robust gloves for 3d interaction in mobile outdoor ar environments. In International Symposium on Mixed and Augmented Reality.
• 23: Wayne Piekarski , Bruce H. Thomas, Augmented Reality Working Planes: A Foundation for Action and Construction at a Distance, Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality, p.162-171, November 02-05, 2004 [doi>10.1109/ISMAR.2004.17]
• 24: Reitmayr, G., Chiu, C., Kusternig, A., Kusternig, M., and Witzmann, H. 2005. iorb - unifying command and 3d input for mobile augmented reality. In 3D User Interfaces.
• 25: Steven Schkolne , Michael Pruett , Peter Schröder, Surface drawing: creating organic 3D shapes with the hand and tangible tools, Proceedings of the SIGCHI conference on Human factors in computing systems, p.261-268, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365114]
• 26: Smith, R. T., Thomas, B. H., and Piekarski, W. 2008. Tech note: Digital foam. In IEEE Symposium on 3D User Interfaces.
• 27: Florian Vogt , Timothy Chen , Reynald Hoskinson , Sidney Fels, A malleable surface touch interface, ACM SIGGRAPH 2004 Sketches, August 08-12, 2004, Los Angeles, California [doi>10.1145/1186223.1186268]
• 28: Mason Woo , Jackie Neider , Tom Davis, OpenGL programming guide (2nd ed.): the official guide to learning OpenGL version 1.1., Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1997

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Prototyping

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Keywords:
3D input device, augmented reality, digital foam, interaction techniques, interactive modeling, virtual reality