Haptic rendering: programming touch interaction with virtual objects

ABSTRACT

Haptic rendering is the process of computing and generating forces in response to user interactions with virtual objects. Recent efforts by our team at MIT's AI laboratory have resulted in the development of haptic interface devices and algorithms for generating the forces of interaction with virtual objects. This paper focuses on the software techniques needed to generate sensations of contact interaction and material properties. In particular, the techniques we describe are appropriate for use with the Phantom haptic interface, a force generating display device developed in our laboratory. We also briefly describe a technique for representing and rendering the feel of arbitrary polyhedral shapes and address issues related to rendering the feel of non-homogeneous materials. A number of demonstrations of simple haptic tasks which combine our rendering techniques are also described.

REFERENCES

• 1: Frederick P. Brooks, Jr. , Ming Ouh-Young , James J. Batter , P. Jerome Kilpatrick, Project GROPEHaptic displays for scientific visualization, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.177-185, September 1990, Dallas, TX, USA
• 2: Colgate, J. Edward, and J. Michael Brown "Factors Affecting the Z-Width of a Haptic Interface." Proceedings of tile IEEE International Conference on Robotics and Automation, 3205-3210. 1994.
• 3: Colgate, J. Edward, P.E. Grating, M.C. Stanley, and G. Schenkel "Implementation of Stiff Virtual Walls in Force-Reflecting Interfaces." Proc. {EEE-VRAIS, pp. 202-208, 1993.
• 4: Durlach, Nathaniel I., et al. "Virtual Reality: Scientific and Technological Challenges." Report produced for the National Research Council, National Academy of Sciences. Washington D.C. December 1994.
• 5: Paul Jerome Kilpatrick, The use of a kinesthetic supplement in an interactive graphics system., 1976
• 6: Massie, Thomas H. "Design of a Three Degree of Freedom Force-l~Leflecting Haptic Interface." SB thesis, MIT EECS Department. May, 1993.
• 7: M assie, Thomas H. and Kenneth Salisbury. "The PHANTOM Haptic Interface: A Device for Probing Virtual Objects.." Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Chicago, IL. November 1994.
• 8: Margaret Minsky , Ouh-young Ming , Oliver Steele , Frederick P. Brooks, Jr. , Max Behensky, Feeling and seeing: issues in force display, ACM SIGGRAPH Computer Graphics, v.24 n.2, p.235-241, Mar. 1990
• 9: Michael E. Mortenson, Geometric modeling, John Wiley & Sons, Inc., New York, NY, 1985
• 10: Noll, A. Michael. "Man-Machine Tactile Communication." Society for Information Display Journal. July/August 1972. Reprinted in Creative Computing, July/August 1978 p.52-57.
• 11: Salcudean, S. E. and T. D. Vlaar. "On the Emulation of Stiff Walls and Static Friction with a Magnetically Levitated Input/Output Device." Proceedings of the ASME 'Dynamic Systems and Control Division. Chicago, IL. Nov. 6-11, 1994.
• 12: Thomas B. Sheridan, Telerobotics, automation, and human supervisory control, MIT Press, Cambridge, MA, 1992
• 13: Swarup, Nitish. SM thesis in progress. Department of Mechanical Engineering, MIT. Expected May 95.
• 14: C. B. Zilles , J. K. Salisbury, A constraint-based god-object method for haptic display, Proceedings of the International Conference on Intelligent Robots and Systems-Volume 3, p.3146, August 05-09, 1995
• 15: Zilles, Craig. SM thesis in progress. Department of Mechanical Engineering, MIT. Expected May 95.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.1 Hardware architecture
          Subjects: Input devices
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Curve, surface, solid, and object representations

General Terms:
Algorithms, Human Factors