Project FEELEX: adding haptic surface to graphics

ABSTRACT

This paper presents work carried out for a project to develop a new interactive technique that combines haptic sensation with computer graphics. The project has two goals. The first is to provide users with a spatially continuous surface on which they can effectively touch an image using any part of their bare hand, including the palm. The second goal is to present visual and haptic sensation simultaneously by using a single device that doesn't oblige the user to wear any extra equipment. In order to achieve these goals, we designed a new interface device comprising of a flexible screen, an actuator array and a projector. The actuator deforms the flexible screen onto which the image is projected. The user can then touch the image directly and feel its shape and rigidity. Initially we fabricated two prototypes, and their effectiveness is examined by studying the observations made by anonymous users and a performance evaluation test for spatial resolution.

REFERENCES

• 1: Frederick P. Brooks, Jr. , Ming Ouh-Young , James J. Batter , P. Jerome Kilpatrick, Project GROPEHaptic displays for scientific visualization, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.177-185, Aug. 1990
• 2: Grigore Burdea , Jiachen Zhuang , Edward Roskos , Deborah Silver , Noshir Langrana, A portable dextrous master with force feedback, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.18-28, Winter 1992
• 3: Grigore C. Burdea, Force and touch feedback for virtual reality, John Wiley & Sons, Inc., New York, NY, 1996
• 4: G. Moy, C. Wagner, and R.S. Fearing. A Compliant Tactile Display for Teletaction. In IEEE Int. Conf. on Robotics and Automation, April 2000.
• 5: K. Hirota , M. Hirose, Simulation and presentation of curved surface in virtual reality environment through surface display, Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95), p.211, March 11-15, 1995
• 6: Virtual Technologies Inc. http://www.virtex.com.
• 7: Hiroo Iwata, Artificial reality with force-feedback: development of desktop virtual space with compact master manipulator, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.165-170, Aug. 1990
• 8: Iwata,H.,. Pen-based Haptic Virtual Environment. In Proc. of IEEE VRAIS'93, 1993.
• 9: Iwata,H.,. Desktop Force Display. In SIGGRAPH 94 Visual Proceedings, 1994.
• 10: Kawai,Y., and Tomita,F.,. A support system for the visually impaired to recognize three-dimensional objects. Technology and Disability, 12(1):13-20, 2000.
• 11: Kontarinis D.A., and Howe, R.D.,. Tactile Display of Vibratory Information in Teleoperation and Virtual Environment. Presence, 4(4):387-402, 1995.
• 12: Lederman, S.J. and Klatzky, R.L.,. Hand movements: A window into haptic object recognition. Cognitive Psychology, 19(3):342-368, 1987.
• 13: Lederman, S.J. and Klatzky, R.L.,. Sensing and displaying spatially distributed fingertip forces in haptic interfaces for teleoperators and virtual environment system. Cognitive Psychology, 8(1):86-103, 1999.
• 14: Massie,T., and Salisbury, K.,. The PHANToM Haptic Interface: A Device for Probing Virtual Objects. In ASME Winter Anual Meeting, DSC-Vol.55-1, 1994.
• 15: McNeely, W.,. Robotic Graphics:A New Approach to Force Feedback for Virtual Reality. In Proc. of IEEE VRAIS'93, 1993.
• 16: Minsky M, Lederman, SJ.,. Simulated Haptic Textures: Roughness. Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. In Proceedings of the ASME Dynamic Systems and Control Division,DSC-Vol. 58, 1996.
• 17: Tamotsu Murakami , Naomasa Nakajima, Direct and intuitive input device for 3-D shape deformation, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.465-470, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191823]
• 18: William R. Mark , Scott C. Randolph , Mark Finch , James M. Van Verth , Russell M. Taylor, II, Adding force feedback to graphics systems: issues and solutions, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.447-452, August 1996 [doi>10.1145/237170.237284]
• 19: Siio,I., . InfoBinder: A pointing Device for Virtual Desktop System. In Proceedings of HCI International '95, 1995.
• 20: Michael Sinclair, The haptic lens, ACM SIGGRAPH 97 Visual Proceedings: The art and interdisciplinary programs of SIGGRAPH '97, p.179, August 03-08, 1997, Los Angeles, California, United States [doi>10.1145/259081.259266]
• 21: Tachi,S.,and others. A Construction Method of Virtual Haptic Space. In Proc. of ICAT'94, 1994.
• 22: John Underkoffler , Brygg Ullmer , Hiroshi Ishii, Emancipated pixels: real-world graphics in the luminous room, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.385-392, July 1999 [doi>10.1145/311535.311593]
• 23: Pierre Wellner, The DigitalDesk calculator: tangible manipulation on a desk top display, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.27-33, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120785]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

General Terms:
Design, Human Factors, Performance, Theory

Keywords:
actuator array, deformable screen, haptics, interactive graphics