Using a vibro-tactile display for enhanced collision perception and presence

ABSTRACT

One of the goals and means of realizing virtual reality is through multimodal interfaces, leveraging on the many sensory organs that humans possess. Among them, the tactile sense is important and useful for close range interaction and manipulation tasks. In this paper, we explore this possibility using a vibro-tactile device on the whole body for simulating collision between the user and virtual environment. We first experimentally verify the effect of enhanced user felt presence by employing localized vibration feedback alone on collision, and further investigate how to effectively provide the sense of collision using the vibro-tactile display in different ways. In particular, we test the effects of using a vibration feedback model (for simulating collision with different object materials), saltation, and simultaneous use of 3D sound toward spatial presence and perceptual realism. The results have shown that employing the proposed vibro-tactile interface did enhance the sense of presence, especially when combined with 3D sound. Furthermore, the use of saltation also helped the user detect and localize the point of contact more correctly. The use of the vibration feedback model was not found to be significantly effective, and sometimes even hindered the correct sense of collision primarily due to the limitation of the vibrotactile display device.

REFERENCES

• 1: Berthoz, A. (Translated by Weiss, G.), The Brain's Sense of Movement. Harvard University Press, 2000.
• 2: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, ACM SIGGRAPH Computer Graphics, v.14 n.3, p.262-270, July 1980
• 3: Chen, L. M., Friedman, R. M., and Roe, A. W., Optical Imaging of a Tactile Illusion in Area 3b of the Primary Somatosensory Cortex. Science, Vol. 302, pp. 881--885, 2003.
• 4: A Map-Based System Using Speech and 3D Gestures for Pervasive Computing, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.191, October 14-16, 2002 [doi>10.1109/ICMI.2002.1166991]
• 5: DiFranco, D. E., Beauregard, G. L., and Srinivasan, M. A., The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments. In G. Rizzoni (Ed.) Proc. of the ASME Dynamic Systems and Control Division, DSC Vol. 61, pp 17--22, 1997.
• 6: Huong Q. Dinh , Neff Walker , Chang Song , Akira Kobayashi , Larry F. Hodges, Evaluating the Importance of Multi-sensory Input on Memory and the Sense of Presence in Virtual Environments, Proceedings of the IEEE Virtual Reality, p.222, March 13-17, 1999
• 7: Geldard, F. A., Sensory Saltation: Metastability in the Perceptual World. New Jersey: Lawrence Erlbaum Associates, 1975.
• 8: Michael A. Grasso , David S. Ebert , Timothy W. Finin, The integrality of speech in multimodal interfaces, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.4, p.303-325, Dec. 1998 [doi>10.1145/300520.300521]
• 9: Eric Gunther , Glorianna Davenport , Sile O'Modhrain, Cutaneous grooves: composing for the sense of touch, Proceedings of the 2002 conference on New interfaces for musical expression, May 24-26, 2002, Dublin, Ireland
• 10: i-Visor, {On-line} avaliable: <u>http://www.personaldisplay.com/.</u>
• 11: Kammermeier, P., Buss, M., and Schmidt, G., A Systems Theoretical for Human Perception in Multimodal Presence Systems. Transactions on IEEE/ASME Mechatronics, 6(3), pp. 234--244, 2001.
• 12: Lin, M., and Gottschalk, S., Collision Detection between Geometric Models: A Survey, Proceedings of IMA Conference on mathematics of Surface, 1998.
• 13: Logitech, "Logitech Force 3D" (Product Description), {Online} available: <u>http://www.logitech.com/index.cfm/products/details/US/EN.</u>
• 14: Mark R. Mine , Frederick P. Brooks, Jr. , Carlo H. Sequin, Moving objects in space: exploiting proprioception in virtual-environment interaction, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.19-26, August 1997 [doi>10.1145/258734.258747]
• 15: Miner, N., and Caudel, T., Computational Requirements and Synchronization Issues for Virtual Acoustic Displays, Presence: Teleoperators and Virtual Environments, MIT, 7(4), pp. 396--409, 1998.
• 16: Mitsutake, N., Hoshiai, K., Igarashi, H., Sugioka, Y., Yamamoto, Y., Yamazaki, K., Yoshida, A., and Yamaguchi, T., Open sesame from top of your head-an event related potential based interface for the control of the virtual reality system, Proceedings of 2nd IEEE International Workshop on Robot and Human Communication, pp. 292--295, 1993.
• 17: Takaaki Nara , Masaya Takasaki , Taro Maeda , Toshiro Higuchi , Shigeru Ando , Susumu Tachi, Surface Acoustic Wave Tactile Display, IEEE Computer Graphics and Applications, v.21 n.6, p.56-63, November 2001 [doi>10.1109/38.963461]
• 18: Okamura, A. M., Dennerlein, J. T., and Howe, R. D., Vibration Feedback Models for Virtual Environments. IEEE Computer Graphics and Application, Vol. 21, No. 6, pp 56--63, 2001.
• 19: PHANTOM, {On-line} available: <u>http://www.sensable.com/products/phantom_ghost/phantom. asp.</u>
• 20: Play Station, {On-line} available: <u>http://www.playstation.com.</u>
• 21: Richard, P., Burdea, G., Gomez, D., and Coiffet, P. A. Comparison of Haptic, Visual and Auditive Force Feedback for Deformable Virtual Objects. Proceedings of ICAT'94 Conference, pp. 49--62, 1994.
• 22: Eva-Lotta Sallnäs , Kirsten Rassmus-Gröhn , Calle Sjöström, Supporting presence in collaborative environments by haptic force feedback, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.4, p.461-476, Dec. 2000 [doi>10.1145/365058.365086]
• 23: Eva-Lotta Sallnäs , Kirsten Rassmus-Gröhn , Calle Sjöström, Supporting presence in collaborative environments by haptic force feedback, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.4, p.461-476, Dec. 2000 [doi>10.1145/365058.365086]
• 24: Sensorama. Invented by Morton Heilig, a filmmaker, a totally mechanical VR device (one person theater), 1961.
• 25: Mel Slater , Martin Usoh , Anthony Steed, Taking steps: the influence of a walking technique on presence in virtual reality, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.3, p.201-219, Sept. 1995 [doi>10.1145/210079.210084]
• 26: Slater, M., and Wilbur, S., A Framework for Immersive Virtual Environments(FIVE): Speculations on the Role of Presence in virtual Environments. Presence: Teleoperators and Virtual Environments, MIT, 6(6), pp. 603--616, 1997.
• 27: Sound Power, {On-line} Availale: <u>http://www.newcoms.co.kr/kor_newcom/kor_main.htm.</u>
• 28: Hong Z. Tan , Alex Pentland, Tactual Displays for Wearable Computing, Proceedings of the 1st IEEE International Symposium on Wearable Computers, p.84, October 13-14, 1997
• 29: TSAS, Tactile Situation Awareness System (TSAS), Information Through the Sense of Touch, {On-line} available: <u>http://www.namrl.navy.mil/accel/TSAS</u>, 2000.
• 30: Jan B. F. van Erp, Tactile Navigation Display, Proceedings of the First International Workshop on Haptic Human-Computer Interaction, p.165-173, August 31-September 01, 2000
• 31: Van Erp, Jan B. F., Veltman, J. A., van Veen, H. A. H. C., and Oving, A. B., Tactile Torso Display as Countermeasure to Reduce Night Vision Goggles Induced Drift, NATO RTO Conference on Spatial Disorientation 15--17, 2002.
• 32: Watanabe, T., and Fujui, S., A Method for Controlling Tactile Sensation of Surface Roughness Using Ultrasonic Vibration. Proc. 1995 IEEE Int. Conf, Robotics and Automation, Vol. 1, pp. 1134--1139, 1995.
• 33: Wellman, P., and Howe, R. D.: "Towards realistic vibrotactile display in virtual environments", proceedings of ASME Dynamic Systems and Control Division, Vol. 57, No. 2, pp. 713--718, 1995.
• 34: Witmer, B. G., and Singer, M. J., Measuring Presence in Virtual Environments: A Presence Questionnaire, Presence, Vol. 7, No. 3, pp. 225--240, 1998.
• 35: Yang, U., Jang Y., and Kim G. J., POS. T. Wear: Vibro-tactile Interface Design for Near-body Space Interaction in VR-based Motion Training System, Intenational Conference on Artificial Reality and Telexistence, 12th ICAT pp. 4--9, 2002.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O; Evaluation/methodology

General Terms:
Experimentation, Human Factors

Keywords:
multimodality, presence, sensory saltation, tactile interface, vibration feedback model, vibrator, virtual environments