Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Recent studies have shown that through a careful combination of multiple sensory channels, so called multisensory binding effects can be achieved that can be beneficial for collision detection and texture recognition feedback. During the design of a new pen-input device called Tactylus, specific focus was put on exploring multisensory effects of audiotactile cues to create a new, but effective way to interact in virtual environments with the purpose to overcome several of the problems noticed in current devices.

REFERENCES

• 1: Kaczmarek, K., et al., Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Transactions on Biomechanical Engineering, 38, 1, 1991.
• 2: Shimojo, S. and Shams, L. Sensory modalities are not separate modalities: plasticity and interactions. Current Opinion in Neurobiology, 11, 2001, 505--509.
• 3: Weisenberger, J. and Poling, G. Multisensory Roughness Perception of Virtual Surfaces: Effects of Correlated Cues. In Proceedings of the 12th International Symposium on Haptic Interfaces for Virtual Environments and Teleoperators Systems (HAPTICS'04). 2004.
• 4: Szalavari, Z. and Gervautz, M. The Personal Interaction Panel - a Two-Handed Interface for Augmented Reality. Computer Graphics Forum, 16, 3, 1997, 335--346.
• 5: Watsen, K., Darken, R. and Capps, M. A Handheld Computer as an Interaction Device to a Virtual Environment. In Proceedings of the Third Immersive Projection Technology Workshop. 1999.
• 6: Li-Te Cheng , Rick Kazman , John Robinson, Vibrotactile feedback in delicate virtual reality operations, Proceedings of the fourth ACM international conference on Multimedia, p.243-251, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244220]
• 7: Robert W. Lindeman , John L. Sibert , Corinna E. Lathan , Jack M. Vice, The Design and Deployment of a Wearable Vibrotactile Feedback System, Proceedings of the Eighth International Symposium on Wearable Computers (ISWC'04), p.56-59, October 31-November 03, 2004 [doi>10.1109/ISWC.2004.43]
• 8: MERL, Haptic Stylus project summary, available at: http://www.merl.com/projects/hapticstylus/. 2004.
• 9: Fiorentino, M., Monno, G. and Uva, A. The Senstylus: a novel rumble-feedback pen device for CAD application in Virtual Reality. In Proceedings of the 13th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision'2005 (WSCG 2005). 2005.
• 10: Spence, C. and Squire, S. Multisensory Integration: Maintaining the Perception of Synchrony. Current Biology, 13, 2003, 519--521.
• 11: Pai, D. Multisensory Interaction: Real and Virtual. In Proceedings of the International Symposium on Robotics Research. 2003.
• 12: S. J. Lederman , Andrea Martin , Christine Tong , Roberta L. Klatzky, Relative Performance Using Haptic and/or Touch-Produced Auditory Cues in a Remote Absolute Texture Identification Task, Proceedings of the 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS'03), p.151, March 22-23, 2003
• 13: Guest, S., et al., Audiotactile interactions in roughness perception. Experimental Brain Research, 146, 2002, 161--171.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Design, Experimentation, Human Factors, Measurement, Performance

Keywords:
3D user interfaces, audiotactile feedback, sensory, substitution