An experimental study on the role of touch in shared virtual environments

ABSTRACT

Investigating virtual environments has become an increasingly interesting research topic for engineers, computer and cognitive scientists, and psychologists. Although there have been several recent studies focused on the development of multimodal virtual environments (VEs) to study human-machine interactions, less attention has been paid to human-human and human-machine interactions in shared virtual environments (SVEs), and to our knowledge, no attention paid at all to what extent the addition of haptic communication between people would contribute to the shared experience. We have developed a multimodal shared virtual environment and performed a set of experiments with human subjects to study the role of haptic feedback in collaborative tasks and whether haptic communication through force feedback can facilitate a sense of being and collaborating with a remote partner. The study concerns a scenario where two participants at remote sites must cooperate to perform a joint task in an SVE. The goals of the study are (1) to assess the impact of force feedback on task performance, (2) to better understand the role of haptic communication in human-human interactions, (3) to study the impact of touch on the subjective sense of collaborating with a human as reported by the participants based on what they could see and feel, and (4) to investigate if gender, personality, or emotional experiences of users can affect haptic communication in SVEs. The outcomes of this research can have a powerful impact on the development of next-generation human-computer interfaces and network protocols that integrate touch and force feedback technology into the internet, development of protocols and techniques for collaborative teleoperation such as hazardous material removal, space station.

REFERENCES

• 1: Woodrow Barfield , Thomas A. Furness, III, Virtual environments and advanced interface design, Oxford University Press, Inc., New York, NY, 1995
• 2: BASDOGAN, C., HO, C., AND SRINIVASAN, M. A. 1997. A ray-based haptic rendering technique for displaying shape and texture of 3D objects in virtual environments. In Proceedings of the Conference on ASME Winter Annual Meeting (Dallas, TX). 77-84.
• 3: BASDOGAN, C., HO, C., SLATER, M., AND SRINIVASAN, M. A. 1998. The role of haptic communication in shared virtual environments. In Proceedings of the Third Workshop on Phantom User Group (Dedham, MA, Oct. 3-6). http://www.ai.mit.edu/conferences/pug98
• 4: Steve Benford , Chris Greenhalgh , Gail Reynard , Chris Brown , Boriana Koleva, Understanding and constructing shared spaces with mixed-reality boundaries, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.3, p.185-223, Sept. 1998 [doi>10.1145/292834.292836]
• 5: W. Broll, Interacting in distributed collaborative virtual environments, Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95), p.148, March 11-15, 1995
• 6: CHOI,H.R.,CHOI,B.H.,AND RYEW, S. M. 1997. Haptic display in virtual collaborative workspace shared by multiple users. In Proceedings of IEEE International Workshop on Robot and Human Communication. 478-483.
• 7: H. Das , H. Zak , W. S. Kim , A. K. Bejczy , P. S. Schenker, Operator performance with alternative manual control modes in teleoperation, Presence: Teleoperators and Virtual Environments, v.1 n.2, p.201-218, Spring 1992
• 8: DURLACH,N.AND SLATER, M. 2000. Presence in virtual environments and virtual togetherness. Presence: Teleoper. Virtual Environ. 9,1.
• 9: ELLIS, S. R. 1992. Nature and origin of virtual environments: A bibliographic essay. Comput. Syst. Engin. 2, 4, 321-347.
• 10: Richard M. Held , Nathaniel I. Durlach, Telepresence, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.109-112, Winter 1992
• 11: HO, C., BASDOGAN, C., SLATER, M., DURLACH, N., AND SRINIVASAN, M. A. 1998. An experiment on the influence of haptic communication on the sense of being together. In Proceedings of the British Telecom Workshop on Presence in Shared Virtual Environments (Ipswich, Suffolk, June 10-11).
• 12: HO, C., BASDOGAN, C., AND SRINIVASAN, M. A. 1999. An efficient haptic rendering technique for displaying 3D polyhedral objects and their surface details in virtual environments. Presence: Teleoper. Virtual Environ. 8, 5, 477-491.
• 13: U. Jasnoch , B. Anderson , H. Joseph, Shared 3D environments within a virtual prototyping environment, Proceedings of the 5th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET ICE'96), p.274, June 19-21, 1996
• 14: LEARY, M. 1983. Social anxiousness: The construct and its measurement. J. Person. Asses. 47, 66-75.
• 15: Michael R. Macedonia , Stefan Noll, A Transatlantic Research and Development Environment, IEEE Computer Graphics and Applications, v.17 n.2, p.76-82, March 1997 [doi>10.1109/38.574686]
• 16: NORMAND, V., BABSKI, C., BENFORD, S., BULLOCK, A., CARION, S., FARCET, N., FRECON, E., HARVEY, J., KIUJPERS, N., MAGNENAT-THALMANN, N., RAUPP-MUSSE, S., RODDEN, T., SLATER, M., SMITH, G., STEED, A., THALMANN, D., TROMP, J., USOH, M., VAN LIEMPD, G., AND KLADIAS, N. 1999. The COVEN project: Exploring applicative, technical and usage dimensions of collaborative virtual environments. Presence: Teleoper. Virtual Environ. 8, 2, 218-236.
• 17: Kyoung Shin Park , Robert V. Kenyon, Effects of Network Characteristics on Human Performance in a Collaborative Virtual Environment, Proceedings of the IEEE Virtual Reality, p.104, March 13-17, 1999
• 18: J. Kenneth Salisbury , Mandayam A. Srinivasan, Phantom-Based Haptic Interaction with Virtual Objects, IEEE Computer Graphics and Applications, v.17 n.5, p.6-10, September 1997 [doi>10.1109/MCG.1997.1626171]
• 19: Thomas B. Sheridan, Musings on telepresence and virtual presence, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.120-126, Winter 1992
• 20: Thomas B. Sheridan, Telerobotics, automation, and human supervisory control, MIT Press, Cambridge, MA, 1992
• 21: SCHROEDER, R. 1997. Networked worlds: Social aspects of multi-user virtual reality technology. Soc. Res. Onl. 2, 4. http://www.socresonline.org.uk/socresonline/2/4/5.html
• 22: SLATER, M., SADAGIC, A., USOH, M., AND SCHROEDER, R. 2000. Small group behaviour in a virtual and real environment. Presence: Teleoper. Virtual Environ. 9, 1, 37-51.
• 23: SRINIVASAN,M.A.AND BASDOGAN, C. 1997. Haptics in virtual environments: Taxonomy, research status, and challenges. Comput. Graph. 21, 4, 393-404.
• 24: STANNEY,K.M.AND SALVENDY, G. 1998. Aftereffects and sense of presence in virtual environments: Formulation of a research and development agenda. Int. J. Hum.-Comput. Interact. 10, 2, 135-187.
• 25: STANNEY,K.M.,MOURANT,R.R.,AND KENNEDY, R. S. 1998. Human factors issues in virtual environments: A review of the literature. Presence: Teleoper. Virtual Environ. 7, 4, 327-351.
• 26: Anthony Steed , Mel Slater , Amela Sadagic , Adrian Bullock , Jolanda Tromp, Leadership and Collaboration in Shared Virtual Environments, Proceedings of the IEEE Virtual Reality, p.112, March 13-17, 1999
• 27: Jolanda Tromp , Adrian Bullock , Anthony Steed , Amela Sadagic , Mel Slater , Emmanuel Frécon, Small Group Behavior Experiments in the Coven Project, IEEE Computer Graphics and Applications, v.18 n.6, p.53-63, November 1998 [doi>10.1109/38.734980]
• 28: WATERS,R.AND BARRUS, J. 1997. The rise of shared virtual environments. IEEE Spectrum 34, 3 (Mar.), 20-25.
• 29: WELCH,R.B.,BLACKMON,T.T.,LIU, A., MELLERS,B.A.,AND STARK, L. W. 1996. The effects of pictorial realism, delay of visual feedback, and observer interactively on the subjective sense of presence. Presence: Teleoper. Virtual Environ. 5, 3, 263-273.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); Haptic I/O

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics
          Subjects: Manipulators
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Design, Human Factors, Management, Performance, Theory

Keywords:
copresence, force feedback devices, haptic interaction, shared virtual environments