Symmetric and asymmetric action integration during cooperative object manipulation in virtual environments

ABSTRACT

Cooperation between multiple users in a virtual environment (VE) can take place at one of three levels. These are defined as where users can perceive each other (Level 1), individually change the scene (Level 2), or simultaneously act on and manipulate the same object (Level 3). Despite representing the highest level of cooperation, multiuser object manipulation has rarely been studied. This paper describes a behavioral experiment in which the piano movers' problem (maneuvering a large object through a restricted space) was used to investigate object manipulation by pairs of participants in a VE. Participants' interactions with the object were integrated together either symmetrically or asymmetrically. The former only allowed the common component of participants' actions to take place, but the latter used the mean. Symmetric action integration was superior for sections of the task when both participants had to perform similar actions, but if participants had to move in different ways (e.g., one maneuvering him/herself through a narrow opening while the other traveled down a wide corridor) then asymmetric integration was superior. With both forms of integration, the extent to which participants coordinated their actions was poor and this led to a substantial cooperation overhead (the reduction in performance caused by having to cooperate with another person).

REFERENCES

• 1: Cagatay Basdogan , Chih-Hao Ho , Mandayam A. Srinivasan , Mel Slater, An experimental study on the role of touch in shared virtual environments, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.4, p.443-460, Dec. 2000 [doi>10.1145/365058.365082]
• 2: Inhabited television: broadcasting interaction from within collaborative virtual environments, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.4, p.510-547, Dec. 2000 [doi>10.1145/365058.365095]
• 3: Doug A. Bowman , Larry F. Hodges, An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.35-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253301]
• 4: Bowman, D. A., Johnson, D. B., and Hodges, L. F. 2001. Testbed evaluation of virtual environment interaction techniques. Presence: Teleoperat. Virtual Environ. 10, 1, 75--95.
• 5: W. Broll, Interacting in distributed collaborative virtual environments, Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95), p.148, March 11-15, 1995
• 6: Frécon, E. and Stenius, M. 1998. DIVE: A scalable network architecture for distributed virtual environments. Distrib. Syst. Eng. 5, 3, 91--100.
• 7: Bernd Fröhlich , Henrik Tramberend , Andrew Beers , Maneesh Agrawala , David Baraff, Physically-Based Manipulation on the Responsive Workbench, Proceedings of the IEEE Virtual Reality 2000 Conference, p.5, March 18-22, 2000
• 8: S. Gottschalk , M. C. Lin , D. Manocha, OBBTree: a hierarchical structure for rapid interference detection, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.171-180, August 1996 [doi>10.1145/237170.237244]
• 9: Green, M., 1995. The MR Toolkit Version 1.4 {Computer program}. Department of Computing Science, University of Alberta, Edmonton, Alta., Canada.
• 10: Chris Greenhalgh , Steven Benford, MASSIVE: a collaborative virtual environment for teleconferencing, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.3, p.239-261, Sept. 1995 [doi>10.1145/210079.210088]
• 11: Guiard, Y. 1987. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. J. Motor Behav. 19, 4, 486--517.
• 12: Hand, C. 1997. A survey of 3D interaction techniques. Comput. Graph. Forum 16, 5, 269--281.
• 13: Jon Hindmarsh , Mike Fraser , Christian Heath , Steve Benford , Chris Greenhalgh, Object-focused interaction in collaborative virtual environments, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.4, p.477-509, Dec. 2000 [doi>10.1145/365058.365088]
• 14: Hollerbach, J. M. 2002. Locomotion interfaces. In Handbook of Virtual Environments, K. M. Stanney, Ed. Lawrence Erlbaum, Mahwah, NJ, 239--254.
• 15: Hubbold, R. and Keates, M. 2000. Real-time simulation of a stretcher evacuation in a large-scale virtual environment. Comput. Graph. Forum 19, 2, 123--134.
• 16: Jed Lengyel , Mark Reichert , Bruce R. Donald , Donald P. Greenberg, Real-time robot motion planning using rasterizing computer graphics hardware, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.327-335, Aug. 1990
• 17: Loftin, R. B. 1997. Hands Across the Atlantic. IEEE Comput. Graph. Appl. 17, 2, 78--79.
• 18: Macedonia, M. R., Zyda, M. J., Pratt, D. R., Barham, P. T., and Zeswitz, S. 1994. NPSNET: a network software architecture for large-scale virtual environments. Presence: Teleoperat. Virtual Environ. 3, 4, 265--287.
• 19: Margery D. M., Arnaldi B., and Plouzeau N. 1999. A general framework for cooperative manipulation in virtual environments. In Proceedings of EGVE 99: Eurographics Workshop on Virtual Environments. Springer, New York, N.Y., 169--178.
• 20: Maurice R. Masliah , Paul Milgram, Measuring the allocation of control in a 6 degree-of-freedom docking experiment, Proceedings of the SIGCHI conference on Human factors in computing systems, p.25-32, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332403]
• 21: William A. McNeely , Kevin D. Puterbaugh , James J. Troy, Six degree-of-freedom haptic rendering using voxel sampling, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.401-408, July 1999 [doi>10.1145/311535.311600]
• 22: Ruddle, R. A. and Jones, D. M. 2001a. Manual and virtual rotation of a three-dimensional object. J. Exper. Psych.: Appl. 7, 4, 286--296.
• 23: Ruddle, R. A. and Jones, D. M. 2001b. Movement in cluttered virtual environments. Presence: Teleoperat. Virtual Environ. 10, 5, 511--524.
• 24: Roy A. Ruddle , Justin C. D. Savage , Dylan M. Jones, Evaluating rules of interaction for object manipulation in cluttered virtual environments, Presence: Teleoperators and Virtual Environments, v.11 n.6, p.591-609, December 2002 [doi>10.1162/105474602321050721]
• 25: Eva-Lotta Sallnäs , Kirsten Rassmus-Gröhn , Calle Sjöström, Supporting presence in collaborative environments by haptic force feedback, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.4, p.461-476, Dec. 2000 [doi>10.1145/365058.365086]
• 26: Shepard, R. N. and Metzler, J. 1971. Mental rotation of three-dimensional objects. Science 171, 701--703.
• 27: Slater, M., Sadagic, A., Usoh, M., and Schroeder, R. 2000. Small-group behavior in a virtual and real environment: A comparative study. Presence: Teleoperat. Virtual Environ. 9, 1, 37--51.
• 28: Slater, M., Steed, A., Crowcroft, J., Whitton, M. C., Brooks Jr. F. P., and Srinivasan, M. A. 2001. Final report of the Collaboration in Tele-immersive Environments project. Retrieved from the World Wide Web March 19, 2002. http://www.cs.ucl.ac.uk/research/vr/Projects/Internet2/Report/finalreport.pdf.
• 29: Sonnenwald, D. H., Bergquist, R. E., Maglaughlin, K. L., Kupstas-Soo, E., and Whitton, M. C. 2001. Designing to support collaborative scientific research across distances: The nanoManipulator environment. In Collaborative Virtual Environments, E. F. Churchill, D. N. Snowdon, and A. J. Munro, Eds. Springer-Verlag, London, England, 202--224.
• 30: Wang, Y. and MacKenzie, C. L. 1999. Effects of orientation disparity between haptic and graphic displays of objects in virtual environments. In Proceedings of the IFIP Conference on Human-Computer Interaction (INTERACT 99). IOS Press, Amsterdam, The Netherlands, 391--398.
• 31: Colin Ware , Jeff Rose, Real handles, virtual images, CHI 98 conference summary on Human factors in computing systems, p.235-236, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286721]
• 32: Wickens, C. D. and Prevett, T. T. 1995. Exploring the dimensions of egocentricity in aircraft navigation displays. J. Exper. Psych.: Appl. 1, 2, 110--135.
• 33: Josef Wideström , Ann-Sofie Axelsson , Ralph Schroeder , Alexander Nilsson , Ilona Heldal , Åsa Abelin, The collaborative cube puzzle: a comparison of virtual and real environments, Proceedings of the third international conference on Collaborative virtual environments, p.165-171, September 2000, San Francisco, California, United States [doi>10.1145/351006.351035]
• 34: Shumin Zhai , Paul Milgram, Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices, Proceedings of the SIGCHI conference on Human factors in computing systems, p.320-327, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274689]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Experimentation, Human Factors, Measurement, Performance

Keywords:
Virtual environments, object manipulation, piano movers' problem, rules of interaction