The cost of supporting references in collaborative augmented reality

ABSTRACT

For successful collaboration to occur, a fundamental requirement is the ability for participants to refer to artifacts within the shared environment. This task is often straightforward in traditional collaborative desktop applications, yet the spatial properties found in mixed reality environments greatly impact the complexity of generating and interpreting meaningful reference cues. Although awareness is a very active area of research, little focus has been given to the environmental and contextual factors that influence referencing or the costs associated with supporting it in mixed reality environments.

The work presented here consists of a compilation of understanding we have gained through user observation, participant feedback and system development. We begin by summarizing our findings from several user studies in collaborative augmented reality (AR). To organize the complexity associated with referencing in AR, we enumerate contextual and environmental factors that influence referential awareness - integrating discussion about user preferences and the impact they have on the underlying technological requirements. Finally, we discuss how these factors can impact the design space of collaborative systems and describe the cost associated with supporting references in collaborative AR.

REFERENCES

• 1: Michael Bajura , Henry Fuchs , Ryutarou Ohbuchi, Merging virtual objects with the real world: seeing ultrasound imagery within the patient, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.203-210, July 1992
• 2: Paul Dourish , Victoria Bellotti, Awareness and coordination in shared workspaces, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.107-114, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143468]
• 3: William W. Gaver, The affordances of media spaces for collaboration, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.17-24, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.371596]
• 4: A. J. Sellen, "Remote Conversations: The Effects of Mediating Talk With Technology," Human-Computer Interaction, vol. 10, pp. 401--444, 1995.
• 5: Robert E. Kraut , Mark D. Miller , Jane Siegel, Collaboration in performance of physical tasks: effects on outcomes and communication, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.57-66, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240190]
• 6: Martin Bauer , Gerd Kortuem , Zary Segall, "Where Are You Pointing At?" A Study of Remote Collaboration in a Wearable Videoconference System, Proceedings of the 3rd IEEE International Symposium on Wearable Computers, p.151, October 18-19, 1999
• 7: G. Bafoutsou, Mentaz, G., "Review and functional classification of collaborative systems," International Journal of Information Management, vol. 22, pp. 281--305, 2002.
• 8: D. Ott, Dillenbourg, P., "Using Proximity and View Awareness to Reduce Referential Ambiguity in a Shared 3D Virtual Environment," in CSCL, 2001.
• 9: K. Kiyokawa , M. Billinghurst , S. E. Hayes , A. Gupta , Y. Sannohe , H. Kato, Communication Behaviors of Co-Located Users in Collaborative AR Interfaces, Proceedings of the 1st International Symposium on Mixed and Augmented Reality, p.139, September 30-October 01, 2002
• 10: Mark Billinghurst , Suzane Weghorst , Tom Furness Iii, Wearable Computers for Three Dimensional CSCW, Proceedings of the 1st IEEE International Symposium on Wearable Computers, p.39, October 13-14, 1997
• 11: M. Billinghurst , H. Kato , S. Bee , J. Bowskill, Asymmetries in Collaborative Wearable Interfaces, Proceedings of the 3rd IEEE International Symposium on Wearable Computers, p.133, October 18-19, 1999
• 12: A. Stafford, Piekarski, W., Thomas, B. H., "Implementation of God-like Interaction Techniques for Supporting Collaboration Between Outdoor AR and Indoor Tabletop Users," Proc. of International Symposium on Mixed and Augmented Reality (ISMAR), 2006.
• 13: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, Proceedings of the 7th annual conference on Computer graphics and interactive techniques, p.262-270, July 14-18, 1980, Seattle, Washington, United States
• 14: J. LaVoila, "Whole-Hand and Speech Input in Virtual Environments," Masters Thesis, Brown University, 1996.
• 15: Doug A. Bowman , Ernst Kruijff , Joseph J. LaViola , Ivan Poupyrev, 3D User Interfaces: Theory and Practice, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 2004
• 16: Jeffrey W. Chastine , Jeremy C. Brooks , Ying Zhu , G. Scott Owen , Robert W. Harrison , Irene T. Weber, AMMP-Vis: a collaborative virtual environment for molecular modeling, Proceedings of the ACM symposium on Virtual reality software and technology, November 07-09, 2005, Monterey, CA, USA [doi>10.1145/1101616.1101620]
• 17: Jeffrey W. Chastine , Kristine Nagel , Ying Zhu , Luca Yearsovich, Understanding the design space of referencing in collaborative augmented reality environments, Proceedings of Graphics Interface 2007, May 28-30, 2007, Montreal, Canada [doi>10.1145/1268517.1268552]
• 18: Tom Rodden, Populating the application: a model of awareness for cooperative applications, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.87-96, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240200]
• 19: J. W. Chastine, Zhu, Y., Preston, J. A, "A Framework for Interreferential Awareness in Collaborative Environments," Proc. of 2nd IEEE International Conference on Collaborative Computing, Atlanta, GA, 2006.
• 20: Niklas Elmqvist, BalloonProbe: reducing occlusion in 3D using interactive space distortion, Proceedings of the ACM symposium on Virtual reality software and technology, November 07-09, 2005, Monterey, CA, USA [doi>10.1145/1101616.1101643]
• 21: Ivan Poupyrev , Mark Billinghurst , Suzanne Weghorst , Tadao Ichikawa, The go-go interaction technique: non-linear mapping for direct manipulation in VR, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.79-80, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237102]
• 22: Frank Biocca , Arthur Tang , Charles Owen , Fan Xiao, Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124939]
• 23: Jon Hindmarsh , Mike Fraser , Christian Heath , Steve Benford , Chris Greenhalgh, Object-focused interaction in collaborative virtual environments, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.4, p.477-509, Dec. 2000 [doi>10.1145/365058.365088]
• 24: K. Kiyokawa, Iwasa, H. Takemura, H., Yokoya, N., "Collaborative immersive workspace through a shared augmented environment.," Proc. of The Society for Photo-Optical Instrumentation Engineers (SPIE), 1998, pp. 2--13.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing

Keywords:
augmented reality, awareness, collaboration, references, referencing