Understanding and constructing shared spaces with mixed-reality boundaries

ABSTRACT

We propose an approach to creating shared mixed realities based on the construction of transparent boundaries between real and virtual spaces. First, we introduce a taxonomy that classifies current approaches to shared spaces according to the three dimensions of transportation, artificiality, and spatiality. Second, we discuss our experience of staging a poetry performance simultaneously within real and virtual theaters. This demonstrates the complexities involved in establishing social interaction between real and virtual spaces and motivates the development of a systematic approach to mixing realities. Third, we introduce and demonstrate the technique of mixed-reality boundaries as a way of joining real and virtual spaces together in order to address some of these problems.

REFERENCES

• 1: BENFORD, S., BOWERS, J., FAHLEN, L. E., MARIANI, J., AND RODDEN, T. 1994. Supporting co-operative work in virtual environments. Comput. J. 37, 8.
• 2: Steve Benford , Chris Brown , Gail Reynard , Chris Greenhalgh, Shared spaces: transportation, artificiality, and spatiality, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.77-86, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240196]
• 3: Steve Benford , Chris Greenhalgh , David Lloyd, Crowded collaborative virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.59-66, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258588]
• 4: BENFORD, S. D., GREENHALGH, C. M., SNOWDON, D. N., AND BULLOCK, A. N. 1997b. Staging a public poetry performance in a collaborative virtual environment. In Proceedings of the 5th European Conference on Computer-Supported Cooperative Work (ECSCW '97, Lancaster, UK, Sept.). Kluwer B.V., Deventer, The Netherlands.
• 5: Steve Benford , Dave Snowdon , Chris Brown , Gail Reynard , Rob Ingram, The populated web: Browsing, searching and inhabiting the WWW using collaborative virtual environments, Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.539-546, July 14-18, 1997
• 6: Steve Benford , Chris Greenhalgh , Chris Brown , Graham Walker , Tim Regan , Jason Morphett , John Wyver , Paul Rea, Experiments in inhabited TV, CHI 98 conference summary on Human factors in computing systems, p.289-290, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286768]
• 7: BILLINGHURST, M., WEGHORST, S., AND FURNESS, T., III 1996. Shared Space: An augmented reality interface for computer supported collaborative work. In Proceedings of the Workshop on Collaborative Virtual Environments (CVE '96, Nottingham, UK, Sept.).
• 8: Sara A. Bly , Steve R. Harrison , Susan Irwin, Media spaces: bringing people together in a video, audio, and computing environment, Communications of the ACM, v.36 n.1, p.28-46, Jan. 1993 [doi>10.1145/151233.151235]
• 9: John Bowers , James Pycock , Jon O'Brien, Talk and embodiment in collaborative virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.58-65, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238404]
• 10: S. Cook , G. Birch , A. Murphy , J. Woolsey, Modelling groupware in the electronic office, Computer-supported cooperative work and groupware, Academic Press Ltd., London, UK, 1991
• 11: Carolina Cruz-Neira , Daniel J. Sandin , Thomas A. DeFanti , Robert V. Kenyon , John C. Hart, The CAVE: audio visual experience automatic virtual environment, Communications of the ACM, v.35 n.6, p.64-72, June 1992 [doi>10.1145/129888.129892]
• 12: Paul Dourish , Sara Bly, Portholes: supporting awareness in a distributed work group, Proceedings of the SIGCHI conference on Human factors in computing systems, p.541-547, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142982]
• 13: Lennart E. Fahlén , Charles Grant Brown , Olov Ståhl , Christer Carlsson, A space based model for user interaction in shared synthetic environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.43-48, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169068]
• 14: Geraldine Fitzpatrick , Simon Kaplan , Tim Mansfield, Physical spaces, virtual places and social worlds: a study of work in the virtual, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.334-343, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240322]
• 15: FLEISCHMANN, M. 1995. Imagination systems--Interface design for science, art and education. In Conference Proceedings of Imagina '95 (Imagina '95, Monte Carlo, Feb. 1-3). 257-261.
• 16: Thomas M. J. Fruchterman , Edward M. Reingold, Graph drawing by force-directed placement, Software—Practice & Experience, v.21 n.11, p.1129-1164, Nov. 1991 [doi>10.1002/spe.4380211102]
• 17: William W. Gaver, The affordances of media spaces for collaboration, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.17-24, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.371596]
• 18: William Gaver , Thomas Moran , Allan MacLean , Lennart Lövstrand , Paul Dourish , Kathleen Carter , William Buxton, Realizing a video environment: EuroPARC's RAVE system, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-35, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142754]
• 19: William W. Gaver , Abigail Sellen , Christian Heath , Paul Luff, One is not enough: multiple views in a media space, Proceedings of the SIGCHI conference on Human factors in computing systems, p.335-341, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169268]
• 20: Chris Greenhalgh , Steven Benford, MASSIVE: a collaborative virtual environment for teleconferencing, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.3, p.239-261, Sept. 1995 [doi>10.1145/210079.210088]
• 21: Steve Harrison , Paul Dourish, Re-place-ing space: the roles of place and space in collaborative systems, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.67-76, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240193]
• 22: HEATH, C. AND LUFF, P. 1991. Collaborative activity and technological design: Task coordination in London underground control rooms. In Proceedings of the European Conference on Computer-Supported Cooperative Work (ECSCW '91), L. Bannon, M. Robinson, and K. Schmidt, Eds.. Kluwer B.V., Deventer, The Netherlands.
• 23: Scott E. Hudson , Ian Smith, Techniques for addressing fundamental privacy and disruption tradeoffs in awareness support systems, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.248-257, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240295]
• 24: John A. Hughes , David Randall , Dan Shapiro, Faltering from ethnography to design, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.115-122, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143469]
• 25: ICHIKAWA, Y., OKADA, K., JEONG, G., TANAKA, S., AND MATUSHITA, Y. 1995. MAJIC videoconferencing system: Experiments, evaluation and improvement. In Proceedings of the European Conference on Computer-Supported Cooperative Work (ECSCW '95, Stockholm, Sweden, Sept.). Kluwer B.V., Deventer, The Netherlands.
• 26: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 27: Hiroshi Ishii , Minoru Kobayashi , Jonathan Grudin, Integration of inter-personal space and shared workspace: ClearBoard design and experiments, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.33-42, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143459]
• 28: KENDON, A. 1990. Conducting Interaction: Patterns of Behaviour in Focused Encounters. Cambridge University Press, New York, NY.
• 29: KUZUOKA, H., ISHIMODA, G., AND NISHIMURA, T. 1995. Can the GestureCam be a surrogate?. In Proceedings of the European Conference on Computer-Supported Cooperative Work (ECSCW '95, Stockholm, Sweden, Sept.). Kluwer B.V., Deventer, The Netherlands.
• 30: Nobuyuki Matsushita , Jun Rekimoto, HoloWall: designing a finger, hand, body, and object sensitive wall, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.209-210, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263549]
• 31: MILGRAM, P. AND KISHINO, F. 1994. A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. E77-D, 12 (Dec.).
• 32: Hideyuki Nakanishi , Chikara Yoshida , Toshikazu Nishimura , Toru Ishida, FreeWalk: supporting casual meetings in a network, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.308-314, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240314]
• 33: M. H. Olson , S. A. Bly, The Portland experience: a report on a distributed research group, Computer-supported cooperative work and groupware, Academic Press Ltd., London, UK, 1991
• 34: Gail Reynard , Steve Benford , Chris Greenhalgh , Christian Heath, Awareness driven video quality of service in collaborative virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.464-471, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274707]
• 35: Tom Rodden, Populating the application: a model of awareness for cooperative applications, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.87-96, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240200]
• 36: Robert W. Root, Design of a multi-media vehicle for social browsing, Proceedings of the 1988 ACM conference on Computer-supported cooperative work, p.25-38, September 26-28, 1988, Portland, Oregon, United States [doi>10.1145/62266.62269]
• 37: SACKS, H., SCHEGLOFF, E., AND JEFFERSON, G. 1974. A simplest systematics for the organisation of turn-taking in conversation. Language 50, 696-735.
• 38: Sunil Sarin , Irene Greif, Computer-based real-time conferencing systems, Computer, v.18 n.10, p.33-45, Oct. 1985 [doi>10.1109/MC.1985.1662711]
• 39: SCHMALSTIEG, D., FUHRMANN, A., SZALAVARI, Z., AND GERVAUTZ, M. 1996. Studierstube--An environment for collaboration in augmented reality. In Proceedings of the Workshop on Collaborative Virtual Environments (CVE '96, Nottingham, UK, Sept.).
• 40: Abigail Sellen , Bill Buxton , John Arnott, Using spatial cues to improve videoconferencing, Proceedings of the SIGCHI conference on Human factors in computing systems, p.651-652, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143070]
• 41: Thomas B. Sheridan, Musings on telepresence and virtual presence, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.120-126, Winter 1992
• 42: Li Shu , Woodie Flowers, Groupware experiences in three-dimensional computer-aided design, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.179-186, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143477]
• 43: SLATER, M., USOH, M., AND STEED, A. 1994. Depth of presence in virtual environments. Presence: Teleoper. Virtual Environ. 3, 2 (Spring), 130-144.
• 44: Mel Slater , Martin Usoh , Anthony Steed, Taking steps: the influence of a walking technique on presence in virtual reality, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.3, p.201-219, Sept. 1995 [doi>10.1145/210079.210084]
• 45: STONE, R. J. 1991. Advanced human-system interfaces for telerobotics using virtual reality and telepresence technologies. In Proceedings of the 5th International Conference on Advanced Robotics in Unstructured Environments (ICAR'91).
• 46: SUZUKI, G. 1995. Interspace: Toward networked virtual reality of cyberspace. In Conference Proceedings of lmagina '95 (Imagina '95, Monte-Carlo, Feb. 1-3).
• 47: Haruo Takemura , Fumio Kishino, Cooperative work environment using virtual workspace, Proceedings of the 10th International Conference of the Computer Graphics Society on Visual computing : integrating computer graphics with computer vision: integrating computer graphics with computer vision, p.171-181, October 1992, Tokyo, Japan
• 48: Pierre Wellner , Wendy Mackay , Rich Gold, Back to the real world, Communications of the ACM, v.36 n.7, p.24-27, July 1993 [doi>10.1145/159544.159555]
• 49: ZYDA, M. J., PRATT, D. R., FALBY, J. S., LOMBARDO, C., AND K~LLEHER, K. M. 1993. The software required for computer generation of virtual environments. Presence: Teleoper. Virtual Environ. 2, 2 (Spring), 130-140.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Theory and models

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Computer conferencing, teleconferencing, and videoconferencing
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

General Terms:
Human Factors, Theory

Keywords:
CSCW, augmented reality, collaborative virtual environments, media-spaces, mixed reality, shared spaces, telepresence, video, virtual reality