Towards multi-site collaboration in tele-immersive environments

ABSTRACT

Tele-immersion is emerging as a new medium that creates 3D photorealistic, immersive, and interactive experience between geographically dispersed users. However, most existing tele-immersive systems can only support two-way collaboration. In this paper we propose a multi-layer framework and a new data dissemination protocol to support multi-site collaboration. The problem context is unique as multiple remote sites participate in an interactive tele-immersive session, where each site has multiple correlated 3D video streams to send (later referred as multi-stream/multi-site environments). The key challenge is to disseminate such large number of 3D live video streams among these sites subject to the bandwidth and latency constraints while satisfying QoS guarantees in visual quality. Among our findings is that the simple randomized algorithm outperforms many other static algorithms in the unique context. Moreover, the streams generated from one site have high semantic correlation, because often cameras at one site are shooting the same scene, only from different angles. We exploit the stream correlation in the multicast protocol to minimize the level of loss.

REFERENCES

• 1: H. Baker, N. Bhatti, D. Tanguay, I. Sobel, D. Gelb, M. Goss, W. Culbertson, and T. Malzbender. The coliseum immersive teleconferencing system. ACM Trans. on Multimedia Computing, Communications, and Applications, 2005.
• 2: Milton Chen, Design of a virtual auditorium, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500147]
• 3: Abigail J. Sellen , Sylvia B. Wilbur , Kathleen E. Finn, Video-Mediated Communication, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1997
• 4: L. Gharai, C. Perkins, R. Riley, and A. Mankin. Large scale video conferencing: A digital amphitheater. In Proc. 8th International Conference on Distributed Multimedia Systems, 2002.
• 5: Mojtaba Hosseini , Nicolas D. Georganas, Design of a multi-sender 3D videoconferencing application over an end system multicast protocol, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957119]
• 6: Sang-Hack Jung , Ruzena Bajcsy, Learning Physical Activities in Immersive Virtual Environments, Proceedings of the Fourth IEEE International Conference on Computer Vision Systems, p.5, January 04-07, 2006 [doi>10.1109/ICVS.2006.38]
• 7: Ramesh Raskar , Greg Welch , Matt Cutts , Adam Lake , Lev Stesin , Henry Fuchs, The office of the future: a unified approach to image-based modeling and spatially immersive displays, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.179-188, July 1998 [doi>10.1145/280814.280861]
• 8: Z. Wang and J. Crowcroft. Qos routing for supporting resource reservation. In IEEE Journal on Selected areas in Communications, Sep. 1996.
• 9: G. Welch, D. H. Sonnenwald, K. Mayer-Patel, R. Yang, A. State, H. Towles, B. Cairns, and H. Fuchs. Remote 3d medical consultation. In Proc. of the 2nd International Conference on Broadband Networks, 2005.
• 10: Zhenyu Yang , Klara Nahrstedt , Yi Cui , Bin Yu , Jin Liang , Sang-hack Jung , Ruzena Bajscy, TEEVE: The Next Generation Architecture for Tele-immersive Environment, Proceedings of the Seventh IEEE International Symposium on Multimedia, p.112-119, December 12-14, 2005 [doi>10.1109/ISM.2005.113]
• 11: Zhenyu Yang , Bin Yu , Wanmin Wu , Klara Nahrstedt , Ross Diankov , Ruzena Bajscy, A Study of Collaborative Dancing in Tele-immersive Environments, Proceedings of the Eighth IEEE International Symposium on Multimedia, p.177-184, December 11-13, 2006 [doi>10.1109/ISM.2006.14]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Distributed applications

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

General Terms:
Design, Experimentation, Measurement

Keywords:
multicast, overlay, tele-immersion