MobileTI: a portable tele-immersive system

ABSTRACT

We present MobileTI, a portable tele-immersive system that merges 3D video representations of users in real time to enable remote collaboration across geographical distances. With portability as a main goal, we address the challenges in the camera setup, time synchronization, video acquisition, and networking in the design and implementation of the system. Having been deployed in public performances, MobileTI proves to be effective, efficient, and user-friendly. Our experimental findings in terms of technical performance and user feedback are presented.

REFERENCES

• 1: J. Bailenson, K. Patel, A. Nielsen, R. Ba jscy, S. H. Jung, and G. Kurillo. The effect of interactivity on learning physical actions in virtual reality. Media Psychology, 2008.
• 2: H. Baker, N. Bhatti, D. Tanguay, I. Sobel, D. Gelb, M. Goss, W. Culbertson, and T. Malzbender. Understanding performance in Coliseum, an immersive videoconferencing system. ACM Transactions on Multimedia Computing Communications and Applications, (1), 2005.
• 3: M. Chen. Design of a virtual auditorium. In Proc. of 9th ACM Multimedia, 2001.
• 4: L. Gharai, C. Perkins, R. Riley, and A. Mankin. Large scale video conferencing: A digital amphitheater. In Proc. of 8th ICDMS, 2002.
• 5: G. Kurillo, Z. Li, and R. Bajcsy. Framework for hierarchical calibration of multi--camera systems for teleimmersion. In Proc. of 2nd ICIT, 2009.
• 6: G. Kurillo, R. Vasudevan, E. Lobaton, and R. Bajcsy. A framework for collaborative real-time 3d teleimmersion in a geographically distributed environment. In Proc. of ISM, 2008.
• 7: D. E. Ott and K. Mayer-Patel. Coordinated multi-streaming for 3d tele-immersion. In Proc. of 12th ACM Multimedia, 2004.
• 8: O. Schreer, N. Brandenburg, S. Askar, and E. Trucco. A virtual 3d video-conferencing system providing semiimmersive telepresence: A real-time solution in hardware and software. In Proc. of International Conference on eWork and eBusiness, 2001.
• 9: R. Sheppard, M. Kamali, R. Rivas, M. Tamai, Z. Yang, W. Wu, and K. Nahrstedt. Advancing interactive collaborative mediums through tele-immersive dance (TED): A symbiotic creativity and design environment for art and computer science. In Proc. of ACM Multimedia Interactive Arts Program, 2008.
• 10: S. Shi, L. Wang, K. Calvert, and J. Griffoen. A multi-path routing service for immersive environments. In Workshop on Grids and Advanced Networks, in conjunction with CCGrid, 2004.
• 11: B. Wang, J. Kurose, P. Shenoy, and D. Towsley. Multimedia streaming via tcp: An analytic performance study. In Proc. of 12th ACM Multimedia, 2004.
• 12: Z. Yang, Y. Cui, B. Yu, J. Liang, K. Nshrstedt, S. H. Jung, and R. Ba jscy. TEEVE: The next generation architecture for tele-immersive environments. In Proc. of 7th ISM, 2005.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Distributed applications

General Terms:
Design, Measurement, Performance

Keywords:
portability, tele-immersion