A multiview video transcoder

ABSTRACT

Video transcoding can convert a compressed video from one format to another format. In this paper, we propose a novel multiview video transcoder, which is used for bit-rate scaling of multiple compressed synchronized video streams. Different from the traditional joint transcoder for independent multiple program transcoding, the multiview video transcoder has one unique task to decorrelate spatial redundancies among video streams. A fast disparity estimation algorithm with the GOP-based disparity search window is put forward and evaluated. The proposed multiview video transcoder can be used to design a cost-effective video acquisition and transmission system for emerging 3D video applications.

REFERENCES

• 1: http://www.povray.org.
• 2: Report on 3dav exploration. In Int. Standards Org./Int. Electrotech. Comm. (ISO/IEC), ISO/IEC JTC1/SC29/WG11, Doc. N5878, July 2003.
• 3: I.-J. M. 93/457. Test model 5. April 1993.
• 4: Joel Carranza , Christian Theobalt , Marcus A. Magnor , Hans-Peter Seidel, Free-viewpoint video of human actors, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 5: S.-C. Chan, K.-T. Ng, Z.-F. Gan, K.-L. Chan, and H.-Y. Shum. The compression of simplified dynamic light field. In Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2003), April 2003.
• 6: C. Fehn, E. Cookie, O. Schreer, and P. Kauff. 3d analysis and image-based rendering for immersive tv applications. Signal Processing: Image Communications, 17:705--715, 2002.
• 7: T. Fujii and M. Tanimoto. Free-viewpoint tv system based on ray-space representation. In Proc. of SPIE ITCom, Vol. 4864-22, 2002.
• 8: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 9: Markus Gross , Stephan Würmlin , Martin Naef , Edouard Lamboray , Christian Spagno , Andreas Kunz , Esther Koller-Meier , Tomas Svoboda , Luc Van Gool , Silke Lang , Kai Strehlke , Andrew Vande Moere , Oliver Staadt, blue-c: a spatially immersive display and 3D video portal for telepresence, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 10: Sang-Uok Kum , Ketan Mayer-Patel , Henry Fuchs, Real-time compression for dynamic 3D environments, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957050]
• 11: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 12: J. Lim, K. N. Ngan, W. Yang, and K. Sohn. A multiview sequence codec with view scalability. Signal Processing: Image Communication, 19(3):239--256, March 2004.
• 13: M. Magnor. 3d-tv - the future of visual entertainment. In Proc. of Multimedia Databases and Image Communications (MDIC'04), June 2004.
• 14: W. Matusik and H. Pfister. 3d tv: A scalable system for real-time acquisition, transmission and autostereoscopic display for dynamic scenes. In Proc. of ACM SIGGRAPH, 2004, August 2004.
• 15: A. Smolic, C. Fehn, and K. Mueller. Mpeg 3dav - video-based rendering for interactive tv applications. In Proc. 10. Dortmunder Fernsehseminar, ITG/FKTG-Fachtagung, September 2003.
• 16: A. Smolic and P. Kauff. Interactive 3d video representation and coding technologies. Proceedings of the IEEE, Special Issue on Advances in Video Coding and Delivery, 93(1):98--110, January 2005.
• 17: A. Smolic, K. Mueller, P. Merkle, T. Rein, P. Eisert, and T. Wiegand. Free viewpoint video extraction, representation, coding, and rendering. In Proc. of IEEE International Conference on Image Processing (ICIP 2004), October 2004.
• 18: A. Vetro, C. Christopulos, and H. Sun. Video transcoding architectures and techniques: an overview. IEEE Signal Processing Magazine, 20(2):18--29, March 2003.
• 19: B. Wilburn, M. Smulski, K. Lee, and M. A. Horowitz. The light field video camera. In Proc. of Media Processors 2002, SPIE Electronic Imaging 2002, 2002.
• 20: J. Xin, C.-W. Lin, and M.-T. Sun. Digital video transcoding. Proceedings of IEEE, 93(1), January 2005.
• 21: J. Xin, M.-T. Sun, and K.-S. Kan. Bit allocation for joint transcoding of multiple mpeg coded video streams. In Proc. of IEEE International Conference on Multimedia and Expo (ICME 2001), 2001.
• 22: Jason C. Yang , Matthew Everett , Chris Buehler , Leonard McMillan, A real-time distributed light field camera, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 23: C. L. Zitnick, S. B. King, Müyttendaele, S. Winder, and R. Szeliski. High-quality video view interpolation using a layered representation. In Proc. of ACM SIGGRAPH, 2004, August 2004.
• 24: B. Bai, P. Boulanger, and J. Harms. An Efficient Multiview Video Compression Scheme. In Proc. of IEEE International Conference on Multimedia and Expo (ICME 2005), July 2005.

INDEX TERMS

Primary Classification:
  E. Data
  E.4 CODING AND INFORMATION THEORY
      Subjects: Data compaction and compression

General Terms:
Algorithms, Design

Keywords:
3D video, multiview video transcoder, video compression