Rate adaptation transcoding for precoded video streams

ABSTRACT

In order to transmit pre-encoded digital video over heterogeneous networks, it is necessary to employ transcoding techniques that convert pre-encoded video streams into streams having different bit rates and quality. The specified problem is referred to as rate shaping or rate adaptation. In this work, we propose a new rate control scheme for H.263+ based video transcoding. The proposed rate control scheme is comprised of Frame-Layer bit allocation and Macroblock-Layer rate control. At the frame layer, scene context statistics from the incoming video stream are utilized to detect scene changes and determine frame type. The bit budget is allocated to frames according to their energy and frame types. At the macroblock layer, a novel linear Rate-Quantization model is used for selecting quantization parameters for macroblocks. Implementation and experimental results show that the proposed algorithm can provide accurate bit allocation, and can effectively alleviate visual quality degradation after scene changes. This rate adaptation scheme can be used to provide flexible video bit rate adaptation for transmission of pre-encoded video over heterogeneous networks.

REFERENCES

• 1: J. Youn, M.-T. Sun, and C.-W. Lin, Motion Vector Refinement for High-Performance Transcoding, IEEE Transactions on Multimedia, Vol.1, No. 1, March 1999.
• 2: P. Assunção, and M. Ghanbari, A Frequency-Domain Video Transcoder for Dynamic Bit-Rate Reduction of MPEG-2 Bit Streams, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 8, No. 8, December 1998.
• 3: J. Youn, and M.-T. Sun, Video Transcoding with H.263 Bit-Streams, Journal of Visual Communication and Image Representation, Vol. 11, 2000.
• 4: H. Sun, W. Kwok, and J. W. Zdopski, Architecture for MPEG Compressed Bitstream Scaling, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, Apr. 1996.
• 5: Q.-F. Zhu, L. Keofsky, and M. B. Garrison, Low-Delay, Low-Complexity Rate Reduction and Continuous Presence for Multipoint Videoconferencing, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 9, No. 4, June 1999.
• 6: P. Assunção, and M. Ghanbri, Post-Processing of MPEG-2 Coded Video for Transmission at Lower Bit Rates, Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, May 1996.
• 7: S.-F. Chang and D.G. Messerschmitt, A New Approach to Decoding and Composting Motion Compensated DCT-Based Images, Proceeding of IEEE International Conference on Acoustics, Speech, and Signal Processing, April 1993.
• 8: Dzung Tien Hoang , Jeffrey Scott Vitter, Efficient algorithms for MPEG video comrpession, John Wiley & Sons, Inc., New York, NY, 2002
• 9: ISO/IEC JTCI/SC29/WG11, Test Model 5, 1993.
• 10: J. Ribas-Corbera and S.-M. Lei, A Frame-Layer Bit Allocation for H.263+, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 10, No. 7, October 2000.
• 11: ITU-T/SG15, Video Codec test model, TMN-8, June 1997.
• 12: J. Ribas-Corbera, and S. Lei, Rate Control in DCT Video Coding for Low-Delay Communications, IEEE Transactions on Circuits and Systems for Video technology, Vol. 9, Feb. 1999.
• 13: S.-W. Wu and A. Gersho, Rate-Constrained Optimal Block-adaptive Coding for Digital Tape Recording of HDTV, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 1, Mar. 1991.
• 14: J. Choi and D. Park, A Stable Feedback Control of The Buffer State Using The Controlled Langrange Multiplier Method, IEEE Transaction on Image Processing, Vol. 3, Sept. 1994.
• 15: D. W. Lin, M.-H. Wang, and J.-J. Chen, Optimal Delayed-coding of Video Sequences Subject to A Buffer-size Constraint, Proceedings of SPIE Visual Communication and Image Processing '93, Cambridge, MA, Nov. 1993.
• 16: J. Lee and B. W. Dickinson, Joint Optimization of Frame Type Selection and Bit Allocation for MPEG Video Encoders, Proceedings of International Conference on Image Processing '94, Austin TX, 1994.
• 17: I.-M. Pao, and M.-T. Sun, Encoding DCT Coefficients Based on Rate-Distortion Measurement, Journal of Visual Communication and Image Representation, Vol. 12, 2001.
• 18: A. Ortega, K. Ramchandran, and M. Vetterli, Optimal Trellis-based Buffered Compression and Fast Approximations, IEEE Transaction on Image Processing, Vol. 3, Jan. 1994.
• 19: Y. Yang and S. S. Hemami, Generalized Rate-Distortion Optimization for Motion-Compensated Video Coders, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 10, No. 6, Sept. 2000.
• 20: R. M. Gary and D. L. Neuhoff, Quantization, IEEE Transactions on Information Theory, Vol. 44, No. 6. Oct. 1998.
• 21: Thomas M. Cover , Joy A. Thomas, Elements of information theory, Wiley-Interscience, New York, NY, 1991
• 22: E.D. Frimout, J. Biemond, and R.L. Lagendik, Forward rate control for MPEG recording, Proceedings of SPIE Visual Communication: Image Processing, Cambridge, Nov. 93.
• 23: H.-M. Hang and J.-J. Chen, Source Model for Transform Video Coder and Its Application---Part I: Fundamental Theory, IEEE Transactions on Circuits and Systems for Video Technology, Vol.7, Apr. 1997.
• 24: B. Tao, B.W. Dickinson, and H.A. Peterson, Adaptive Model-Driven Bit Allocation for MPEG Video Coding, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 10, Feb. 2000.
• 25: W. Ding and B. Liu, Rate Control of MPEG Video Coding and Recording by Rate-quantization Modeling, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 6, Feb. 1996.
• 26: L.-J. Lin, and A. Ortega, Bit-Rate Control Using Piecewise Approximated Rate-Distortion Characteristics, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 8, Aug. 1998.
• 27: T. Chiang, and Y.-Q. Zhang, A New Rate Control Scheme Using Quadratic Rate Distortion Model, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 1, February 1997.
• 28: A. Puri and R. Aravind, Motion-compensated Video Coding with Adaptive Perceptual Quantization, IEEE Transaction on Circuits and Systems for Video Technology, Vol. 1, Dec. 1991.
• 29: J.-B. Cheng and H.-M. Hang, Adaptive Piecewise Linear Bits Estimation Model for MPEG Based Video Coding, Journal of Visual Communication and Image Representation, Vol. 8, No. 1, March 1997.
• 30: Z. Lei, and N. D. Georganas, Accurate Bit Allocation and Rate Control for DCT Domain Video Transcoding, Proceedings of IEEE Canadian Conference on Electrical & Computer Engineering, Winnipeg, May 2002.
• 31: S. Park, Y. Lee, and Hyunsik Chang, A New MPEG-2 Rate Control Scheme Using Scene Change Detection, ETRI Journal, Vol. 18, July 1996.
• 32: Yoo-Sok Saw, Rate-Quality Optimized Video Coding, Kluwer Academic Publishers, Norwell, MA, 1999

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.2 Compression (Coding)

General Terms:
Algorithms, Design, Experimentation

Keywords:
rate adaptation, rate quantization, scene variations, video transcoding