Unbalanced multiple description with variable frame rate

ABSTRACT

This paper describes a technique based on Unbalanced Multiple Description Coding to improve the robustness of video transmission. The proposed system relies on two descriptions, HR (High-Resolution) and LR (Low-Resolution) where LR is primarily used as redundancy. HR and LR are produced by using different encoding parameters. HR has constant frame rate and is encoded in such a way to optimize video quality. LR, on the other hand, uses only intra frames and its frame rate is dynamically adapted to the amount of motion. Using only intra frames in LR allows fast encoding/decoding time and provides resilience to bursts of packet losses. This technique produces acceptable quality even if redundancy percentage is less than packet loss rate. Therefore this approach is suitable for multicast video distribution over wireless links where estimating packet loss can be a difficult task because different receivers experience different loss patterns.

REFERENCES

• 1: J. Zheng, L. P. Chau, "Efficient Motion Vector Recovery Algorithm for H.264 Based on a Polynomial Model," in IEEE Transactions on Multimedia, Volume 7, No. 2, April 2005.
• 2: Antonio Vilei , Gabriella Convertino , Silvio Oliva , Roberto Cuppone, A novel unbalanced multiple description scheme for video transmission over WLAN, Proceedings of the 3rd ACM international workshop on Wireless mobile applications and services on WLAN hotspots, September 02-02, 2005, Cologne, Germany [doi>10.1145/1080730.1080737]
• 3: S. Ekmekci, T. Sikora, "Unbalanced Quantized Multiple Description Video Transmission using Path Diversity," in IS&T/SPIE's Electronic Imaging 2003, Santa Clara, CA, January 2003.
• 4: David Comas , Raghavendra Singh , Antonio Ortega , Ferran Marqués, Unbalanced multiple-description video coding with rate-distortion optimization, EURASIP Journal on Applied Signal Processing, 2003, p.81-90, January 2003 [doi>10.1155/S1110865703211215]
• 5: M. Fumagalli, R. Lancini, S. Tubaro, "A Novel ErrorConcealment Algorithm for an Unbalanced Multiple Description Coding Architecture," in PV2004, Irvine, CA, December 2004.
• 6: R. Bernardini, M. Durigon, R. Rinaldo, L. Celetto, A. Vitali, "Polyphase Spatial Subsampling Multiple Description Coding of Video Streams with H264," in IEEE International Conference on Image Processing, October 2004.
• 7: H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, "RFC 1889 - RTP: A transport protocol for real-time applications," IETF, January 1996.
• 8: T. Wiegand, G. J. Sullivan, G. Bjontegaard, A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 560576, July 2003.
• 9: F. Chen, C. Huijuan and T. Kun, "Chessboard-interpolation-based multiple description video coding," Science in China Series F: Information Sciences, vol. 47, no. 1, pp. 66--74, Feb. 2004.
• 10: K. R. Matty and L. P. Kondi, "Balanced multiple description video coding using optimal partitioning of the dct coefficients," IEEE Transactions on CSVT, vol. 15, no. 7, pp. 928--934, Jul. 2005.
• 11: Taehyun Kim , Mostafa H. Ammar, A comparison of layering and stream replication video multicast schemes, Proceedings of the 11th international workshop on Network and operating systems support for digital audio and video, p.63-72, January 2001, Port Jefferson, New York, United States [doi>10.1145/378344.378354]
• 12: L. Bin, H. Feng, S. Lifeng and Y. Shiqiang, "Optimized Rate Allocation for Unbalanced Multiple Description Video Coding Over Unreliable Packet Network," in ICME 2006, Toronto, Canada, July 2006.
• 13: E. N. Gilbert, "Capacity of a burst-noise channel," Bell Syst. Tech. J., pp. 1253--1265, Sept. 1960.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.2 Compression (Coding)

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.2 Network Protocols

General Terms:
Algorithms, Experimentation, Performance, Reliability

Keywords:
UMD, WLAN, frame rate, multicast, packet loss, streaming, unbalanced multiple description, video