Error control techniques for interactive low-bit rate video transmission over the Internet

ABSTRACT

A new retransmission-based error control technique is presented that does not incur any additional latency in frame playout times, and hence are suitable for interactive applications. It takes advantage of the motion prediction loop employed in most motion compensation-based codecs. By correcting errors in a reference frame caused by earlier packet loss, it prevents error propagation. The technique rearranges the temporal dependency of frames so that a displayed frame is referenced for the decoding of its succeeding dependent frames much later than its display time. Thus, the delay in repairing lost packets can be effectively masked out. The developed technique is combined with layered video coding to maintain consistently good video quality even under heavy packet loss. Through the results of extensive Internet experiments, the paper shows that layered coding can be very effective when combined with the retransmission-based error control technique for low-bit rate transmission over best effort networks where no network-level mechanism exists for protecting high priority data from packet loss.

REFERENCES

• 1: A. Albanese, J. Blomer, J. Edmonds, M. Luby, and M. Sudan, "Priority Encoding Transmission," IEEE Transactions on Information Theory, vol. 42, no. 6, Nov. 1996.
• 2: Amir, E., McCanne, S., and Vetterli, M. "A Layered DCT Coder for Internet Video," the Proceedings of IEEE international Conference on Image Processing. September, 1996. Lausanne, Switzerland.
• 3: P. Brady, "Effects of Transmission Delay on Conversational Behavior on Echo-Free Telephone Circuits,'' Bell System Technical Journal, vol. 50, no. 1, pp. 115- 134, Jan. 1993.
• 4: B. DeCleene, P. Pancha, M. E1 Zarki, and H. Sorensen, "Comparison of Priority Partition Methods for VBR MPEG," Proceedings of IEEE Infocom'9J, Toronto, Canada, June 1994.
• 5: Bert J. Dempsey , Jörg Liebeherr , Alfred C. Weaver, On retransmission-based error control for continuous media traffic in packet-switching networks, Computer Networks and ISDN Systems, v.28 n.5, p.719-736, March 1996 [doi>10.1016/0169-7552(95)00051-8]
• 6: T. Dorcey, "CU-SeeMe desktop videoconferencing software," ConneXions, vol. 9, no. 3, Mar. 1995.
• 7: R. Fredrick, Network Video(nv), Xerox Palo Alto Research Center.
• 8: M. Ghanbari, "Two layer coding of video signals for VBR networks," IEEE Journal on Selected Areas in Communications, vol. 7, no. 5, June 1989.
• 9: James K. Han , George C. Polyzos, Multi-resolution layered coding for real-time image transmission: architectural and error control considerations, Real-Time Imaging, v.4 n.4, p.275-298, Aug. 1, 1998 [doi>10.1006/rtim.1997.0090]
• 10: M. Khansari, A. Jalali, E. Dubois, and P. Mermelstein, "Low bit-rate video transmission over fading channels for wireless microcellular systems," IEEE Transactions on Circuits and Systems for Video Technology, vol. 6, pp. 1-11, February 1996.
• 11: C. Leicher, "Hierarchical encoding of MPEG sequences using priority encoding transmission (PET)," ICSI technical report TR-94-058, Nov. 1994.
• 12: X. Li, S. Paul, P. Pancha, and M. Ammar, "Layered video multicast with retransmission (LVMR): evaluation of error recovery schemes," Proceedings of the Sixth International Workshop on Network and Operating System Support for Digital Audio and Video, St Louis, May 1997.
• 13: Steven McCanne , Van Jacobson, vic: a flexible framework for packet video, Proceedings of the third ACM international conference on Multimedia, p.511-522, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215315]
• 14: S. McCanne, M. Vetterli, and V. Jacobson, "Lowcomplexity video coding for receiver-driven layered multicast," IEEE Journal on Selected Areas in Communications, vol. 16, no. 6, pp. 983-1001, August 1997
• 15: M. Normura, T. Fujii, N. Ohta, "Layered Packet- Loss Protection for Variable Rate Coding Using DCT," Proceedings of InteTnational Workshop on Packet Video, DT, Sept. 1988.
• 16: Naohisa Ohta, Packet Video: Modeling and Signal Processing, Artech House, Inc., Norwood, MA, 1994
• 17: P. Pancha and M. E1 Zarki,"MPEG Coded Video and BISDN," IEEE Communications Magazine, Vol. 32, No. 5, May 1994.
• 18: C. Papadopoulos and G. Parulkar, "Retransmission-based error control for continuous media applications," Proceedings of the Sixth international Workshop on Network and Operating System Support for Digital Audio and Video, pp. 5-12, 1996.
• 19: Priority Encoding Transmission, Web Page: http://www, icsi. berkeley, edu/P ET/icsi- pet. html.
• 20: E. J. Posnak, S. P. Gallindo, A. P. Stephens and H. M. Vin. "Techniques for Resilient Transmission of JPEG Video Streams" the Proceedings of Multimedia Computing and Networking, San Jose, Volume 2417, Pages 243-252, February 1995.
• 21: G. Ramamurthy , D Raychaudhuri, Performance of packet video with combined error recovery and concealment, Proceedings of the Fourteenth Annual Joint Conference of the IEEE Computer and Communication Societies (Vol. 2)-Volume, p.753, April 02-06, 1995
• 22: K. Shimamura, Y. Hayashi, and F. Kishino, "Variable-bit-rate Coding Capable of Compensating for Packet Loss," Proceedings of Visual Communications and Image Processing, Nov. 1988, pp. 991 - 998.
• 23: R. Xu, C. Myers, H. Zhang, R. Yavatkar, "Resilient multicast support for continuous-media applications,'' Proceedings of the Sixth International Workshop on Network and Operating System Support for Digital Audio and Video, St Louis, May 1997.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.5 Local and Wide-Area Networks
          Subjects: Internet (e.g., TCP/IP)

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.2 Network Protocols
          Subjects: Routing protocols

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Measurement, Reliability