Experience with control mechanisms for packet video in the internet

ABSTRACT

The single class best effort service available in the current Internet does not provide the guarantees, typically expressed in terms of minimum bandwidth and/or maximum delay or loss, associated with real-time applications such as live video. One way to support such applications in best effort networks is to use control mechanisms that adapt the coding, transmission, reception, and decoding processes at the source and at the destination(s) depending on the state of the network. In this paper, we examine and report on our experience over the past several years with such mechanisms for videoconferencing software. We illustrate our points with results obtained with the IVS software developed at INRIA.We consider in particular rate and error control mechanisms. These mechanisms adapt the bandwidth requirements and the resilience to packet loss of the video stream sent by a source coder. We have found that they do prevent video sources from swamping the resources of the Internet, and that they provide reasonably graceful degradation of image quality during periods of network congestion. However, they raise thorny issues of fairness with non-real time traffic sources (such as TCP sources) and of scalability for the multicast delivery of video in heterogeneous networks. We examine different approaches to tackling these problems.

REFERENCES

• 1: Elan Amir , Steven McCanne , Hui Zhang, An application level video gateway, Proceedings of the third ACM international conference on Multimedia, p.255-265, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215277]
• 2: [2] U. Bilting, A. Sasse, C-D. Schulz, T. Turletti, "Remote seminars through multimedia conferencing: Experiences from the MICE project", Proc. INET'94, Prague, June 1994.
• 3: [3] J-C. Bolot, T. Turletti, "A rate control for packet video in the Internet", Proc. IEEE lnfocom '94, Toronto, Canada, pp. 1216-1223.
• 4: [4] J-C. Bolot, T. Turletti, I. Wakeman, "Scalable feedback control for multicast video distribution in the Internet", Proc. ACM Sigcomm'94 , pp. 58-67, Oct. 1994.
• 5: [5] J-C. Bolot, A. V. Garcia, "Control mechanisms for packet audio in the Internet", Proc. IEEE Infocom '96, San Fransisco, CA, pp. 232-239, Apr. 1996.
• 6: [6] J-C. Bolot, A. V. Garcia, "The case for FEC-based error control for packet audio in the Internet", to appear in ACM Multimedia Systems .
• 7: [7] I. Busse, B. Deffner, H. Schulzrinne, "Dynamic QoS control of multimedia applications based on RTP", Computer Communications , vol. 19, no. 1, pp. 49-58, Jan. 1996.
• 8: D.-M. Chiu , R. Jain, Analysis of the increase and decrease algorithms for congestion avoidance in computer networks, Computer Networks and ISDN Systems, v.17 n.1, p.1-14, June 10, 1989 [doi>10.1016/0169-7552(89)90019-6]
• 9: [9] L. Cline et al., "DirectShow support for adaptivity in networked multimedia applications", Intel technical report, 1997.
• 10: [10] R. Frederick, "Experiences with real-time software video compression", Sixth International Workshop on Packet Video, Portland, Oregon, Sept. 26-27, 1994, pp. F1.1-F1.4.
• 11: Mark W. Garrett , Martin Vetterli, Joint source/channel coding of statistically multiplexed real-time services on packet networks, IEEE/ACM Transactions on Networking (TON), v.1 n.1, p.71-80, Feb. 1993 [doi>10.1109/90.222908]
• 12: [12] H. Gharavi, "Multilayer subband-based video coding", lEEE Trans. on Communications, vol. 39, no. 9, pp. 1288-1291, Sept. 1991.
• 13: [13] H. Ghanbari, V. Seferidis, "Cell loss concealment in ATM video codecs", IEEE Trans. Circuits Systs. Video Tech., vol. 3, no. 3, pp. 238-247, June 1993.
• 14: [14] V. Hardman, A. Sasse, M. Handley, A. Watson, "Reliable audio for use over the Internet", Proc. INET '95, Honolulu, HI, pp. 171-178, June 1995.
• 15: [15] B. Haskell, "Buffer and channel sharing by several interframe picturephone coders", Bell Syst. Tech. J., vol. 51, Jan. 1972.
• 16: [16] "Video codec for audiovisual services at p × 64 kb/s", ITU-T Recommendation H. 261, 1993.
• 17: Don Hoffman , Michael Speer , Gerard Fernando, Network Support for Dynamically Scaled Multimedia Data Streams, Proceedings of the 4th International Workshop on Network and Operating System Support for Digital Audio and Video, p.240-251, November 03-05, 1993
• 18: [18] V. Jacobson, "Congestion avoidance and control", Proc. ACM Sigcomm "88, Stanford, CA, pp. 314-329, Aug. 1988.
• 19: Kevin Jeffay , Donald L. Stone , Terry Talley , F. Donelson Smith, Adaptive, Best-Effort Delivery of Digital Audio and Video Across Packet-Switched Networks, Proceedings of the Third International Workshop on Network and Operating System Support for Digital Audio and Video, p.3-14, November 12-13, 1992
• 20: [20] H. Kanakia, P. Mishra, A. Reibman, "An adaptive congestion control scheme for real-time packet video transport", Proc. ACM Sigcomm '93, San Fransisco, CA, pp. 20-31, Sept. 1993.
• 21: [21] G. Karlsson, "Layered error-control coding for layered multicast", SICS Technical report, 1997.
• 22: T. V. Lakshman , Upamanyu Madhow, Performance Analysis of Window-based Flow Control Using TCP/IP: Effect of High Bandwidth-Delay Products and Random Loss, Proceedings of the IFIP TC6/WG6.4 Fifth International Conference on High Performance Networking V, p.135-149, June 27-July 01, 1994
• 23: [23] J. Mahdavi, S. Floyd, "TCP-friendly unicast rate-based flow control", Technical note sent to the end2end-interest mailing list, January 8, 1997.
• 24: Steven McCanne , Van Jacobson, vic: a flexible framework for packet video, Proceedings of the third ACM international conference on Multimedia, p.511-522, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215315]
• 25: [25] S. McCanne, V. Jacobson, M. Vetterli, "Receiver-driven layered multicast", Proc. ACM Sigcomm '96, Stanford University, CA, pp. 117-130, Sept. 1996.
• 26: [26] S. McCanne, M. Vetterli, "Low complexity video coding for receiver driven layered multicast", IEEE JSAC, vol. 16, no. 6, pp. 983-1001, Aug. 1997.
• 27: [27] J.W. Modestino et al., "Combined source-channel coding of images using the block cosine transform", IEEE Trans. Comm., vol. 29, pp. 1261-1274, Sept. 1981.
• 28: A. Ortega , M. Khansari, Rate control for video coding over variable bit rate channels with applications to wireless transmission, Proceedings of the 1995 International Conference on Image Processing (Vol. 3)-Volume 3, p.3388, October 23-26, 1995
• 29: Joseph Pasquale , George C. Polyzos , Eric W. Anderson , Vachaspathi P. Kompella, Filter Propagation in Dissemination Trees: Trading Off Bandwidth and Processing in Continuous Media Networks, Proceedings of the 4th International Workshop on Network and Operating System Support for Digital Audio and Video, p.259-268, November 03-05, 1993
• 30: [30] C. Perkins et al., "Payload Format Issues for Redundant Encodings in RTP", internet-draft, July 1996.
• 31: [31] H. Schulzrinne, S. Casner, R. Frederick, V. Jacobson, "RTP: A transport protocol for real-time applications", RFC 1889.
• 32: [32] N. Shacham, E McKenney, "Packet recovery in high-speed networks using coding and buffer management", Proc. IEEE Infocom '90, San Fransisco, CA, pp. 124-131, May 1990.
• 33: Nachum Sacham, Multipoint communication by hierarchically encoded data, Proceedings of the eleventh annual joint conference of the IEEE computer and communications societies on One world through communications (Vol. 3), p.2107-2114, May 1992, Florence, Italy
• 34: [34] D. Sisalem, H. Schulzrinne, "End to end quality of service control using adaptive applications", Proc. 5th Intl. Wksp on QoS (IWQPS'97), New York, NY, May 1997.
• 35: Thierry Turletti , Christian Huitema, Videoconferencing on the Internet, IEEE/ACM Transactions on Networking (TON), v.4 n.3, p.340-351, June 1996 [doi>10.1109/90.502233]
• 36: T. Turletti , C. Huitema, RTP Payload Format for H.261 Video Streams, RFC Editor, 1996
• 37: [37] T. Turletti, S. Fosse Parisis, J.C., "Experiments with a layered transmission scheme over the Internet", INRIA report RR3296, 1997.
• 38: [38] L. Vicisano, L. Rizzo, J. Crowcroft, "TCP-like congestion control for layered multicast data transfer", UCL research note RN/97/75, 1997.
• 39: [39] I. Wakeman, "Packetized video - Options for interaction between the user, the network, and the codec", The Computer Journal, vol. 36, no. 1, 1993.
• 40: [40] P. H. Westerink et al., "Adaptive channel error protection of sub-band encoded images", IEEE Trans. Comm., vol. 41, no. 3, pp. 454-459, March 1993.
• 41: [41] L. Wu, R. Sharma, B. Smith, "Thin streams: an architecture for multicasting layered video", Proc. NOSSDAV 97, St. Louis, MO, May 1997.
• 42: [42] M. Yajnik, J. Kurose, D. Towsley, "Packet loss correlation in the MBone multicast network," IEEE Global Internet Conf., London, UK, Nov. 1996.
• 43: [43] J. Zdepsky et al., "Statistically based buffer control policies for constant rate transmission of compressed digital video", IEEE Trans. Comm., vol. 39, pp. 947-957, June 1991.
• 44: [44] Q-F. Zhu et al., "Coding and cell loss recovery in DCT-based packet video", IEEE Trans. Circuits Systs. Video Tech., vol. 3, no. 3, pp. 248-258, June 1993.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.5 Local and Wide-Area Networks
          Subjects: Internet (e.g., TCP/IP)

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Packet-switching networks

  G. Mathematics of Computing
  G.4 MATHEMATICAL SOFTWARE
      Subjects: Algorithm design and analysis

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Algorithms, Experimentation, Measurement, Performance, Theory