Adjusting forward error correction with temporal scaling for TCP-friendly streaming MPEG

ABSTRACT

New TCP-friendly constraints require multimedia flows to reduce their data rates under packet loss to that of a conformant TCP flow. To reduce data rates while preserving real-time playout, temporal scaling can be used to discard the encoded multimedia frames that have the least impact on perceived video quality. To limit the impact of lost packets, Forward Error Correction (FEC) can be used to repair frames damaged by packet loss. However, adding FEC requires further reduction of multimedia data, making the decision of how much FEC to use of critical importance. Current approaches use either inflexible FEC patterns or adapt to packet loss on the network without regard to TCP-friendly data rate constraints. In this article, we analytically model the playable frame rate of a TCP-friendly MPEG stream with FEC and temporal scaling, capturing the impact of distributing FEC within MPEG frame types with interframe dependencies. For a given network condition and MPEG video encoding, we use our model to exhaustively search for the optimal combination of FEC and temporal scaling that yields the highest playable frame rate within TCP-friendly constraints. Analytic experiments over a range of network and application conditions indicate that adjustable FEC with temporal scaling can provide a significant performance improvement over current approaches. Extensive simulation experiments based on Internet traces show that our model can be effective as part of a streaming protocol that chooses FEC and temporal scaling patterns that meet dynamically-changing application and network conditions.

REFERENCES

• 1: Acharya, S. and Smith, B. 1998. An experiment to characterize videos stored on the Web. In Proceedings of the ACM/SPIE Multimedia Computing and Networking (MMCN). San Jose, CA, 166--178.
• 2: Albanese, A., Bomer, J., Edmonds, J., Luby, M., and Sudan, M. 1996. Priority encoding transmission. IEEE Trans. Inform. Theory 42, 6 (Nov.), 1737--1744.
• 3: Hari Balakrishnan , Hariharan S. Rahul , Srinivasan Seshan, An integrated congestion management architecture for Internet hosts, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.175-187, August 30-September 03, 1999, Cambridge, Massachusetts, United States
• 4: Bocheck, P., Campbell, A., Chang, S.-F., and Lio, R. 1999. Utility-based network adaptation for MPEG-4 systems. In Proceedings of International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV). Basking Ridge, NJ.
• 5: Bolot, J.-C., Fosse-Parisis, S., and Towsley, D. 1999. Adaptive FEC-based error control for Internet telephony. In Proceedings of IEEE INFOCOM. New York, NY.
• 6: Catherine Boutremans , Gianluca Iannaccone , Christophe Diot, Impact of link failures on VoIP performance, Proceedings of the 12th international workshop on Network and operating systems support for digital audio and video, May 12-14, 2002, Miami, Florida, USA [doi>10.1145/507670.507680]
• 7: Jill M. Boyce , Robert D. Gaglianello, Packet loss effects on MPEG video sent over the public Internet, Proceedings of the sixth ACM international conference on Multimedia, p.181-190, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290770]
• 8: Braden, B., Clark, D., Crowcroft, J., Davie, B., Deering, S., Estrin, D., Floyd, S., Jacobson, V., Minshall, G., Partridge, C., L. Peterson, K. R., Shenker, S., Wroclawski, J., and Zhang, L. 1998. Recommendations on queue management and congestion avoidance in the Internet. IETF Request for Comments (RFC) 2309.
• 9: Chung, J., Claypool, M., and Zhu, Y. 2003. Measurement of the congestion responsiveness of RealPlayer streaming video over UDP. In Proceedings of the Packet Video Workshop (PV). Nantes, France.
• 10: DeSantis, T. and Loose, D. 2003. TCP traffic analysis. Major Qualifying Project MQP-MLC-MT03 Worcester Polytechnic Institute. Advisors M. Claypool and R. Kinicki.
• 11: Feamster, N. and Balakrishnan, H. 2002. Packet loss recovery for streaming video. In Proceedings of 12th International Packet Video (PV) Workshop. Pittsburgh, PA.
• 12: Floyd, S. 1994. TCP and explicit congestion notification. Comput. Comm. Rev.
• 13: Sally Floyd , Kevin Fall, Promoting the use of end-to-end congestion control in the Internet, IEEE/ACM Transactions on Networking (TON), v.7 n.4, p.458-472, Aug. 1999 [doi>10.1109/90.793002]
• 14: Sally Floyd , Mark Handley , Jitendra Padhye , Jörg Widmer, Equation-based congestion control for unicast applications, Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, p.43-56, August 28-September 01, 2000, Stockholm, Sweden
• 15: Mark W. Garrett , Walter Willinger, Analysis, modeling and generation of self-similar VBR video traffic, Proceedings of the conference on Communications architectures, protocols and applications, p.269-280, August 31-September 02, 1994, London, United Kingdom
• 16: Hardman, V., Sasse, M. A., Handley, M., and Watson, A. 1995. Reliable audio for use over the Internet. In Proceedings of Internet Society's International Networking Conference (INET).
• 17: Hartanto, F. and Sirisena, H. R. 1999. Hybrid error control mechanism for video transmission in the wireless IP networks. In Proceedings of the 10th IEEE Workshop on Local and Metropolitan Area Networks (LANMAN).
• 18: Hemy, M., Hangartner, U., Steenkiste, P., and Gross, T. 1999. MPEG system streams in best-effort networks. In Proceedings of Packet Video Workshop.
• 19: International Telecommunications Union. 1996. One-way transmission time. Tech. Rep. G. 114, ITU-T Recommendation.
• 20: Jaiswal, S., Iannaccone, G., Diot, C., Kurose, J., and Towsley, D. 2004. Inferring TCP connection characteristics through passive measurements. In Proceedings of IEEE Infocom. Hong Kong, China.
• 21: M. Krunz , R. Sass , H. Hughes, Statistical characteristics and multiplexing of MPEG streams, Proceedings of the Fourteenth Annual Joint Conference of the IEEE Computer and Communication Societies (Vol. 2)-Volume, p.455, April 02-06, 1995
• 22: Liu, Y. and Claypool, M. 2000. Using redundancy to repair video damaged by network data loss. In Proceedings of IS&T/SPIE/ACM Multimedia Computing and Networking (MMCN).
• 23: Dmitri Loguinov , Hayder Radha, Measurement study of low-bitrate internet video streaming, Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement, November 01-02, 2001, San Francisco, California, USA [doi>10.1145/505202.505238]
• 24: Controlling High-Bandwidth Flows at the Congested Router, Proceedings of the Ninth International Conference on Network Protocols, p.192, November 11-14, 2001
• 25: Ketan Mayer-Patel , Long Le , Georg Carle, An MPEG performance model and its application to adaptive forward error correction, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641009]
• 26: Mena, A. and Heidemann, J. 2000. An empirical study of real audio traffic. In Proceedings of IEEE Infocom. Tel-Aviv, Israel, 101--110.
• 27: Joan L. Mitchell , William B. Pennebaker , Chad E. Fogg , Didier J. Legall, MPEG Video Compression Standard, Chapman & Hall, Ltd., London, UK, 1996
• 28: Nguyen, T. and Zakhor, A. 2002. Distributed video streaming with forward error correction. In 12th International Packet Video Workshop.
• 29: Padhye, C., Christensen, K., and Moreno, W. 2000. A new adaptive FEC loss control algorithm for voice over IP applications. In Proceedings of IEEE International Performance, Computing and Communication Conference. Phoenix, AZ.
• 30: Jitendra Padhye , Victor Firoiu , Don Towsley , Jim Kurose, Modeling TCP throughput: a simple model and its empirical validation, Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication, p.303-314, August 31-September 04, 1998, Vancouver, British Columbia, Canada
• 31: Kihong Park , Wei Wang, QoS-Sensitive Transport of Real-Time MPEG Video using Adaptive Forward Error Correction, Proceedings of the IEEE International Conference on Multimedia Computing and Systems Volume II-Volume 2, p.426, June 07-11, 1999
• 32: Paxson, V. 1999. End-to-end internet packet dynamics. IEEE/ACM Trans. Networ.
• 33: Pinson, M. and Wolf, S. 2004. A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50, 3 (Sept.), 312--322.
• 34: Real Networks Incorporated. © 2000. RealProducer User's Guide. URL: http://www.service.real.com/help/library/guides/producerplus85/producer.htm.
• 35: Reed, I. S. and Solomon, G. 1960. Polynomial codes over certain finite fields. J. SIAM Society Indust. Appl. Math. 8, 2 (June), 300--304.
• 36: Rejaie, R., Handley, M., and Estrin, D. 1999. RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet. In Proceedings of IEEE Infocom. New York, NY, 1337--1345.
• 37: Injong Rhee, Error control techniques for interactive low-bit rate video transmission over the Internet, Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication, p.290-301, August 31-September 04, 1998, Vancouver, British Columbia, Canada
• 38: Rizzo, L. 1997. On the feasibility of software FEC. Tech. Rep. LR-970131, DEIT.
• 39: O. Rose, Statistical properties of MPEG video traffic and their impact on traffic modeling in ATM systems, Proceedings of the 20th Annual IEEE Conference on Local Computer Networks, p.397, October 16-19, 1995
• 40: Tripathi, A. and Claypool, M. 2002. Improving multimedia streaming with content-aware video scaling. In Workshop on Intelligent Multimedia Computing and Networking (IMMCN). Durham, NC.
• 41: van den Branden Lambrecht, C. J. and Verscheure, O. 1996. Quality measure using a spatio-temporal model of the human visual system. In Proceedings of SPIE.
• 42: Yubing Wang , Mark Claypool , Zheng Zuo, An empirical study of realvideo performance across the internet, Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement, November 01-02, 2001, San Francisco, California, USA [doi>10.1145/505202.505239]
• 43: Huahui Wu , Mark Claypool , Robert Kinicki, A model for MPEG with forward error correction and TCP-friendly bandwidth, Proceedings of the 13th international workshop on Network and operating systems support for digital audio and video, June 01-03, 2003, Monterey, CA, USA [doi>10.1145/776322.776342]
• 44: Wu, H., Claypool, M., and Kinicki, R. 2003b. Adjusting forward error correction with temporal scaling for TCP-friendly streaming MPEG. Tech. Rep. WPI-CS-TR-03-10, CS Department, Worcester Polytechnic Institute.
• 45: Wu, H., Claypool, M., and Kinicki, R. 2004. Practical group of pictures considerations. In Proceedings of the Packet Video Workshop (PV). Irvine, CA. Poster.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.m Miscellaneous

General Terms:
Design, Performance

Keywords:
MPEG, Multimedia networking, TCP-friendly, forward error correction