Disruption-tolerant content-aware video streaming

ABSTRACT

Communication between a pair of nodes in the network may get disrupted due to failures of links/nodes resulting in zero effective bandwidth between them during the recovery period. It has been observed that such disruptions are not too uncommon and may last from tens of seconds to minutes. Even an occasional such disruption can drastically degrade the viewing experience of a participant in a video streaming session particularly when a sequence of frames central to the story are lost during the disruption. The conventional approach of prefetching video frames and patching lost ones with retransmissions is not always viable when disruptions are localized and experienced only by a few among many receivers. Error spreading approaches that distribute the losses across the video work well only when the disruptions are quite short. As a better alternative, we propose a disruption-tolerant content-aware video streaming approach that combines the techniques of content summarization and error spreading to enhance viewers experience even when the disruptions are long. We introduce the notion of "substitutable content summary frames" and provide a method to select these frames and also their transmission order to mitigate the impact of a disruption. In the event of a disruption, the already received summary frames are played by the client during disruption and near normal playback is resumed after the disruption. We evaluate our approach and demonstrate that it provides acceptable viewing experience with minimal startup latency and client buffer.

REFERENCES

• 1: C. Alattinoglu, V. Jacobson, and H.Yu. Towards milli-second IGP convergence. IETF Internet Draft, Nov. 2000. draft-alaettinoglu-ISIS-convergence-00.txt.
• 2: Wu-chi Feng, On the efficacy of quality, frame rate, and buffer management for video streaming across best-effort networks, Journal of High Speed Networks, v.11 n.3-4, p.199-214, 2002
• 3: F. Fitzek and M. Rei. Prefetching protocol for continuous media streaming in wireless environments. IEEE Journal on Selected Areas in Communications, 19(10).
• 4: Charles Krasic , Jonathan Walpole , Wu-chi Feng, Quality-adaptive media streaming by priority drop, Proceedings of the 13th international workshop on Network and operating systems support for digital audio and video, June 01-03, 2003, Monterey, CA, USA [doi>10.1145/776322.776341]
• 5: Tiecheng Liu , John R. Kender, Optimization Algorithms for the Selection of Key Frame Sequences of Variable Length, Proceedings of the 7th European Conference on Computer Vision-Part IV, p.403-417, May 28-31, 2002
• 6: T. Liu and J. R. Kender. Rule-based semantic summarization of instructional videos. In International Conference on Image Processing, 2002.
• 7: Anirban Mahanti , Derek L. Eager , Mary K. Vernon , David J. Sundaram-Stukel, Scalable on-demand media streaming with packet loss recovery, IEEE/ACM Transactions on Networking (TON), v.11 n.2, p.195-209, April 2003 [doi>10.1109/TNET.2003.810311]
• 8: A. Markopulu, G. Iannaccone, S. Bhattacharya, C.-N. Chuah, and C. Diot. Characterization of failures in an IP backbone. In Proc. IEEE Infocom, Mar. 2004.
• 9: Bobby Vandalore , Wu-chi Feng , Raj Jain , Sonia Fahmy, A survey of application layer techniques for adaptive streaming of multimedia, Real-Time Imaging, v.7 n.3, p.221-235, June 2001 [doi>10.1006/rtim.2001.0224]
• 10: Srivatsan Varadarajan , Hung Q. Ngo , Jaideep Srivastava, Error spreading: a perception-driven approach to handling error in continuous media streaming, IEEE/ACM Transactions on Networking (TON), v.10 n.1, p.139-152, February 2002 [doi>10.1109/90.986585]
• 11: F. Wu, shipeng Li, and Y.-Q. Zhang. A framework for efficient progressive fine granularity scalable video coding. IEEE Trans. on Circuits and Systems for Video Technology, 13(3):332--344, 2001.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.5 Local and Wide-Area Networks
          Subjects: Internet (e.g., TCP/IP)

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services
          Subjects: Data sharing

General Terms:
Algorithms

Keywords:
disruption-tolerant streaming, network disruption, video key frames, video streaming