Fine-grained scalable streaming from coarse-grained videos

ABSTRACT

Scalable video is an attractive option for adapting the bandwidth consumption of streaming video to the available bandwidth. Fine-grained scalability can adapt most closely to the available bandwidth, but this comes at the cost of a high compression penalty. In the context of VoD streaming to mobile end systems, we have therefore explored whether a similar adaptation to the available bandwidth can be achieved by performing layer switching in coarse-grained scalable videos. In this approach, enhancement layers of a video stream are switched on and off to achieve any desired longer-term bandwidth. We performed user studies to evaluate the idea, and came to the far-from-obvious conclusion that layer switching is viable way for bit-rate savings and fine-grained bit-rate adaptation even for rather short times between layer switches.

REFERENCES

• 1: Nicola Cranley , Philip Perry , Liam Murphy, User perception of adapting video quality, International Journal of Human-Computer Studies, v.64 n.8, p.637-647, August 2006 [doi>10.1016/j.ijhcs.2005.12.002]
• 2: Eichhorn, A., and Ni, P. Pick your Layers wisely - A Quality Assessment of H.264 Scalable Video Coding for Mobile Devices. In IEEE International Conference on Communications (2009).
• 3: International Telecommunications Union. ITU-T P.910. Subjective video quality assessment methods for multimedia applications, 1999.
• 4: Jeannin, S., and Divakaran, A. MPEG-7 Visual Motion Descriptors. IEEE Trans. on Circuits and Systems for Video Technology 11, 6 (Jun 2001), 720--724.
• 5: Hendrik O. Knoche , M Angela Sasse, The sweet spot: how people trade off size and definition on mobile devices, Proceeding of the 16th ACM international conference on Multimedia, October 26-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1459359.1459363]
• 6: John D. McCarthy , M. Angela Sasse , Dimitrios Miras, Sharp or smooth?: comparing the effects of quantization vs. frame rate for streamed video, Proceedings of the SIGCHI conference on Human factors in computing systems, p.535-542, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985760]
• 7: Dong Kwon Park , Yoon Seok Jeon , Chee Sun Won, Efficient use of local edge histogram descriptor, Proceedings of the 2000 ACM workshops on Multimedia, p.51-54, October 30-November 03, 2000, Los Angeles, California, United States [doi>10.1145/357744.357758]
• 8: Schwarz, H., Marpe, D., and Wiegand, T. Overview of the Scalable Extension of the H.264/AVC Video Coding Standard. IEEE Trans. on Circuits and Systems for Video Technology 17, 9 (2007), 1103--1120.
• 9: Wenger, S., Ye-Kui, W., and Schierl, T. Transport and Signaling of SVC in IP Networks. IEEE Trans. on Circuits and Systems for Video Technology 17, 9 (2007), 1164--1173.
• 10: Huahui Wu , Mark Claypool , Robert Kinicki, On combining temporal scaling and quality scaling for streaming MPEG, Proceedings of the 2006 international workshop on Network and operating systems support for digital audio and video, November 22-23, 2006, Newport, Rhode Island [doi>10.1145/1378191.1378200]
• 11: Zink, M., Künzel, O., Schmitt, J., and Steinmetz, R. Sub jective Impression of Variations in Layer Encoded Videos. In Proc. of Intl. Workshop on Quality of Service (2003), pp. 137--154.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Experimentation, Human Factors, Measurement

Keywords:
layer switching, quality of experience, scalable video