The effectiveness of a QoE-based video output scheme for audio-video ip transmission

ABSTRACT

This paper shows the effectiveness and feasibility of a video output scheme the authors proposed previously to enhance QoE (Quality of Experience) (i.e., perceptual QoS) of audio-video IP transmission. The scheme, SCS (Switching between error Concealment and frame Skipping), utilizes a tradeoff relation between spatial and temporal quality caused by video error concealment and video frame skipping, both of which cope with video packet loss. The scheme switches from error concealment to frame skipping when the percentage of video slices error-concealed in a frame exceeds a threshold value, which is a key to achieving high QoE with SCS. We propose a way of selecting appropriate threshold values on the basis of real-time estimation of QoE. For that purpose, we performed two experiments for four values of the threshold. One experiment is the measurement of application-level QoS and QoE, from which we confirm the effectiveness of SCS and derive multiple regression lines that estimate QoE from the application-level QoS. The other is the measurement of the percentage of the selected threshold value by the proposed way with the multiple regression lines. Examining the QoE measured by the first experiment when we adopt the selected threshold values in the second experiment, we find that the way gives appropriate selections in many cases and therefore the SCS with the way of threshold selection is feasible.

REFERENCES

• 1: Mihaela van der Schaar , Philip A. Chou, Multimedia over IP and Wireless Networks: Compression, Networking, and Systems, Academic Press, Inc., Orlando, FL, 2007
• 2: IETF RFC 1633, "Integrated Services in the Internet Architecture: An Overview," June 1994.
• 3: IETF RFC 2475, "Architecture for Differentiated Services," Dec. 1998.
• 4: L. Atzori, F. G. B. De Natale, and C. Perra, "A spatio-temporal concealment technique using boundary matching algorithm and mesh-based warping (BMA-MBW)," IEEE Trans. Multimedia, vol.3, no.3, pp. 326--338, Sep. 2001.
• 5: S. Belfiore, M. Grangetto, E. Magli, and G. Olmo, "Spatio-temporal video concealment with perceptually optimized mode selection," in Proc. IEEE ICASSP, Apr. 2003.
• 6: S. Tasaka and Y. Ishibashi, "Mutually compensatory property of multimedia QoS," in Conf. Rec. IEEE ICC2002, pp. 1105--1111, Apr./May 2002.
• 7: ITU-T Rec. G.100/P.10 Amendment 1, "Amendment 1: new appendix I definition of Quality of Experience (QoE)," Jan. 2007.
• 8: H. Yoshimi and S. Tasaka, "The effect of error concealment and frame skipping on QoE in audio-video IP transmission," (in Japanese) IEICE Technical Report, CQ2007-93, Jan. 2008, and S. Tasaka and H. Yoshimi, "Enhancement of QoE in audio-video IP transmission by utilizing tradeoff between spatial and temporal quality for video packet loss," to appear in Conf. Rec. IEEE GLOBECOM 2008, Dec. 2008.
• 9: S. Tasaka, J. Sako and Y. Ito, "Enhancement of user-level QoS in audio-video IP transmission by utilizing the mutually compensatory property," in Conf. Rec. IEEE GLOBECOM2006, Nov. 2006.
• 10: ITU-T Rec. J.148, "Requirements for an objective perceptual multimedia quality model," May 2003.
• 11: Yoshihiro Ito , Shuji Tasaka , Yoshihiko Fukuta, Psychometric analysis of the effect of buffering control on user-level QoS in an interactive audio--visual application, Proceedings of the 2004 ACM workshop on Next-generation residential broadband challenges, October 15-15, 2004 [doi>10.1145/1026763.1026766]
• 12: Y. Ito and S. Tasaka, "Tradeoff relationship between fidelity and latency in interactive audio-video applications over IP networks," IEICE Trans. on Commun., vol. E90-B, no. 5, pp. 1112--1121, May 2007.
• 13: S. Tasaka and Y. Watanabe, "Real-time estimation of user-level QoS in audio-video IP transmission by using temporal and spatial quality," in Conf. Rec. IEEE GLOBECOM2007, Nov. 2007.
• 14: S. Tasaka and Y. Ito, "Psychometric analysis of the mutually compensatory property of multimedia QoS," in Conf. Rec. IEEE ICC2003, pp. 1880--1886, May 2003.
• 15: J. P. Guilford, Psychometric methods, McGraw-Hill, N. Y., 1954.
• 16: J. C. Nunnally and I. H. Bernstein, Psychometric theory, Third edition, McGraw-Hill, N. Y., 1994.
• 17: S. Tasaka and Y. Ito, "Real-time estimation of user-level QoS of audio-video transmission over IP networks," in Conf. Rec. IEEE ICC2006, June 2006.
• 18: Y. Ito and S. Tasaka, "Quantitative assessment of user-level QoS and its mapping", IEEE Trans. Multimedia, vol. 7, no. 3, pp. 572--584, June 2005.
• 19: F. Mosteller, "Remarks on the method of paired comparisons: III a test of significance for paired comparisons when equal standard deviations and equal correlations are assumed," Psychometrika, vol. 16, no. 2, pp. 207--218, June 1951.
• 20: S. Tasaka, Y. Ito, H. Yamada and J. Sako, "A method of user-level QoS guarantee by session control in audio-video transmission over IP networks," in Conf. Rec. IEEE GLOBECOM2006, Nov. 2006.
• 21: Mindcraft Inc., "WebStone benchmark information," http://www.mindcraft.com/webstone/.
• 22: "H.264/MPEG-4 AVC reference software JM11.0," http://iphome.hhi.de/suehring/tml/index.htm.
• 23: The Video Quality Experts Group, "Multimedia group test plan, draft version 1.19," http://www.its.bldrdoc.gov/vqeg/.
• 24: ITU-T Rec. P.911, "Subjective audiovisual quality assessment methods for multimedia applications," Dec. 1998.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output; Video (e.g., tape, disk, DVI)

General Terms:
Experimentation, Human Factors, Measurement, Performance

Keywords:
audio-video ip transmission, perceptual qos, qoe, qos, video error concealment, video frame skipping