MediSyn: a synthetic streaming media service workload generator

ABSTRACT

Currently, Internet hosting centers and content distribution networks leverage statistical multiplexing to meet the performance requirements of a number of competing hosted network services. Developing efficient resource allocation mechanisms for such services requires an understanding of both the short-term and long-term behavior of client access patterns to these competing services. At the same time, streaming media services are becoming increasingly popular, presenting new challenges for designers of shared hosting services. These new challenges result from fundamentally new characteristics of streaming media relative to traditional web objects, principally different client access patterns and significantly larger computational and bandwidth overhead associated with a streaming request. To understand the characteristics of these new workloads we use two long-term traces of streaming media services to develop MediSyn, a publicly available streaming media workload generator. In summary, this paper makes the following contributions: i) we model the long-term behavior of network services capturing the process of file introduction and changing file popularity, ii) we present a novel generalized Zipf-like distribution that captures recently-observed popularity of both web objects and streaming media not captured by existing Zipf-like distributions, and iii) we capture a number of characteristics unique to streaming media services, including file duration, encoding bit rate, session duration and non-stationary popularity of media accesses.

REFERENCES

• 1: General Pareto Distribution. http://www.math.uah.edu/stat/special/special12.html.
• 2: S. Acharya, B. Smith, and P. Parnes. Characterizing User Access to Videos on the World Wide Web. In Proceedings of ACM/SPIE Multimedia Computing and Networking, January 2000.
• 3: Jussara M. Almeida , Jeffrey Krueger , Derek L. Eager , Mary K. Vernon, Analysis of educational media server workloads, Proceedings of the 11th international workshop on Network and operating systems support for digital audio and video, p.21-30, January 2001, Port Jefferson, New York, United States [doi>10.1145/378344.378348]
• 4: Virgílio Almeida , Azer Bestavros , Mark Crovella , Adriana de Oliveira, Characterizing reference locality in the WWW, Proceedings of the fourth international conference on on Parallel and distributed information systems, p.92-107, December 18-20, 1996, Miami Beach, Florida, United States
• 5: V. Almeida, M. Cesirio, R. Fonseca, W. Meira Jr., and C. Murta. Analyzing the behavior of a proxy server in the light of regional and cultural issues. In Proceedings of WCW, June 1998.
• 6: Paul Barford , Mark Crovella, Generating representative Web workloads for network and server performance evaluation, Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, p.151-160, June 22-26, 1998, Madison, Wisconsin, United States
• 7: R. Braynard, D. KostiΕ, A. Rodriguez, J. Chase, and A. Vahdat. Opus: an Overlay Peer Utility Service. In Proceedings of OPENARCH, June 2002.
• 8: L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web Caching and Zipf-like Distributions: Evidence, and Implications. In Proceedings of INFOCOM, March 1999.
• 9: Jeffrey S. Chase , Darrell C. Anderson , Prachi N. Thakar , Amin M. Vahdat , Ronald P. Doyle, Managing energy and server resources in hosting centers, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 10: L. Cherkasova and G. Ciardo. Characterizing Temporal Locality and its Impact on Web Server Performance. In Proceedings of ICCCN, October 2000.
• 11: Ludmila Cherkasova , Minaxi Gupta, Characterizing locality, evolution, and life span of accesses in enterprise media server workloads, Proceedings of the 12th international workshop on Network and operating systems support for digital audio and video, May 12-14, 2002, Miami, Florida, USA [doi>10.1145/507670.507676]
• 12: M. Chesire, A. Wolman, G. Voelker, and H. Levy. Measurement and Analysis of a Streaming-Media Workload. In Proceedings of USITS, March 2001.
• 13: R. Jain. The art of computer systems performance analysis: technique for experimental design,measurement,simulation and modeling. John Wiley & Sons, 1992.
• 14: Shudong Jin , Azer Bestavros, Temporal Locality in Web Request Streams: Sources, Characteristics, and Caching Implications, Boston University, Boston, MA, 1999
• 15: S. Jin and A. Bestavros. GISMO: A Generator of Internet Streaming Media Objects and Workloads. Technical Report BUCS-TR-2001-020, Department of Computer Science, Boston University, October 2001.
• 16: D. Luperello, S. Mukherjee, and S. Paul. Streaming Media Traffic: an Empirical Study. In Proceedings of WCW, June 2002.
• 17: Hewlett Packard. Utility Data Center. http://www.hp.com/go/hpudc.
• 18: J. Padhye and J. Kurose. An Empirical Study of Client Interactions with a Continuous-Media Courseware Server. In Proceedings of NOSSDAV, June 1998.
• 19: S. Ross. Introduction to probability models. Academic Press, 1997.
• 20: S. Sen, J. Rexford, and D. Towsley. Proxy Prefix Caching for Multimedia Streams. In Proceedings of INFOCOM, March 1999.
• 21: W. Tang, Y. Fu, L. Cherkasova , and A. Vahdat. Long-term Streaming Media Server Workload Analysis and Modeling. HP Laboratories, Technical Report HPL-2003-23, February 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.0 General

General Terms:
Algorithms, Design, Measurement, Performance

Keywords:
streaming media, workload analysis, workload generator