An analysis of live streaming workloads on the internet

ABSTRACT

In this paper, we study the live streaming workload from a large content delivery network. Our data, collected over a 3 month period, contains over 70 million requests for 5,000 distinct URLs from clients in over 200 countries. To our knowledge, this is the most extensive data of live streaming on the Internet that has been studied to date. Our contributions are two-fold. First, we present a macroscopic analysis of the workload, characterizing popularity, arrival process, session duration, and transport protocol use. Our results show that popularity follows a 2-mode Zipf distribution, session interarrivals within small time-windows are exponential, session durations are heavy-tailed, and that UDP is far from having universal reach on the Internet. Second, we cover two additional characteristics that are more specific to the nature of live streaming applications: the diversity of clients in comparison to traditional broadcast media like radio and TV, and the phenomena that many clients regularly join recurring events. We find that Internet streaming does reach a wide audience, often spanning hundreds of AS domains and tens of countries. More interesting is that small streams also have a diverse audience. We also find that recurring users often have lifetimes of at least as long as one-third of the days in the event.

REFERENCES

• 1: Jussara M. Almeida , Jeffrey Krueger , Derek L. Eager , Mary K. Vernon, Analysis of educational media server workloads, Proceedings of the 11th international workshop on Network and operating systems support for digital audio and video, p.21-30, January 2001, Port Jefferson, New York, United States [doi>10.1145/378344.378348]
• 2: Virgílio Almeida , Azer Bestavros , Mark Crovella , Adriana de Oliveira, Characterizing reference locality in the WWW, Proceedings of the fourth international conference on on Parallel and distributed information systems, p.92-107, December 18-20, 1996, Miami Beach, Florida, United States
• 3: Kevin C. Almeroth , Mostafa H. Ammar, Collecting and Modeling the Join/Leave Behavior of Multicast Group Members in the MBone, Proceedings of the High Performance Distributed Computing (HPDC '96), p.209, August 06-09, 1996
• 4: Konstantin Andreev , Bruce M. Maggs , Adam Meyerson , Ramesh K. Sitaraman, Designing overlay multicast networks for streaming, Proceedings of the fifteenth annual ACM symposium on Parallel algorithms and architectures, June 07-09, 2003, San Diego, California, USA [doi>10.1145/777412.777437]
• 5: L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web Caching and Zipf-like Distributions: Evidence and Implications. In Proceedings of the IEEE INFOCOMM '99, March 1999.
• 6: M. Chesire, A. Wolman, G. Voelker, and H. Levy. Measurement and Analysis of a Streaming-Media Workload. In Proceedings of Usenix Symposium on Internet Technologies and Systems (USITS), March 2001.
• 7: Mark E. Crovella , Murad S. Taqqu, Estimating the heavy tail index from scaling properties, Methodology and Computing in Applied Probability, v.1 n.1, p.55-79, July 1999 [doi>10.1023/A:1010012224103]
• 8: Jun-Hong Cui , Michalis Faloutsos , Dario Maggiorini , Mario Gerla , Khaled Boussetta, Measuring and modelling the group mmbership in the internet, Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, October 27-29, 2003, Miami Beach, FL, USA [doi>10.1145/948205.948215]
• 9: Carlos Cunha , Azer Bestavros , Mark Crovella, Characteristics of WWW Client-based Traces, Boston University, Boston, MA, 1995
• 10: S. Floyd, M. Handley, J. Padhye, and J. Widmer. Multicast Routing in Internetworks and Extended LANs. In Proceedings of the ACM SIGCOMM, August 2000.
• 11: Steven Glassman, A caching relay for the World Wide Web, Selected papers of the first conference on World-Wide Web, p.165-173, November 1994, Geneva, Switzerland
• 12: Krishna P. Gummadi , Richard J. Dunn , Stefan Saroiu , Steven D. Gribble , Henry M. Levy , John Zahorjan, Measurement, modeling, and analysis of a peer-to-peer file-sharing workload, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 13: IxMapper. http://www.ixiacom. com/products.
• 14: Balachander Krishnamurthy , Jia Wang, On network-aware clustering of Web clients, Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, p.97-110, August 28-September 01, 2000, Stockholm, Sweden
• 15: T. M. Kroeger, J. C. Mogul, and C. Maltzahn. Digital's web proxy traces. Available at ftp://ftp.digital. com/pub/DEC/traces/proxy/webtraces.html, August 1996.
• 16: A. Lakhina, J. W. Byers, M. Crovella, and I. Matta. On the Geographic Location of Internet Resources. In IEEE Journaln Selected Areas in Communications Vol. 21 No. 6, Aug 2003.
• 17: MaxMind GeoIP Free Country Database. http://www.maxmind.com/app/geoipcountry.
• 18: Microsoft Windows Media Services 9 Series and Windows Media Services Version 4. 1 - Performance Comparison. http://www. veritest.com/clients/reports/microsoft/ms media services. pdf.
• 19: Venkata N. Padmanabhan , Helen J. Wang , Philip A. Chou , Kunwadee Sripanidkulchai, Distributing streaming media content using cooperative networking, Proceedings of the 12th international workshop on Network and operating systems support for digital audio and video, May 12-14, 2002, Miami, Florida, USA [doi>10.1145/507670.507695]
• 20: Route Views Project. http://www.routeviews.org/.
• 21: Kunwadee Sripanidkulchai , Hui Zhang , Bruce Maggs, A measurement-driven approach to designing peer-to-peer systems, Carnegie Mellon University, Pittsburgh, PA, 2005
• 22: Kunwadee Sripanidkulchai , Aditya Ganjam , Bruce Maggs , Hui Zhang, The feasibility of supporting large-scale live streaming applications with dynamic application end-points, Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications, August 30-September 03, 2004, Portland, Oregon, USA
• 23: Eveline Veloso , Virgílio Almeida , Wagner Meira , Azer Bestavros , Shudong Jin, A hierarchical characterization of a live streaming media workload, Proceedings of the 2nd ACM SIGCOMM Workshop on Internet measurment, November 06-08, 2002, Marseille, France [doi>10.1145/637201.637220]
• 24: Yubing Wang , Mark Claypool , Zheng Zuo, An empirical study of realvideo performance across the internet, Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement, November 01-02, 2001, San Francisco, California, USA [doi>10.1145/505202.505239]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

General Terms:
Measurement

Keywords:
content delivery networks, live streaming