The impact and implications of the growth in residential user-to-user traffic

ABSTRACT

It has been reported worldwide that peer-to-peer traffic is taking up a significant portion of backbone networks. In particular, it is prominent in Japan because of the high penetration rate of fiber-based broadband access. In this paper, we first report aggregated traffic measurements collected over 21 months from seven ISPs covering 42% of the Japanese backbone traffic. The backbone is dominated by symmetric residential traffic which increased 37%in 2005. We further investigate residential per-customer trafficc in one of the ISPs by comparing DSL and fiber users, heavy-hitters and normal users, and geographic traffic matrices. The results reveal that a small segment of users dictate the overall behavior; 4% of heavy-hitters account for 75% of the inbound volume, and the fiber users account for 86%of the inbound volume. About 63%of the total residential volume is user-to-user traffic. The dominant applications exhibit poor locality and communicate with a wide range and number of peers. The distribution of heavy-hitters is heavy-tailed without a clear boundary between heavy-hitters and normal users, which suggests that users start playing with peer-to-peer applications, become heavy-hitters, and eventually shift from DSL to fiber. We provide conclusive empirical evidence from a large and diverse set of commercial backbone data that the emergence of new attractive applications has drastically affected traffic usage and capacity engineering requirements.

REFERENCES

• 1: Australian Bureau of Statistics: Internet Activity, Australia, Mar 2005. http://www.abs.gov.au/.
• 2: Cisco Sampled NetFlow. http://www.cisco.com/univercd/cc/td/doc/product/software/ios120/120newf%t/120limit/120s/120s11/12s_sanf.htm.
• 3: K. Claffy, G. Polyzos, and H. Braun. Traffic characteristics of the T1 NSFNET backbone. In INFOCOM '93, pages 885--892, San Francisco, CA, Mar. 1993.
• 4: Anja Feldmann , Albert Greenberg , Carsten Lund , Nick Reingold , Jennifer Rexford , Fred True, Deriving traffic demands for operational IP networks: methodology and experience, Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, p.257-270, August 28-September 01, 2000, Stockholm, Sweden
• 5: C. Fraleigh, S. Moon, B. Lyles, C. Cotton, M. Khan, D. Moll, R. Rockell, T. Seely, and C. Diot. Packet-Level Traffic Measurements from the Sprint IP Backbone. IEEE Network 17(6):6--16, Nov. 2003.
• 6: Kensuke Fukuda , Kenjiro Cho , Hiroshi Esaki, The impact of residential broadband traffic on Japanese ISP backbones, ACM SIGCOMM Computer Communication Review, v.35 n.1, January 2005 [doi>10.1145/1052812.1052820]
• 7: Krishna P. Gummadi , Richard J. Dunn , Stefan Saroiu , Steven D. Gribble , Henry M. Levy , John Zahorjan, Measurement, modeling, and analysis of a peer-to-peer file-sharing workload, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 8: L. Guo, S. Chen, Z. Xiao, E. Tan, X. Ding, and X. Zhang. Measurements, analysis, and modeling of bittorrent-like systems. In IMC2005, pages 35--48, Berkeley, CA, Oct. 2005.
• 9: Hong Kong OFTA: Statistics of Internet Traffic Volume. http://www.ofta.gov.hk/en/tele-lic/operator-licensees/opr-isp/s2.html.
• 10: M. Izal, G. Urvoy-Keller, E. W. Biersack, P. A. Felber, A. A. Hamra, and L. Garces-Erice. Dissecting bittorrent:Five months in a torrent's lifetime. In PAM2004 (LNCS3015), pages 1--11, Antibes Juan-les-Pins, France, Apr. 2004.
• 11: Japan Internet Exchange Co., Ltd. http://www.jpix.co.jp.
• 12: Multifeed JPNAP service. http://www.jpnap.net.
• 13: I. Kaneko. The Technology of Winny (In Japanese). ASCII, Tokyo, Japan, 2005.
• 14: T. Karagiannis, A. Broido, N. Brownlee, kc claffy, and M. Faloutsos. Is p2p dying or just hiding?In Globecom 2004, pages 1532--538, Dallas, TX, Dec. 2004.
• 15: T. Karagiannis, P. Rodriguez, and D. Papagiannaki. Should Internet service providers fear peer-assisted content distribution?In IMC2005, pages 63--76, Berkeley, CA, Oct. 2005.
• 16: Alexander Klemm , Christoph Lindemann , Mary K. Vernon , Oliver P. Waldhorst, Characterizing the query behavior in peer-to-peer file sharing systems, Proceedings of the 4th ACM SIGCOMM conference on Internet measurement, October 25-27, 2004, Taormina, Sicily, Italy [doi>10.1145/1028788.1028796]
• 17: L. Lessig. The future of ideas. Random House, 2001.
• 18: NSPIXP. http://nspixp.wide.ad.jp.
• 19: A. M. Odlyzko. Internet traffic growth: Sources and implications. In Optical Transmission Systems and Equipment for WDM Networking II, pages 1--15, San Jose, CA, Jan. 2003.
• 20: OECD Broadband Statistics, December 2005. http://oecd.org/sti/ict/broadband.
• 21: T. Oetiker. RRDtool: Round Robin Database Tool. http://ee-sta~ethz.ch/~oetiker/webtools/rrdtool/.
• 22: Tobias Oetiker, MRTG: The Multi Router Traffic Grapher, Proceedings of the 12th Conference on Systems Administration, p.141-148, December 06-11, 1998
• 23: V. Paxson. Growth trends in wide-area TCP connections. IEEE Network, 8(4):8--17, July 1994.
• 24: L. Plissonneau, J.-L. Costeux, and P. Brown. Analysis of peer-to-peer traffic on ADSL. In PAM2005 (LNCS3431), pages 69--82, Boston, MA, Mar. 2005.
• 25: M. Roughan, A. Greenberg, C. Kalmanek, M. Rumsewicz, J. Yates, and Y. Zhang. Experience in measuring Internet backbone traffic variability:Models, metrics, measurements and meaning. In International Teletraffic Congress 18, 2003.
• 26: S. Saroiu, P. K. Gummadi, and S. D. Gribble. A measurement study of peer-to-peer file sharing systems. In MMCN '02, pages 156--170, San Jose, CA, Jan. 2002.
• 27: Subhabrata Sen , Jia Wang, Analyzing peer-to-peer traffic across large networks, Proceedings of the 2nd ACM SIGCOMM Workshop on Internet measurment, November 06-08, 2002, Marseille, France [doi>10.1145/637201.637222]
• 28: D. Stutzbach, R. Rejaie, and S. Sen. Characterizing unstructured overlay topologies in modern p2p file-share systems. In IMC2005, pages 49--62, Berkeley, CA, Oct. 2005.
• 29: Statistical Outlook of the Internet in Japan (in Japanese). The Ministry of Internal Affairs and Communications, 2005.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.3 Network Operations
          Subjects: Network monitoring

General Terms:
Management, Measurement

Keywords:
ISP backbone traffic, residential broadband, traffic growth