Sampling time-dependent parameters in high-speed network monitoring

ABSTRACT

Nowadays network bandwidth is increasing continuously for end-users and network providers. Network monitoring tools have to be able to support these high-speed networks, processing a high number of packets per second. For this reason, network monitoring tools have to be improved using software or hardware techniques. In this paper we use sampling techniques, as a software technique that can provide the capacity of monitoring networks with high bandwidth, keeping a low-cost hardware platform. A new technique called mixed sampling is proposed and compared with other techniques proposed in the literature. We focus on time-dependent statistics not studied before with sampling. These statistics will require applying estimation techniques for better results

REFERENCES

• 1: Endace Measurement Systems. http://www.endace.com
• 2: A Scaleable Monitoring Platform for the Internet (SCAMPI). IST European Project. http://www.ist-scampi.org/
• 3: Andrew Begel , Steven McCanne , Susan L. Graham, BPF+: exploiting global data-flow optimization in a generalized packet filter architecture, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.123-134, August 30-September 03, 1999, Cambridge, Massachusetts, United States
• 4: I. Kim, J. Moon, and H. Y. Yeom, Timer-Based Interrupt Mitigation for High Performance Packet Processing, Proceedings of 5th International Conference on High-Performance Computing in the Asia-Pacific Region, 2001.
• 5: Lucas Deri. Improving Passive Packet Capture: Beyond Device Polling. 15th NMRG, Bremen, Germany, January 2004.
• 6: Kimberly C. Claffy , George C. Polyzos , Hans-Werner Braun, Application of sampling methodologies to network traffic characterization, Conference proceedings on Communications architectures, protocols and applications, p.194-203, September 13-17, 1993, San Francisco, California, United States
• 7: Nick Duffield , Carsten Lund , Mikkel Thorup, Estimating flow distributions from sampled flow statistics, Proceedings of the 2003 conference on Applications, technologies, architectures, and protocols for computer communications, August 25-29, 2003, Karlsruhe, Germany [doi>10.1145/863955.863992]
• 8: Cristian Estan , Ken Keys , David Moore , George Varghese, Building a better NetFlow, Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications, August 30-September 03, 2004, Portland, Oregon, USA
• 9: Nick Duffield , Carsten Lund , Mikkel Thorup, Flow sampling under hard resource constraints, Proceedings of the joint international conference on Measurement and modeling of computer systems, June 10-14, 2004, New York, NY, USA
• 10: Nicolas Hohn , Darryl Veitch, Inverting sampled traffic, Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, October 27-29, 2003, Miami Beach, FL, USA [doi>10.1145/948205.948235]
• 11: Kedar Dhandhere, Hyang-Ah Kim and Tim Jia-Yu Pan. The Application and Effect of Sampling Methods on Collecting Network Traffic Statistics. Technical Report Carnegie Mellon, April 28, 2001.
• 12: F. Yegenoglu, F. Faris, O. Qadan. A model for representing wide area Internet packet behavior. Proceeding of the IEEE InternationalPerformance, Computing, and Communications Conference, 2000. IPCCC '00. pp.167--173, Feb 2000.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.3 Network Operations
          Subjects: Network monitoring

General Terms:
Algorithms, Measurement, Performance

Keywords:
estimation, network monitoring, sampling