ns-2 distributed clients emulation: accuracy and scalability

ABSTRACT

ns-2 is a well known network simulator, recently extended with improvements to its emulation facility. Real-time constraints and the boundary between real-world and simulated entities impose scalability and accuracy limitations, and distort the simulated network as perceived by the involved real-world applications. This paper presents results from a performance evaluation of the ns-2 emulation facility. Conducting emulation experiments of differing magnitudes, and under varying emulation environment set-ups, we unveil central types of scalability limitations and obtainable accuracy. We find throughput limits using high and low end computers, and a significant throughput decrease when increasing the number of involved real-world applications. We furthermore show how end-to-end delay increases both with traffic load and an increasing number of involved real-world applications. Moreover, during these conditions, we find that the system treats these applications increasingly unfair by distributing total throughput unevenly between them, and by imposing different amounts of end-to-end delay.

REFERENCES

• 1: D. Wetherall. Otcl, online software: http://otcl-tclcl.sourceforge.net/otcl.
• 2: D. Mahrenholz and S. Ivanov. Adjusting the ns-2 emulation mode to a live netowork. In Proceedings of KiVS. Springer, 2005.
• 3: Daniel Mahrenholz , Svilen Ivanov, Real-Time Network Emulation with ns-2, Proceedings of the 8th IEEE International Symposium on Distributed Simulation and Real-Time Applications, p.29-36, October 21-23, 2004 [doi>10.1109/DS-RT.2004.34]
• 4: E. Göoktürk. Emulating ad hoc networks: Differences from simulations and emulation specific problems. New Trends in Computer Networks conference, July 2005.
• 5: D. Mahrenholz and S. Ivanov. HOWTO: Wireless Network Emulation Using ns-2 and Distributed Applications. University of Magdeburg, Germany, December 2004.
• 6: USC/ISI A Collaboration Between Researchers at US Berkley, LBL and Xerox PARC. ns-2 Manual. The VINT Project, October 2006.
• 7: M. Krasnyansky and M. Yevmenkin. Universal tun/tap driver, online software: http://vtun.sourceforge.net/tu.
• 8: Traffic generator, online software: http://www.postel.org/tg.
• 9: S. Kristiansen. ns-2 emulation: Performance evaluation and improvement proposals. Master's thesis, University of Oslo, Dep. of Informatics, 2008.
• 10: P. Russel and P. McHardy. netfilter/iptables, online software: http://www.netfilter.org.
• 11: W. Almesberger and E. Ica. Linux network traffic control - implementation overview. In Proceedings of 5th Annual Linux Expo, 1999.
• 12: G. F. Riley, R. M. Fujimoto, and M. H. Ammar. Parallel/distributed ns, online software: http://www.cc.gatech.edu/computing, 2000.
• 13: George F. Riley , Richard M. Fujimoto , Mostafa H. Ammar, A Generic Framework for Parallelization of Network Simulations, Proceedings of the 7th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, p.128, March 24-28, 1999
• 14: Net:bridge, online software: http://www.linux-foundation.org/en/net:bridge.
• 15: E. Göktürk. A stance on emulation and testbeds, and a survey of network emulators and testbeds. In Proceedings of ECMS, 2007.
• 16: M. Kropff et al. A survey on real world and emulation testbeds for mobile ad hoc networks. In Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006. 2nd International Conference on, pages 6 pp.--453, 2006.
• 17: Brian White , Jay Lepreau , Leigh Stoller , Robert Ricci , Shashi Guruprasad , Mac Newbold , Mike Hibler , Chad Barb , Abhijeet Joglekar, An integrated experimental environment for distributed systems and networks, ACM SIGOPS Operating Systems Review, v.36 n.SI, Winter 2002 [doi>10.1145/844128.844152]
• 18: K. Fall. Network emulation in the vint/ns simulator. Univ. of California, Berkley, 1999.
• 19: S. Bhatia et al. Hosting virtual networks on commodity hardware. Technical report, Georgia Tech Computer Science, January 2008.
• 20: Ken Yocum , Kevin Walsh , Amin Vahdat , Priya Mahadevan , Dejan Kostic , Jeff Chase , David Becker, Scalability and accuracy in a large-scale network emulator, ACM SIGCOMM Computer Communication Review, v.32 n.3, p.28-28, July 2002 [doi>10.1145/571697.571717]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

Additional Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.3 Applications

Keywords:
NS-2, network emulation, network simulation, performance evaluation