Accuracy study and improvement of network simulation in the SimGrid framework

ABSTRACT

Distributed computing is a very broad and active research area comprising fields such as cluster computing, computational grids, desktop grids and peer-to-peer (P2P) systems. Studies in this area generally resort to simulations, which enable reproducible results and make it possible to explore wide ranges of platform and application scenarios. In this context, network simulation is certainly the most critical part. Many packet-level network simulators are available and enable high-accuracy simulation but they lead to prohibitively long simulation times. Therefore, many simulation frameworks have been developed that simulate networks at higher levels, thus enabling fast simulation but losing accuracy. One such framework, SimGrid, uses a flow-level approach that approximates the behavior of TCP networks, including TCP's bandwidth sharing properties. A preliminary study of the accuracy loss by comparing it to popular packet-level simulators has been proposed in [11] and in which regimes in which SimGrid's accuracy is comparable to that of these packet-level simulators are identified. In this article we come back on this study, reproduce these experiments and provide a deeper analysis that enables us to greatly improve SimGrid's range of validity.

REFERENCES

• 1: U. P. X. D. Al'fag and A. Schiper. Neko: A Single Environment to Simulate and Prototype Distributed Algorithms. Journal of Information Science and Engeneering, 18(6):981--997, 2002.
• 2: Dimitri Bertsekas , Robert Gallager, Data networks, Prentice-Hall, Inc., Upper Saddle River, NJ, 1987
• 3: D. G. Cameron, A. P. Millar, C. Nicholson, F. Z. R. Carvajal-Schiaffino, and K. Stockinger. Optorsim: a Simulation Tool for Scheduling and Replica Optimization in Data Grids. In Computing in High Energy and Nuclear Physics (CHEP) conference, September 2004.
• 4: Henri Casanova , Arnaud Legrand , Martin Quinson, SimGrid: A Generic Framework for Large-Scale Distributed Experiments, Proceedings of the Tenth International Conference on Computer Modeling and Simulation, p.126-131, April 01-03, 2008 [doi>10.1109/UKSIM.2008.28]
• 5: H. Casanova and L. Marchal. A network model for simulation of grid application. Technical Report 2002--40, LIP, 2002.
• 6: Dah Ming Chiu, Some Observations on Fairness of Bandwidth Sharing, Proceedings of the Fifth IEEE Symposium on Computers and Communications (ISCC 2000), p.125, July 04-06, 2000
• 7: J. H. Cowie, H. liu, J. Liu, D. Nicol, and A. Ogielski. Towards Realistic Million-Node Internet Simulations. In International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), June 1999.
• 8: James H. Cowie , David M. Nicol , Andy T. Ogielski, Modeling the Global Internet, Computing in Science and Engineering, v.1 n.1, p.42-50, January 1999 [doi>10.1109/5992.743621]
• 9: C. L. Dumitrescu , I. Foster, GangSim: a simulator for grid scheduling studies, Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2, p.1151-1158, May 09-12, 2005
• 10: Sally Floyd , Kevin Fall, Promoting the use of end-to-end congestion control in the Internet, IEEE/ACM Transactions on Networking (TON), v.7 n.4, p.458-472, Aug. 1999 [doi>10.1109/90.793002]
• 11: Kayo Fujiwara , Henri Casanova, Speed and accuracy of network simulation in the SimGrid framework, Proceedings of the 2nd international conference on Performance evaluation methodologies and tools, October 22-27, 2007, Nantes, France
• 12: B. Liu, D. R. Figueiredo, Y. Guo, J. F. Kurose, and D. F. Towsley. A Study of Networks Simulation Efficiency: Fluid Simulation vs. Packet-level Simulation. In IEEE INFOCOM, April 2001.
• 13: Xin Liu , Andrew A. Chien, Traffic-based Load Balance for Scalable Network Emulation, Proceedings of the 2003 ACM/IEEE conference on Supercomputing, p.40, November 15-21, 2003
• 14: Steven H. Low, A duality model of TCP and queue management algorithms, IEEE/ACM Transactions on Networking (TON), v.11 n.4, p.525-536, August 2003 [doi>10.1109/TNET.2003.815297]
• 15: Laurent Massoulié , James Roberts, Bandwidth sharing: objectives and algorithms, IEEE/ACM Transactions on Networking (TON), v.10 n.3, p.320-328, June 2002 [doi>10.1109/TNET.2002.1012364]
• 16: Matthew Mathis , Jeffrey Semke , Jamshid Mahdavi , Teunis Ott, The macroscopic behavior of the TCP congestion avoidance algorithm, ACM SIGCOMM Computer Communication Review, v.27 n.3, p.67-82, July 1997 [doi>10.1145/263932.264023]
• 17: A. Medina, A. Lakhina, I. Matta, and J. Byers. BRITE: Universal topology generation from a user's perspective. Electronic manual, Apr. 2001. Available at http://www.nrg.cs.uoregon.edu/topology_generation/brite-manual/.
• 18: T. Ott, J. Kemperman, and M. Mathis. Window Size Behavior in TCP/IP with Constant Loss Probabillity. In 4th IEEE Workshop on High-Performance Communication Systems, June 1997.
• 19: Jitendra Padhye , Victor Firoiu , Don Towsley , Jim Kurose, Modeling TCP throughput: a simple model and its empirical validation, Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication, p.303-314, August 31-September 04, 1998, Vancouver, British Columbia, Canada
• 20: Sugree Phatanapherom , Putchong Uthayopas , Voratas Kachitvichyanukul, Dynamic scheduling II: fast simulation model for grid scheduling using HyperSim, Proceedings of the 35th conference on Winter simulation: driving innovation, December 07-10, 2003, New Orleans, Louisiana
• 21: B. Quetier and F. Cappello. A Survey of Grid Research Tools: Simulators, Emulators and Real Life Platforms. In 17th IMACS World Congress, July 2005.
• 22: George F. Riley, The Georgia Tech Network Simulator, Proceedings of the ACM SIGCOMM workshop on Models, methods and tools for reproducible network research, August 25-27, 2003, Karlsruhe, Germany [doi>10.1145/944773.944775]
• 23: The SimGrid project. http://simgrid.gforge.inria.fr.
• 24: Marc Snir , Steve Otto, MPI-The Complete Reference: The MPI Core, MIT Press, Cambridge, MA, 1998
• 25: H. J. Song , X. Liu , D. Jakobsen , R. Bhagwan , X. Zhang , K. Taura , A. Chien, The MicroGrid: A scientific tool for modeling Computational Grids, Scientific Programming, v.8 n.3, p.127-141, August 2000
• 26: Anthony Sulistio , Gokul Poduval , Rajkumar Buyya , Chen-Khong Tham, On incorporating differentiated levels of network service into GridSim, Future Generation Computer Systems, v.23 n.4, p.606-615, May, 2007 [doi>10.1016/j.future.2006.10.006]
• 27: Atsuko Takefusa , Satoshi Matsuoka , Kento Aida , Hidemoto Nakada , Umpei Nagashima, Overview of a Performance Evaluation System for Global Computing Scheduling Algorithms, Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing, p.11, August 03-06, 1999
• 28: N.-. Team. The Network Simulator - NS-2. http://nsnam.isi.edu/nsnam/index.php/User_Information.
• 29: Amin Vahdat , Ken Yocum , Kevin Walsh , Priya Mahadevan , Dejan Kostić , Jeff Chase , David Becker, Scalability and accuracy in a large-scale network emulator, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060315]
• 30: B. M. Waxman. Routing of Multipoint Connections. IEEE Journal on Selected Areas in Communications, 6(9):1617--1622, December 1988.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.4 Model Validation and Analysis

Additional Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.7 Simulation Support Systems

Keywords:
network simulation