On the accuracy of MANET simulators

ABSTRACT

The deployment of wireless applications or protocols in the context of Mobile Ad-hoc NETworks (MANETs), often requires to step through a simulation phase. For the results of the simulation to be meaningful, it is important that the model on which is based the simulator matches as closely as possible the reality. In this paper we present the simulation results of a straightforward algorithm using several popular simulators (OPNET Modeler, NS-2, GloMoSim). The results tend to show that significant divergences exist between the simulators. This can be explained partly by the mismatching of the modelisation of each simulator and also by the different levels of detail provided to implement and configure the simulated scenarios.

REFERENCES

• 1: The REAL network simulator. http://www.cs.cornell.edu/skeshav/real/overview.html
• 2: L. Bajaj, M. Takai, R. Ahuja, K. Tang, R. Bagrodia, and M. Gerla. Glomosim: A scalable network simulation environment. Technical Report 990027, UCLA Computer Science Departmen, May 1999.
• 3: T. Camp, J. Boleng, and V. Davies. A survey of mobility models for ad hoc network research. Dept. of Math and Computer Sciences, Colorado School of Mines, Golden, CO.
• 4: I. W. Group. Wireless LAN medium access control (MAC) and physical layer (PHY) specifications. IEEE specification (http://standards.ieee.org/getieee802/download/802.11b-1999.pdf), Sep 1999. Work in Progress.
• 5: J. Heidemann, N. Bulusu, J. Elson, C. Intanagonwiwat and K. Lan and Y. Xu and W. Ye and D. Estrin, and R. Govindan. Effects of detail in wireless network simulation. In Proceedings of the SCS Multiconference on Distributed Simulation, pages 3--11, Phoenix, Arizona, USA, January 2001. USC/Information Sciences Institute, Society for Computer Simulation.
• 6: Chalermek Intanagonwiwat , Ramesh Govindan , Deborah Estrin, Directed diffusion: a scalable and robust communication paradigm for sensor networks, Proceedings of the 6th annual international conference on Mobile computing and networking, p.56-67, August 06-11, 2000, Boston, Massachusetts, United States [doi>10.1145/345910.345920]
• 7: D. Johnson and D. Maltz. Dynamic source routing in ad hoc wireless networks. In T. Imielinski and H. Korth, editors, Mobile Computing, chapter 5, pages 195--206. Kluwer Academic Publishers, Seattle, WA, 1996.
• 8: R. A. Meyer. PARSEC User Manual. UCLA Parralel Computing Laboratory, http://pcl.cs.ucla.edu.
• 9: The network simulator - NS-2. http://www.isi.edu/nsnam/ns.
• 10: OPNET Modeler. http://www.opnet.com/products/modeler/home.html.
• 11: T. C. M. Project. The CMU Monarch Project's wireless and mobility extensions to ns, Aug 1998. Available from http://www.monarch.cs.cmu.edu.
• 12: Mineo Takai , Jay Martin , Rajive Bagrodia, Effects of wireless physical layer modeling in mobile ad hoc networks, Proceedings of the 2nd ACM international symposium on Mobile ad hoc networking & computing, October 04-05, 2001, Long Beach, CA, USA [doi>10.1145/501426.501429]
• 13: Yongguang Zhang , Wei Li, An integrated environment for testing mobile ad-hoc networks, Proceedings of the 3rd ACM international symposium on Mobile ad hoc networking & computing, June 09-11, 2002, Lausanne, Switzerland [doi>10.1145/513800.513813]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Distributed networks

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Wireless communication

  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Performance measures
  D.4 OPERATING SYSTEMS
      D.4.8 Performance
          Subjects: Simulation; Measurements; Modeling and prediction

  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.6 Simulation Output Analysis

General Terms:
Measurement, Performance

Keywords:
GloMoSim, MANET, NS-2, OPNET, accuracy, flooding, mobile ad-hoc networks, simulations, simulators