ns-2 vs. OPNET: a comparative study of the IEEE 802.11e technology on MANET environments

ABSTRACT

In this work we present the results of a comparative study between two well-known network simulators: ns-2 and OP-NET Modeler. In particular, we focus on a performance evaluation of the IEEE 802.11e technology on Mobile Ad-hoc Networks (MANETs) in both stationary and mobile scenarios. The paper describes the tested scenarios in detail, and discusses simulation results obtained with OPNET Modeler, comparing them with those obtained with ns-2. The performance of IEEE 802.11e in the presence of legacy IEEE 802.11 stations is also analyzed. Due to the significant differences between both simulators, we enumerate those changes required so as to make results obtained via both simulators comparable. The results that have been reached support the conclusion that the behavior of both simulators is quite similar in general.

REFERENCES

• 1: IEEE Standards for Information Technology -- ANSI/IEEE Std 802.11 -- Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications, online, 1999.
• 2: IEEE Standards for Information Technology -- IEEE Std 802.11e -- Draft Supplement to Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications: Medium Access Control (MAC) Quality of Service Enhancements. online, 2005.
• 3: Todd R. Andel , Alec Yasinac, On the Credibility of Manet Simulations, Computer, v.39 n.7, p.48-54, July 2006 [doi>10.1109/MC.2006.242]
• 4: Becker, M., Weerawardane, T. L., Li, X., and Görg, C. Extending OPNET Modeler with external pseudo random number generators and statistical evaluation by the limited relative error algorithm. In Proceedings of Recent Advances in Modeling and Simulation Tools for Communication Networks and Services (2007), N. Ince and A. Bragg, Eds., Springer, pp. 241--255.
• 5: Carlos T. Calafate , Pietro Manzoni , Manuel P. Malumbres, Assessing the Effectiveness of IEEE 802.11e in Multi-Hop Mobile Network Environments, Proceedings of the The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, p.205-212, October 04-08, 2004
• 6: Carlos T. Calafate , Pietro Manzoni , Manuel P. Malumbres, On the Interaction Between IEEE 802.11e and Routing Protocols in Mobile Ad-Hoc Networks, Proceedings of the 13th Euromicro Conference on Parallel, Distributed and Network-Based Processing, p.110-117, February 09-12, 2005 [doi>10.1109/EMPDP.2005.27]
• 7: David Cavin , Yoav Sasson , André Schiper, On the accuracy of MANET simulators, Proceedings of the second ACM international workshop on Principles of mobile computing, October 30-31, 2002, Toulouse, France [doi>10.1145/584490.584499]
• 8: Flores Lucio, G., Paredes-Farrera, M., Jammeh, E., Fleury, M., and J Reed, M. Opnet modeler and ns-2 - comparing the accuracy of network simulators for packet-level analysis using a network testbed. WSEAS Transactions on Computers 2, 3 (July 2003), 700--707.
• 9: Hechenleitner, B., and Entacher, K. On shortcomings of the ns-2 random number generator. In Communication Networks and Distributed Systems Modeling and Simulation Conference (CNDS 2002) (2002).
• 10: Johnson, D. B., and Maltz, D. A. Dynamic source routing in ad hoc wireless networks. In Mobile Computing, Imielinski and Korth, Eds., vol. 353. Kluwer Academic Publishers, 1996.
• 11: Stuart Kurkowski , Tracy Camp , Michael Colagrosso, MANET simulation studies: the incredibles, ACM SIGMOBILE Mobile Computing and Communications Review, v.9 n.4, October 2005 [doi>10.1145/1096166.1096174]
• 12: Malowidzki, M. Network simulators: A developer's perspective. In Int. Symp. on Performance Evaluation of Computer and Telecommunication Systems (SPECTS) (2004).
• 13: MANET Working Group. Ad hoc On-demand Distance Vector (AODV) routing, July 2003. Request For Comments 3561.
• 14: Navidi, W., Camp, T., and Bauer, N. Improving the accuracy of random waypoint simulations through steady-state initialization. In 15th Int. Conf. on Modeling and Simulation (MS) (2004).
• 15: The Network Simulator -- ns-2. http://www.isi.edu/nsnam/ns/.
• 16: OPNET Technologies Inc. OPNET Modeler. http://www.opnet.com/.
• 17: Pawlikowski, K., Jeong, H. D. J., and Lee, J. S. R. On credibility of simulation studies of telecommunication networks. IEEE Communications Magazine 40, 1 (2002), 132--139.
• 18: Luiz Felipe Perrone , Yougu Yuan , David M. Nicol, Simulation of large scale networks II: modeling and simulation best practices for wireless ad hoc networks, Proceedings of the 35th conference on Winter simulation: driving innovation, December 07-10, 2003, New Orleans, Louisiana
• 19: Dragan Savić , Matevž Pustišek , Francesco Potortì, A tool for packaging and exchanging simulation results, Proceedings of the 1st international conference on Performance evaluation methodolgies and tools, October 11-13, 2006, Pisa, Italy [doi>10.1145/1190095.1190172]
• 20: Wlethoelter, S., and Hoene, C. Design and verification of an IEEE 802.11e EDCF simulation model in ns-2.26. Tech. Rep. TKN-03-019, Telecommunication Networks Group, Technische Universität Berlin, Nov. 2003.
• 21: Yoon, J., Liu, M., and Noble, B. Random waypoint considered harmful. In IEEE INFOCOM Conference (2003).

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design

General Terms:
Algorithms, Measurement, Performance

Keywords:
802.11e, MANET, network simulators, performance comparative