Simulation validation using direct execution of wireless Ad-Hoc routing protocols

ABSTRACT

Computer simulation is the most common approach to studying wireless ad-hoc routing algorithms. The results, however, are only as good as the models the simulation uses. One should not underestimate the importance of validation, as inaccurate models can lead to wrong conclusions. In this paper, we use direct-execution simulation to validate radio models used by ad-hoc routing protocols, against real-world experiments. This paper documents a common testbed that supports direct execution of a set of ad-hoc routing protocol implementations in a wireless network simulator. The testbed reads traces generated from real experiments, and uses them to drive direct-execution implementations of the routing protocols. Doing so we reproduce the same network conditions as in real experiments. By comparing routing behavior measured in real experiments with behavior computed by the simulation, we are able to validate the models of radio behavior upon which protocol behavior depends. We conclude that it is possible to have fairly accurate results using a simple radio model, but the routing behavior is quite sensitive to one of this model's parameters. The implication is that one should i) use a more complex radio model that explicitly models point-to-point path loss, or ii) use measurements from an environment typical of the one of interest, or iii) study behavior over a range of environments to identify sensitivities.

REFERENCES

• 1: X.A. Dimitropoulos and G. F. Riley. Creating realistic BGP models. MASCOTS'03, October 2003.
• 2: P. Gupta and P. R. Kumar. A system and traffic dependent adaptive routing algorithm for ad hoc networks. 36th IEEE Conference on Decision and Control, pages 2375-2380, December 1997.
• 3: J. Heidemann, N. Bulusu, J. Elson, C. Intanagonwiwat, K. Lan, Y. Xu, W. Ye, D. Estrin, and R. Govindan. Effects of details in wireless network simulation. SCS Multiconference on Distributed Simulation, pages 3-11, January 2001.
• 4: D. B. Johnson. Validation of wireless and mobile network models and simulation. DARPA/NIST Network Simulation Validation Workshop, May 1999.
• 5: B. Karp and H. T. Kung. Dynamic neighbor discovery and loopfree, multi-hop routing for wireless, mobile networks. Hardvard University, May 1998.
• 6: Brad Karp , H. T. Kung, GPSR: greedy perimeter stateless routing for wireless networks, Proceedings of the 6th annual international conference on Mobile computing and networking, p.243-254, August 06-11, 2000, Boston, Massachusetts, United States [doi>10.1145/345910.345953]
• 7: Sung Ju Lee , William Su , Mario Gerla, On-demand multicast routing protocol in multihop wireless mobile networks, Mobile Networks and Applications, v.7 n.6, p.441-453, December 2002 [doi>10.1023/A:1020756600187]
• 8: J. Liu, L. F. Perrone, D. M. Nicol, M. Liljenstam, C. Elliott, and D. Pearson. Simulation modeling of large-scale adhoc sensor networks. European Simulation Interoperability Workshop (Euro-SIW'01), June 2001.
• 9: Michael Neufeld , Ashish Jain , Dirk Grunwald, Nsclick:: bridging network simulation and deployment, Proceedings of the 5th ACM international workshop on Modeling analysis and simulation of wireless and mobile systems, September 28-28, 2002, Atlanta, Georgia, USA [doi>10.1145/570758.570772]
• 10: Charles E. Perkins , Elizabeth M. Royer, Ad-hoc On-Demand Distance Vector Routing, Proceedings of the Second IEEE Workshop on Mobile Computer Systems and Applications, p.90, February 25-26, 1999
• 11: Theodore S. Rappaport, Wireless Communications: Principles and Practice, IEEE Press, Piscataway, NJ, 1996
• 12: Mineo Takai , Rajive Bagrodia , Ken Tang , Mario Gerla, Efficient wireless network simulations with detailed propagation models, Wireless Networks, v.7 n.3, p.297-305, 05/01/2001 [doi>10.1023/A:1016682323833]
• 13: Mineo Takai , Jay Martin , Rajive Bagrodia, Effects of wireless physical layer modeling in mobile ad hoc networks, Proceedings of the 2nd ACM international symposium on Mobile ad hoc networking & computing, October 04-05, 2001, Long Beach, CA, USA [doi>10.1145/501426.501429]