Model complexity vs. better parameter value estimation: comparing four topography-independent radio models

ABSTRACT

In this case study we show how four topography-independent radio models (models not regarding individual obstacles in the operations area) can be "tuned" such that the outcomes of an event-driven network simulator come as close as possible to reference data obtained in a real-world radio network experiment. An evolutionary optimization process was applied to find near optimal parameter values four these models. We describe the optimization process, the error function that guides it and discuss the results.

REFERENCES

• 1: INET framework with ad-hoc routing protocols, available at http://webpersonal.uma.es/~AARIZAQ/.
• 2: The official guide to learning OpenGL, available at http://www.glprogramming.com/red/.
• 3: Todd R. Andel , Alec Yasinac, On the Credibility of Manet Simulations, Computer, v.39 n.7, p.48-54, July 2006 [doi>10.1109/MC.2006.242]
• 4: David Cavin , Yoav Sasson , André Schiper, On the accuracy of MANET simulators, Proceedings of the second ACM international workshop on Principles of mobile computing, October 30-31, 2002, Toulouse, France [doi>10.1145/584490.584499]
• 5: Nikolaus Hansen , Sibylle D. Müller , Petros Koumoutsakos, Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES), Evolutionary Computation, v.11 n.1, p.1-18, Spring 2003 [doi>10.1162/106365603321828970]
• 6: J. Koberstein and N. Luttenberger. Data-centric wireless sensor network programming methodology. In 3rd International Conference on Networked Sensing Systems (INSS), 2006.
• 7: Jochen Koberstein , Hagen Peters , Norbert Luttenberger, Graph-based mobility model for urban areas fueled with real world datasets, Proceedings of the 1st international conference on Simulation tools and techniques for communications, networks and systems & workshops, March 03-07, 2008, Marseille, France
• 8: J. Koberstein, S. Witt, J. Boetel, and N. Luttenberger. Multipurpose application of evolutionary algorithms for wsn parameterization---a case study. In submitted to International Conference Information Processing in Sensor Networks (IPSN), San Francisco, USA, April 2009. ACM/IEEE.
• 9: Jason Liu , Yougu Yuan , David M. Nicol , Robert S. Gray , Calvin C. Newport , David Kotz , Luiz Felipe Perrone, Simulation validation using direct execution of wireless Ad-Hoc routing protocols, Proceedings of the eighteenth workshop on Parallel and distributed simulation, May 16-19, 2004, Kufstein, Austria [doi>10.1145/1013329.1013333]
• 10: Robert Nagel , Stephan Eichler, Efficient and realistic mobility and channel modeling for VANET scenarios using OMNeT++ and INET-framework, Proceedings of the 1st international conference on Simulation tools and techniques for communications, networks and systems & workshops, March 03-07, 2008, Marseille, France
• 11: Calvin Newport , David Kotz , Yougu Yuan , Robert S. Gray , Jason Liu , Chip Elliott, Experimental Evaluation of Wireless Simulation Assumptions, Simulation, v.83 n.9, p.643-661, September 2007 [doi>10.1177/0037549707085632]
• 12: OpenWrt. available at http://www.openwrt.org.
• 13: Theodore S. Rappaport, Wireless Communications: Principles and Practice, IEEE Press, Piscataway, NJ, 1996
• 14: M. Segal and K. Akeley. The OpenGL Graphics System: A Specification. December 2006.
• 15: Mineo Takai , Jay Martin , Rajive Bagrodia, Effects of wireless physical layer modeling in mobile ad hoc networks, Proceedings of the 2nd ACM international symposium on Mobile ad hoc networking & computing, October 04-05, 2001, Long Beach, CA, USA [doi>10.1145/501426.501429]
• 16: A. Varga. The OMNeT++ discrete event simulation system. In Proceedings of the European Simulation Multiconference (ESM), 2001.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.4 Model Validation and Analysis

Keywords:
calibration, comparison, optimization, radio model, real world, simulation model validation