Using statistical design of experiments for analyzing mobile ad hoc networks

ABSTRACT

The performance of mobile ad hoc networks can be influenced by numerous factors, including protocol design at every layer; parameter settings such as retransmission limits and timers; system factors such as network size and traffic load; as well as environmental factors such as channel fading. In this work, we are concerned with understanding the functional relationship between these influential factors and performance of mobile ad hoc networking systems. We show how a systematic statistical design of experiments (DOE) strategy can be used to analyze network system and protocol performance, leading to more objective conclusions valid over a wide range of network conditions and environments. Using a DOE strategy and a 2^k factorial design, we quantify the main and interactive effects of five factors (i.e., network density, node mobility, traffic load, network size, and medium access control scheme) on two response metrics (i.e., packet delivery ratio and end-to-end delay). Using these effects measures, we then develop two first-order linear regression models that define the functional relationship between the influential factors and two performance metrics.

REFERENCES

• 1: Chris Barrett , Achla Marathe , Madhav V. Marathe , Martin Drozda, Characterizing the interaction between routing and MAC protocols in ad-hoc networks, Proceedings of the 3rd ACM international symposium on Mobile ad hoc networking & computing, June 09-11, 2002, Lausanne, Switzerland [doi>10.1145/513800.513812]
• 2: C. L. Barrett, M. Drozda, A. Marathe, and M. V. Marathe. Analyzing interaction between network protocols, topology and traffic in wireless radio networks. In Proceedings of the IEEE Wireless Communications and Networking Conference, 2003.
• 3: G. E. P. Box, W. G. Hunter, and J. S. Hunter. Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building. John Wiley and Sons, Inc., New York, NY, 1978.
• 4: M. Conti, G. Maselli, G. Turi, and S. Giordana. Cross-layering in mobile ad hoc network design. IEEE Computer, 37(2):48--51, February 2004.
• 5: S. Corson and J. Macker. Mobile Ad hoc Networking (MANET): Routing Protocol Performance Issues and Evaluation Considerations. Internet-Draft, Oct. 1998.
• 6: A. Ephremides. Energy concerns in wireless networks. IEEE Wireless Communications, August 2002.
• 7: Z. J. Haas. Panel report on ad-hoc networks. Mobile Computing and Communications Review, 2(1), 1997.
• 8: Gavin Holland , Nitin Vaidya, Analysis of TCP performance over mobile ad hoc networks, Proceedings of the 5th annual ACM/IEEE international conference on Mobile computing and networking, p.219-230, August 15-19, 1999, Seattle, Washington, United States [doi>10.1145/313451.313540]
• 9: R. Jain. The Art of Computer System Performance and Analysis. John Wiley and Sons, New York, 1991.
• 10: J. P. C. Kleijnen. A user's guide to the brave new world of designing simulation experiments. White paper, Tilburg University, CentER, March 2004.
• 11: S. Kumar, V. S. Raghavan, and J. Deng. Medium access control protocols for ad hoc wireless networks: A survey. Elsevier Ad-Hoc Networks Journal, 2004.
• 12: Averill M. Law , David M. Kelton, Simulation Modeling and Analysis, McGraw-Hill Higher Education, 1999
• 13: J. Lee, S. Singh, and Y. Roh. Interlayer interactions and performance in wireless ad hoc network. Internet-draft, IRTF ANS Working Group, September 2003.
• 14: D. C. Montgomery. Design and Analysis of Experiments. John Wiley and Sons, New York, 2001.
• 15: E. M. Royer, P. M. Melliar-Smith, and L. E. Moser. An analysis of the optimum node density for ad hoc mobile networks. In Proceedings of the IEEE International Communications Conference, pages 857--861, Helsinki, Finland, June 2001.
• 16: M. W. Subbarao. Ad hoc networking critical features and performance metrics. White paper, National Institutes of Standards and Technology, September 1999.
• 17: H. Takagi and L. Kleinrock. Optimal transmission ranges for randomly distributed packet radio terminals. IEEE Transactions on Communications, 32(3), Mar. 1984.
• 18: K. K. Vadde and V. R. Syrotiuk. Factor interaction on service delivery in mobile ad hoc networks. IEEE Journal on Selected Areas in Communications, 22(7):1335--1346, September 2004.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Modeling techniques

Additional Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Performance attributes

  G. Mathematics of Computing
  G.3 PROBABILITY AND STATISTICS
      Subjects: Correlation and regression analysis; Experimental design

  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.6 Simulation Output Analysis

General Terms:
Experimentation, Performance

Keywords:
mobile ad hoc networks, performance evaluation, statistical design of experiments