Trace-driven co-simulation of high-performance computing systems using OMNeT++

ABSTRACT

In the context of developing next-generation high-performance computing systems, there is often a need for an "end-to-end" simulation tool that can simulate the behaviour of a full application on a reasonably faithful model of the actual system. Considering the ever-increasing levels of parallelism, we take a communication-centric view of the system based on collecting application traces at the message-passing interface level. We present an integrated toolchain that enables the evaluation of the impact of all interconnection network aspects on the performance of parallel applications. The network simulator, based on OMNeT++, provides a socket-based co-simulation interface to the MPI task simulator, which replays traces obtained using an instrumentation package. Both simulators generate output that can be evaluated with a visualization tool. A set of additional tools is provided to translate generic topology files to OMNeT's ned format, import route files at run time, perform routing optimizations, and generate particular topologies. We also present several examples of results obtained that provide insights that would not have been possible without this integrated environment.

REFERENCES

• 1: J. L. Peterson , P. J. Bohrer , L. Chen , E. N. Elnozahy , A. Gheith , R. H. Jewell , M. D. Kistler , T. R. Maeurer , S. A. Malone , D. B. Murrell , N. Needel , K. Rajamani , M. A. Rinaldi , R. O. Simpson , K. Sudeep , L. Zhang, Application of full-system simulation in exploratory system design and development, IBM Journal of Research and Development, v.50 n.2/3, p.321-332, March 2006 [doi>10.1147/rd.502.0321]
• 2: Peter S. Magnusson , Magnus Christensson , Jesper Eskilson , Daniel Forsgren , Gustav Hållberg , Johan Högberg , Fredrik Larsson , Andreas Moestedt , Bengt Werner, Simics: A Full System Simulation Platform, Computer, v.35 n.2, p.50-58, February 2002 [doi>10.1109/2.982916]
• 3: Wolfgang E. Denzel , Jian Li , Peter Walker , Yuho Jin, A framework for end-to-end simulation of high-performance computing systems, Proceedings of the 1st international conference on Simulation tools and techniques for communications, networks and systems & workshops, March 03-07, 2008, Marseille, France
• 4: Varga, A. The OMNeT++ discrete event simulation system. In Proceedings of the European Simulation Multiconference (ESM' 01), Prague, Czech Republic, June 2001.
• 5: Nanette J. Boden , Danny Cohen , Robert E. Felderman , Alan E. Kulawik , Charles L. Seitz , Jakov N. Seizovic , Wen-King Su, Myrinet: A Gigabit-per-Second Local Area Network, IEEE Micro, v.15 n.1, p.29-36, February 1995 [doi>10.1109/40.342015]
• 6: Fabrizio Petrini , Marco Vanneschi, k -ary n -trees: High Performance Networks for Massively Parallel Architectures, Proceedings of the 11th International Symposium on Parallel Processing, p.87, April 01-05, 1997
• 7: Desai, N., Balaji, P., Sadayappan, P., Islam, M. Are nonblocking networks really needed for high-end-computing workloads? In Proceedings of the 2008 IEEE International Conference on Cluster Computing (Cluster '08), Tsukuba, Japan, Sep. 29--Oct. 1, 2008, pp. 152--159.
• 8: Sabine R. Öhring , Maximilian Ibel , Sajal K. Das , Mohan J. Kumar, On generalized fat trees, Proceedings of the 9th International Symposium on Parallel Processing, p.37, April 25-28, 1995
• 9: Patrick Geoffray , Torsten Hoefler, Adaptive Routing Strategies for Modern High Performance Networks, Proceedings of the 2008 16th IEEE Symposium on High Performance Interconnects, p.165-172, August 26-28, 2008 [doi>10.1109/HOTI.2008.21]
• 10: Rajive L. Bagrodia , Mineo Takai, Performance Evaluation of Conservative Algorithms in Parallel Simulation Languages, IEEE Transactions on Parallel and Distributed Systems, v.11 n.4, p.395-411, April 2000 [doi>10.1109/71.850835]
• 11: Varga, A., Sekercioglu, Y. A., Egan, G. K. A practical efficiency criterion for the null message algorithm. In Proceedings of the European Simulation Symposium (ESS 2003), Oct. 26--29, 2003, Delft, The Netherlands.

INDEX TERMS

Keywords:
PDES, high-performance computing, interconnection network