Distributed component support for integrating large-scale parallel HPC applications

ABSTRACT

Component-based software engineering (CBSE) is now a widely accepted paradigm for developing large-scale commercial software. The Common Component Architecture (CCA) and its associated Babel toolsuite is designed to enable CBSE for High Performance Computing (HPC) scientific applications. Many scientific applications have adopted the CBSE paradigm and demonstrated its effectiveness using CCA.

Properly designed, integrating multiple distributed HPC applications into a large-scale system allows the overall system to take advantage of scattered resources and to provide alternative strategies in enhancing system's overall parallelism and performance. There exists several ongoing projects to add support for connecting multiple parallel applications using various distributed technologies, including the Babel Remote Method Invocation.

In this paper, we review two different approaches to enable interconnection between conventional CCA HPC applications. Specifically, we extend our previous work on distributed proxy components and develop a new Babel RMI library that supports Common Object Request Broker Architecture's (CORBA) Internet Inter-ORB Protocol (IIOP) transport mechanism. Finally, we provide both qualitative and quantitative comparisons among various approaches and transport mechanisms.

REFERENCES

• 1: http://www.extreme.indiana.edu/xcat/.
• 2: http://www.sci.utah.edu/.
• 3: Java beans. http://java.sun.com/products/javabeans/.
• 4: B. Allan, R. Armstrong, S. Lefantzi, J. Ray, E. Walsh, and P. Wolfe. Ccaffeine -- a CCA component framework for parallel computing. http://www.cca-forum.org/ccafe/.
• 5: Rob Armstrong , Dennis Gannon , Al Geist , Katarzyna Keahey , Scott Kohn , Lois McInnes , Steve Parker , Brent Smolinski, Toward a Common Component Architecture for High-Performance Scientific Computing, Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing, p.13, August 03-06, 1999
• 6: Alexander B. Arulanthu , Carlos O'Ryan , Douglas C. Schmidt , Michael Kircher , Jeff Parsons, The design and performance of a scable ORB architecture for COBRA asynchronous messaging, IFIP/ACM International Conference on Distributed systems platforms, p.208-230, April 03-07, 2000, New York, New York, United States
• 7: D. E. Bernholdt, B. A. Allan, R. Armstrong, F. Bertrand, K. Chiu, T. L. Dahlgren, K. Damevski,W. R. Elwasif, T. G.W. Epperly, M. Govindaraju, D. S. Katz, J. A. Kohl, M. Krishnan, G. Kumfert, J. W. Larson, S. Lefantzi, M. J. Lewis, A. D. Malony, L. C. McInnes, J. Nieplocha, B. Norris, S. G. Parker, J. Ray, S. Shende, T. L. Windus, and S. Zhou. A component architecture for high-performance scientific computing. Intl. J. High-Perf. Computing Appl., 2005. Submitted to ACTS Collection special issue.
• 8: T. Dahlgren, T. Epperly, G. Kumfert, and J. Leek. Babel User's Guide. CASC, Lawrence Livermore National Laboratory, Livermore, CA, babel-1.1.0 edition, 2007.
• 9: Douglas C. Schmidt. Successful Project Deployments of ACE and TAO. www.cs.wustl.edu/~schmidt/TAO-users.html, Washington University.
• 10: Carlton Egremont, Mr. Bunny's Guide to ActiveX, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1998
• 11: George T. Heineman , William T. Councill, Component-based software engineering: putting the pieces together, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2001
• 12: Michi Henning , Steve Vinoski, Advanced CORBA programming with C++, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 13: Institute for Software Integrated Systems. The ACE ORB (TAO). www.dre.vanderbilt.edu/TAO/, Vanderbilt University.
• 14: D. Jefferson. Relationship between Co-op and MPI-2. Technical Report UCRL-TR-225783, Lawrence Livermore National Laboratory, 2006.
• 15: John May. Cooperative Parallelism. http://www.llnl.gov/CASC/coopParallelism/, Nov. 2006.
• 16: G. Kumfert, J. Leek, and T. Epperly. Babel Remote Method Invocation. In Proceedings of IEEE International Parallel and Distributed Processing Symposium (IPDPS 2007), Long Beach, CA, Mar. 2007.
• 17: A. C. L. (LANL). Chasm -- language interoperability tools. http://chasm-interop.sourceforge.net/.
• 18: Manojkumar Krishnan , Yuri Alexeev , Theresa L. Windus , Jarek Nieplocha, Multilevel Parallelism in Computational Chemistry using Common Component Architecture and Global Arrays, Proceedings of the 2005 ACM/IEEE conference on Supercomputing, p.23, November 12-18, 2005 [doi>10.1109/SC.2005.46]
• 19: Microsoft Corporation. Distributed Component Object Model Protocol (DCOM), 1.0 edition, Jan. 1998.
• 20: Nanbor Wang , Rooparani Pundaleeka , Johan Carlsson, Distributed component support for integrating large-scale parallel HPC applications, Proceedings of the 2007 symposium on Component and framework technology in high-performance and scientific computing, October 21-22, 2007, Montreal, Quebec, Canada [doi>10.1145/1297385.1297408]
• 21: Object Management Group. CORBA Components, OMG Document formal/2002-06-65 edition, June 2002.
• 22: Object Management Group. Data Parallel CORBA Specification, formal/06-01-03 edition, Jan. 2006.
• 23: Irfan Pyarali , Carlos O'Ryan , Douglas Schmidt , Nanbor Wang , Aniruddha S. Gokhale , Vishal Kachroo, Using Principle Patterns to Optimize Real-Time ORBs, IEEE Concurrency, v.8 n.1, p.16-25, January 2000 [doi>10.1109/4434.824309]
• 24: Rainer Schmidt and Michael R. Head and Madhusudhan Govindaraju and Michael J. Lewis and Siegfried Benkner. Design and implementation choices for implementing distributed cca frameworks,. In Proceedings of GECO-COMPFRAME06: Workshop on HPC Grid programming Environments and Components and Component and Framework Technology in High-Performance and Scientific Computing (collocated with HPDC-15), pages 3--10, Paris, France, 2006.
• 25: D. C. Schmidt and S. Vinoski. C++ Servant Managers for the Portable Object Adapter. C++ Report, 10(8), Sept. 1998.
• 26: D. C. Schmidt and S. Vinoski. Dynamic CORBA, Part 1: The Dynamic Invocation Interface. C/C++ Users Journal, July 2002.
• 27: D. C. Schmidt and S. Vinoski. Dynamic CORBA, Part 2: Dynamic Any. C/C++ Users Journal, Sept. 2002.
• 28: D. C. Schmidt and S. Vinoski. Dynamic CORBA, Part 3: The Dynamic Skeleton Interface. C/C++ Users Journal, Oct. 2002.
• 29: Sébastien Lacour and Christian Pérez. Automatic deployment of MPI applications on a computational grid. In Proceedings of Computational Science and Engineering of the Society for Industrial and Applied Mathematics (SIAM-CSE2005), Orlando, FL, Feb. 2005.
• 30: Grid Service for Visualization and Analysis of Remote Fusion Data, Proceedings of the 2nd International Workshop on Challenges of Large Applications in Distributed Environments, p.34, June 07-07, 2004
• 31: Sun Microsystems. Enterprise JavaBeans Specification. java.sun.com/products/ejb/docs.html, Aug. 2001.
• 32: Clemens Szyperski, Component software: beyond object-oriented programming, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1998
• 33: N. Wang, D. C. Schmidt, A. Gokhale, C. Rodrigues, B. Natarajan, J. P. Loyall, R. E. Schantz, and C. D. Gill. QoS-enabled Middleware. In Q. Mahmoud, editor, Middleware for Communications. Wiley and Sons, New York, 2004.
• 34: K. Zhang, K. Damevski, V. Venkatachalaphathy, and S. G. Parker". Scirun2: A cca framework for high performance computing. In Proceedings of the Ninth International Workshop on High-Level Parallel Programming Models and Supportive Environments (HIPS'04), Santa Fe, NM, Apr 2004.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.13 Reusable Software
            Subjects: Reuse models

General Terms:
Design, Performance

Keywords:
CBSE, CCA, HPC, framework, parallel and distributed computing