Optimisation of component-based applications within a grid environment

ABSTRACT

Effective exploitation of computational grids can only be achieved when applications are fully integrated with the grid middleware and the underlying computational resources. Fundamental to this exploitation is information. Information about the structure and behaviour of the application, the capability of the computational and networking resources, and the availability and access to these resources by an individual, a group or an organisation.This paper describes an integrated grid environment that is open, extensible and platform independent. We match a high-level application specification, defined as a network of components, to an optimal combination of the currently available component implementations within our grid environment. We demonstrate the effectiveness of this architecture through high-level specification and solution of a set of linear equations by automatic and optimal resource and implementation selection.

REFERENCES

• 1: Ian Foster , Carl Kesselman, The grid: blueprint for a new computing infrastructure, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 2: Bonnie A. Nardi, A small matter of programming: perspectives on end user computing, MIT Press, Cambridge, MA, 1993
• 3: John Darlington , A. J. Field , Peter G. Harrison , Paul H. J. Kelly , D. W. N. Sharp , Q. Wu, Parallel Programming Using Skeleton Functions, Proceedings of the 5th International PARLE Conference on Parallel Architectures and Languages Europe, p.146-160, June 14-17, 1993
• 4: J. Darlington, M. Ghanem, Y. Guo, and H. W. To. Guided Resource Organisation in Heterogeneous Parallel Computing. Journal of High Performance Computing, 4(10):13-23, 1997.
• 5: Peter Au , John Darlington , Moustafa Ghanem , Yike Guo , Hing Wing To , Jin Yang, Co-ordinating Heterogeneous Parallel Computation, Proceedings of the Second International Euro-Par Conference on Parallel Processing, p.601-614, August 26-29, 1996
• 6: Samuel Z. Guyer , Calvin Lin, Optimizing the Use of High Performance Software Libraries, Proceedings of the 13th International Workshop on Languages and Compilers for Parallel Computing-Revised Papers, p.227-243, August 10-12, 2000
• 7: JavaSoft. JavaBeans. http://java.sun.com/beans, October 1996.
• 8: Object Management Group. The common object request broker: Architecture and specification. formal document 97-02-25, July 1995. http://www.omg.org.
• 9: David Chappell, Understanding ActiveX and OLE: a guide for developers and managers, Microsoft Press, Redmond, WA, 1996
• 10: The linear system analyzer. http://www.extreme.indiana.edu/pseware/LSA/LSAhome.html.
• 11: Rob Armstrong , Dennis Gannon , Al Geist , Katarzyna Keahey , Scott Kohn , Lois McInnes , Steve Parker , Brent Smolinski, Toward a Common Component Architecture for High-Performance Scientific Computing, Proceedings of the The Eighth IEEE International Symposium on High Performance Distributed Computing, p.13, August 03-06, 1999
• 12: Katarzyna Keahey , Peter Beckman , James Ahrens, Ligature: Component Architecture for High Performance Applications, International Journal of High Performance Computing Applications, v.14 n.4, p.347-356, November 2000 [doi>10.1177/109434200001400406]
• 13: Andrew S. Grimshaw , Wm. A. Wulf , CORPORATE The Legion Team, The Legion vision of a worldwide virtual computer, Communications of the ACM, v.40 n.1, p.39-45, Jan. 1997 [doi>10.1145/242857.242867]
• 14: Steven Newhouse , John Darlington, Computational Communities: A Marketplace for Federated Resources, Proceedings of the 9th International Conference on High-Performance Computing and Networking, p.667-674, June 25-27, 2001
• 15: Nathalie Furmento , Steven Newhouse , John Darlington, Building Computational Communities from Federated Resources, Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing, p.855-863, August 28-31, 2001
• 16: W3 Consortium. XML: eXtensible Markup Language. http://www.w3c.org/XML.
• 17: Nathalie Furmento , Anthony Mayer , Stephen McGough , Steven Newhouse , John Darlington, A Component Framework for HPC Applications, Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing, p.540-548, August 28-31, 2001
• 18: Nathalie Furmento , Anthony Mayer , Stephen McGough , Steven Newhouse , Tony Field , John Darlington, An Integrated Grid Environment for Component Applications, Proceedings of the Second International Workshop on Grid Computing, p.26-37, November 12, 2001
• 19: Clemens Szyperski, Component software: beyond object-oriented programming, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1998
• 20: F. Berman and B. Wolski. The AppLeS project: A status report. In Proc. NEC Symp. On Metacomputing, 1997.
• 21: Holly Dail , Graziano Obertelli , Francine Berman , Rich Wolski , Andrew Grimshaw, Application-Aware Scheduling of a Magnetohydrodynamics Application in the Legion Metasystem, Proceedings of the 9th Heterogeneous Computing Workshop, p.216, May 01-01, 2000
• 22: N. Furmento, A. Mayer, S. McGough, S. Newhouse, and J. Darlington. Performance Models for Linear Solvers within a Component Framework. Technical report, ICPC, 2001.
• 23: R. Wolski. Dynamically forecasting network performance to support dynamic scheduling using the network weather service, 1997.
• 24: F. Berman, A. Chien, K. Cooper, J. Dongarra, I. Foster, L. Gannon, K. Kennedy, C. Kesselman, D. Reed, L. Torczon, and R. Wolski. The GrADS Project: Software support for high-level grid application development, 2000.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.1 Large and Medium ("Mainframe") Computers
          Subjects: Super (very large) computers

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Distributed networks
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Performance attributes

General Terms:
Algorithms, Design, Performance