Pluggable parallelisation

ABSTRACT

This paper presents the concept of pluggable parallelisation that allows scientists to develop sequential like codes that can take advantage of multi-core, cluster and grid systems. In this approach parallel applications are developed by plugging parallelisation patterns/idioms into scientific codes (e.g., sequential like codes), softening the move from sequential to parallel programming and promoting the separation between domain specific code and parallelisation issues. Pluggable parallelisation combines three characteristics: 1) parallelisation is performed from outside to inside, localising parallelisation concerns into well defined modules, reducing changes required to the domain specific code and avoiding invasive parallelisation of base code; 2) control view is separated from data view promoting a stronger separation of concerns which improves reuse of parallelisation concerns across platforms and enables fine-grained refinements; and 3) abstractions can be composed, supporting the development of more complex patterns based on fine-grained features. This paper presents the concept of pluggable parallelisation and shows how some well known parallelisation strategies can be implemented in this approach. Results show that this is a feasible approach and performance is competitive with traditional parallel programming.

REFERENCES

• 1: L. Baduel , F. Baude , D. Caromel, Object-oriented SPMD, Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2, p.824-831, May 09-12, 2005
• 2: Bornemann, M., Nieuwpoort, M., Kielmann T., MPJ/Ibis: a Flexible and Efficient Message Passing Platform for Java, EuroPVM/MPI 2005, Sorrento, Italy, September 2005.
• 3: Denis Caromel, Toward a method of object-oriented concurrent programming, Communications of the ACM, v.36 n.9, p.90-102, Sept. 1993 [doi>10.1145/162685.162711]
• 4: Carlos A. Cunha , João L. Sobral , Miguel P. Monteiro, Reusable aspect-oriented implementations of concurrency patterns and mechanisms, Proceedings of the 5th international conference on Aspect-oriented software development, March 20-24, 2006, Bonn, Germany [doi>10.1145/1119655.1119674]
• 5: M. Aldinucci , M. Danelutto , P. Teti, An advanced environment supporting structured parallel programming in Java, Future Generation Computer Systems, v.19 n.5, p.611-626, July 2003 [doi>10.1016/S0167-739X(02)00172-3]
• 6: J. F. Ferreira , J. L. Sobral , A. J. Proenca, JaSkel: A Java Skeleton-Based Framework for Structured Cluster and Grid Computing*, Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, p.301-304, May 16-19, 2006 [doi>10.1109/CCGRID.2006.65]
• 7: Jan Hannemann , Gregor Kiczales, Design pattern implementation in Java and aspectJ, Proceedings of the 17th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, November 04-08, 2002, Seattle, Washington, USA
• 8: Bruno Harbulot , John R. Gurd, Using AspectJ to separate concerns in parallel scientific Java code, Proceedings of the 3rd international conference on Aspect-oriented software development, p.122-131, March 22-24, 2004, Lancaster, UK [doi>10.1145/976270.976286]
• 9: Bruno Harbulot , John R. Gurd, A join point for loops in AspectJ, Proceedings of the 5th international conference on Aspect-oriented software development, March 20-24, 2006, Bonn, Germany [doi>10.1145/1119655.1119666]
• 10: Kiczales, G., Lamping, J., Mendhekar, A., Maeda, C., Lopes, C., Loingtier, J., Irwin, J., Aspect-Oriented Programming. ECOOP'97, LNCS, Jyväskylä, Finland, June 1997
• 11: Gregor Kiczales , Erik Hilsdale , Jim Hugunin , Mik Kersten , Jeffrey Palm , William G. Griswold, An Overview of AspectJ, Proceedings of the 15th European Conference on Object-Oriented Programming, p.327-353, June 18-22, 2001
• 12: Doug Lea, A Java fork/join framework, Proceedings of the ACM 2000 conference on Java Grande, p.36-43, June 03-04, 2000, San Francisco, California, United States [doi>10.1145/337449.337465]
• 13: Marcio E. F. Maia , Paulo H. M. Maia , Nabor C. Mendonca , Rossana M. C. Andrade, An Aspect-Oriented Programming Model for Bag-of-Tasks Grid Applications, Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, p.789-794, May 14-17, 2007 [doi>10.1109/CCGRID.2007.19]
• 14: Rob van Nieuwpoort , Thilo Kielmann , Henri E. Bal, Satin: Efficient Parallel Divide-and-Conquer in Java, Proceedings from the 6th International Euro-Par Conference on Parallel Processing, p.690-699, August 29-September 01, 2000
• 15: L. A. Smith , J. M. Bull , J. Obdrzálek, A parallel java grande benchmark suite, Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM), p.8-8, November 10-16, 2001, Denver, Colorado [doi>10.1145/582034.582042]
• 16: Sobral, J., Incrementally Developing Parallel Applications with AspectJ, IEEE IPDPS'06, Rhodes, Greece, April 2006
• 17: Sobral, J., Cunha, C., Monteiro, M., Aspect-Oriented Pluggable Support for Parallel Computing, VecPar'06, LNCS, Rio de Janeiro, Brasil, June 2006
• 18: João L. Sobral , Miguel P. Monteiro, A domain-specific language for parallel and grid computing, Proceedings of the 2008 AOSD workshop on Domain-specific aspect languages, p.1-4, April 01-01, 2008, Brussels, Belgium [doi>10.1145/1404927.1404929]

INDEX TERMS

Primary Classification:
  D. Software
  D.1 PROGRAMMING TECHNIQUES
      D.1.3 Concurrent Programming
          Subjects: Parallel programming

Additional Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.3 Language Constructs and Features
          Subjects: Concurrent programming structures

General Terms:
Design, Languages, Performance

Keywords:
non-invasive parallelisation, parallel programming, separation of concerns