Object-based collective communication in Java

ABSTRACT

CCJ is a communication library that adds MPI-like collective operations to Java. Rather than trying to adhere to the precise MPI syntax, CCJ aims at a clean integration of collective communication into Java's object-oriented framework. For example, CCJ uses thread groups to support Java's multithreading model and it allows any data structure (not just arrays) to be communicated. CCJ is implemented entirely in Java, on top of RMI, so it can be used with any Java virtual machine. The paper discusses three parallel Java applications that use collective communication. It compares the performance (on top of a Myrinet cluster) of CCJ, RMI and mpiJava versions of these applications, and also compares the code complexity of the CCJ and RMI versions. The results show that the CCJ versions are significantly simpler than the RMI versions and obtain a good performance.

REFERENCES

• 1: A. D. Alexandrov, M. Ibel, K. E. Schauser, andC. J. Scheiman. SuperWeb: Research Issues in Java-Based Global Computing. Concurrency: Practice and Experience, 9(6):535-553, June 1997.
• 2: M. Baker, B. Carpenter, G. Fox, S. H. Ko, and X. Li. A Java interface to MPI. In Proc. First UK Workshop on Java for High Performance Network Computing, Sept. 1998.
• 3: Henri E. Bal , Raoul Bhoedjang , Rutger Hofman , Ceriel Jacobs , Koen Langendoen , Tim Rühl , M. Frans Kaashoek, Performance evaluation of the Orca shared-object system, ACM Transactions on Computer Systems (TOCS), v.16 n.1, p.1-40, Feb. 1998 [doi>10.1145/273011.273014]
• 4: Raoul A. F. Bhoedjang , Tim Rühl , Henri E. Bal, User-Level Network Interface Protocols, Computer, v.31 n.11, p.53-60, November 1998 [doi>10.1109/2.730737]
• 5: Nanette J. Boden , Danny Cohen , Robert E. Felderman , Alan E. Kulawik , Charles L. Seitz , Jakov N. Seizovic , Wen-King Su, Myrinet: A Gigabit-per-Second Local Area Network, IEEE Micro, v.15 n.1, p.29-36, February 1995 [doi>10.1109/40.342015]
• 6: F. Breg, S. Diwan, J. Villacis, J. Balasubramanian, E. Akman, and D. Gannon. Java RMI Performance and Object Model Interoperability: Experiments with Java/HPC++ Distributed Components. In ACM 1998 Workshop on Java for High-Performance Network Computing, Santa Barbara, CA, Feb. 1998.
• 7: Michael O. Neary , Sean P. Brydon , Paul Kmiec , Sami Rollins , Peter Cappello, Javelin++: scalability issues in global computing, Proceedings of the ACM 1999 conference on Java Grande, p.171-180, June 12-14, 1999, San Francisco, California, United States [doi>10.1145/304065.304120]
• 8: Michael G. Burke , Jong-Deok Choi , Stephen Fink , David Grove , Michael Hind , Vivek Sarkar , Mauricio J. Serrano , V. C. Sreedhar , Harini Srinivasan , John Whaley, The Jalapeño dynamic optimizing compiler for Java, Proceedings of the ACM 1999 conference on Java Grande, p.129-141, June 12-14, 1999, San Francisco, California, United States [doi>10.1145/304065.304113]
• 9: B. Carpenter, V. Getov, G. Judd, A. Skjellum, and G. Fox. MPJ: MPI-like Message Passing for Java. Concurrency: Practice and Experience, 12(11): 1019-1038, 2000.
• 10: G. Crawford, Y. Dandass, and A. Skjellum. The jmpi commercial message passing environment and specification. http:llwww.mpisofttooh.comlpublicationsld MPI_121797.html, Dec. 1997.
• 11: Erich Gamma , Richard Helm , Ralph Johnson , John Vlissides, Design patterns: elements of reusable object-oriented software, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 12: Al Geist , Adam Beguelin , Jack Dongarra , Weicheng Jiang , Robert Manchek , Vaidy Sunderam, PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing, MIT Press, Cambridge, MA, 1995
• 13: Vladimir Getov , Paul Gray , Vaidy Sunderam, MPI and Java-MPI: contrasts and comparisons of low-level communication performance, Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM), p.21-es, November 14-19, 1999, Portland, Oregon, United States [doi>10.1145/331532.331553]
• 14: V. Getov, S. Flynn-Hummel, and S. Mintchev. High-performance Parallel Programming in Java: Exploiting Native Libraries. In ACM 1998 workshop on Java for High-performance network computing, Feb. 1998.
• 15: William Gropp , Ewing Lusk , Nathan Doss , Anthony Skjellum, A high-performance, portable implementation of the MPI message passing interface standard, Parallel Computing, v.22 n.6, p.789-828, Sept. 1996 [doi>10.1016/0167-8191(96)00024-5]
• 16: Geoffrey Fox , Tomasz Haupt , Erol Akarsu , Alexey Kalinichenko , Kang-Seok Kim , Praveen Sheethalnath , Choon-Han Youn, The gateway system: uniform Web based access to remote resources, Proceedings of the ACM 1999 conference on Java Grande, p.1-7, June 12-14, 1999, San Francisco, California, United States [doi>10.1145/304065.304085]
• 17: G. Judd, M. Clement, and Q. Snell. DOGMA: Distributed Object Group Metacomputing Architecture. Concurrency: Practice and Experience, 10:977-983, 1998.
• 18: Thilo Kielmann , Rutger F. H. Hofman , Henri E. Bal , Aske Plaat , Raoul A. F. Bhoedjang, MagPIe: MPI's collective communication operations for clustered wide area systems, Proceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming, p.131-140, May 04-06, 1999, Atlanta, Georgia, United States
• 19: T. Ktihne. The function object pattern. C++ Report, 9(9):32--42, Oct. 1997.
• 20: Jason Maassen , Thilo Kielmann , Henri E. Bal, Efficient replicated method invocation in Java, Proceedings of the ACM 2000 conference on Java Grande, p.88-96, June 03-04, 2000, San Francisco, California, United States [doi>10.1145/337449.337486]
• 21: Jason Maassen , Rob van Nieuwpoort , Ronald Veldema , Henri E. Bal , Aske Plaat, An efficient implementation of Java's remote method invocation, Proceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming, p.173-182, May 04-06, 1999, Atlanta, Georgia, United States
• 22: Message Passing Interface Forum. MPI: A Message Passing Interface Standard. International Journal of Supercomputing Applications, 8(3/4), 1994.
• 23: Sava Mintchev , Vladimir Getov, Towards Portable Message Passing in Java: Binding MPI, Proceedings of the 4th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, p.135-142, November 03-05, 1997
• 24: Template Based Structured Collections, Proceedings of the 14th International Symposium on Parallel and Distributed Processing, p.483, May 01-05, 2000
• 25: M. Philippsen, B. Haumacher, and C. Nester. More efficient serialization and RMI for Java. Concurrency: Practice and Experience, 12(7):495-518, 2000.
• 26: G. K. Thiruvathukal, P. M. Dickens, and S. Bhatti. Java on networks of workstations (JavaNOW): a parallel computing framework inspired by Linda and the Message Passing Interface (MPI). Concunrrency: Practice and Experience, 12:1093-1116, 2000.
• 27: R. van Nieuwpoort, J. Maassen, H. E. Bal, T. Kielmann, and R. Veldema. Wide-Area Parallel Programming using the Remote Method Invocation Model. Concurrency: Practice and Experience, 12(8):643-666, 2000.

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications

          Nouns: Java

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.1 Requirements/Specifications
          Subjects: Methodologies (e.g., object-oriented, structured)
  D.3 PROGRAMMING LANGUAGES
      D.3.3 Language Constructs and Features
          Subjects: Classes and objects
      D.3.4 Processors
          Subjects: Interpreters

General Terms:
Design, Experimentation, Performance