The implementation of dynamite: an environment for migrating PVM tasks

ABSTRACT

Parallel programming on clusters of workstations is increasingly attractive, but dynamic load balancing is needed to make efficient use of the available resources. Dynamite provides dynamic load balancing for PVM applications running under Linux and Solaris. It supports migration of individual tasks between nodes in a manner transparent both to the application programmer and to the user, implemented entirely in user space. Dynamically linked executables are supported, as are tasks with open files and with direct PVM connections. In this paper, we describe the technical aspects of migrating message-passing tasks.

REFERENCES

• 1: Al Geist , Adam Beguelin , Jack Dongarra , Weicheng Jiang , Robert Manchek , Vaidy Sunderam, PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing, MIT Press, Cambridge, MA, 1995
• 2: MPI: A Message-Passing Interface Standard, Version 1.1, Technical Report, University of Tennessee, Knoxville, TN, June 1995. http://www-unix.mcs.anl.gov/mpi/
• 3: W. D. Gropp, and E. Lusk, User's Guide for mpich, a Portable Implementation of MPI, Technical Report, ANL-96/6, Argonne National Laboratory, 1996.
• 4: Leen Dikken , Frank van der Linden , J. J. J. Vesseur , Peter M. A. Sloot, DynamicPVM - Dynamic Load Balancing on Parallel Systems, Proceedings of the nternational Conference and Exhibition on High-Performance Computing and Networking Volume II: Networking and Tools, p.273-277, April 18-20, 1994
• 5: J. J. J. Vesseur, R. N. Heederik, B. J. Overeinder, and P. M. A. Sloot, Experiments in Dynamic Load Balancing for Parallel Cluster Computing, In Proceedings of the Workshop on Parallel Programming and Computation (ZEUS'95) and the 4th Nordic Transputer Conference (NTUG'95), in series Transputer and Occam Engineering Series, Parallel Programming and Applications, pp. 189-194, IOS Press, 1995.
• 6: B. J. Overeinder , P. M. A. Sloot , R. N. Heederik , L. O. Hertzberger, A dynamic load balancing system for parallel cluster computing, Future Generation Computer Systems, v.12 n.1, p.101-115, May 1996 [doi>10.1016/0167-739X(95)00038-T]
• 7: G. Dick van Albada , J. Clinckmaillie , A. H. L. Emmen , Jörn Gehring , O. Heinz , Frank van der Linden , Benno J. Overeinder , Alexander Reinefeld , Peter M. A. Sloot, Dynamite - Blasting Obstacles to Parallel Cluster Computing, Proceedings of the 7th International Conference on High-Performance Computing and Networking, p.300-310, April 12-14, 1999
• 8: J. Casas, D. L. Clark, R. Konuru, S. W. Otto, R. M. Prouty, and J. Walpole, MPVM: A Migration Transparent Version of PVM, Usenix Computing Systems, v. 8, n. 2, pp. 171-216, 1995.
• 9: G. Stellner, and J. Pruyne, Resource Management and Checkpointing for PVM, In Proceedings of the 2nd European Users' Group Meeting, pp. 131-136, 1995.
• 10: C. P. Tan , Weng-Fai Wong , Chung-Kwong Yuen, tmPVM - Task Migratable PVM, Proceedings of the 13th International Symposium on Parallel Processing and the 10th Symposium on Parallel and Distributed Processing, p.196-202, April 12-16, 1999
• 11: Pei Dan , Wang Dongsheng , Zhang Youhui , Shen Meiming, Quasi-asynchronous migration: a novel migration protocol for PVM tasks, ACM SIGOPS Operating Systems Review, v.33 n.2, p.5-14, April 1999 [doi>10.1145/311094.311100]
• 12: Pawel Czarnul , Henryk Krawczyk, Dynamic Assignment with Process Migration in Distributed Environments, Proceedings of the 6th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, p.509-516, September 26-29, 1999
• 13: Georg Stellner, CoCheck: Checkpointing and Process Migration for MPI, Proceedings of the 10th International Parallel Processing Symposium, p.526-531, April 15-19, 1996
• 14: Jonathan Robinson , Samuel Russ , Bjorn Heckel , Brian Flachs, A Task Migration Implementation of the Message-Passing Interface, Proceedings of the High Performance Distributed Computing (HPDC '96), p.61, August 06-09, 1996
• 15: http://www.genias.de/products/codine/
• 16: Jim Pruyne , Miron Livny, Managing Checkpoints for Parallel Programs, Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing, p.140-154, April 16, 1996
• 17: J. S. Plank, M. Beck, G. Kingsley, and K. Li, Libckpt: Transparent Checkpointing under Unix, Proceedings of the Usenix Winter 1995 Technical Conference, New Orleans, LA, pp. 213-223, 1995.
• 18: M. Litzkow, T. Tannenbaum, J. Basney, and M. Livny, Checkpoint and Migration of UNIX Processes in the Condor Distributed Processing System, University of Wisconsin---Madison Computer Sciences Technical Report #1346, 1997.
• 19: A. Barak, O. La'adan, and A. Shiloh, Scalable Cluster Computing with MOSIX for LINUX, In Proceedings of Linux Expo '99, pp. 95-100, Raleigh, N.C., 1999.
• 20: S. Loosemore, R. M. Stallman, R. McGrath, A. Oram, and U. Drepper, The GNU C Library Reference Manual, Free Software Foundation, Inc, Boston, MA, USA, 1999.

INDEX TERMS

Keywords:
PVM, cluster computing, message-passing, task migration