The Tool Dæmon Protocol (TDP)

ABSTRACT

Run-time tools are crucial to program development. In our desktop computer environments, we take for granted the availability of tools for operations such as debugging, profiling, tracing, checkpointing, and visualization. When programs move into distributed or Grid environments, it is difficult to find such tools. This difficulty is caused by the complex interactions necessary between application program, operating system and layers of job scheduling and process management software. As a result, each run-time tool must be individually ported to run under a particular job management system; for m tools and n environments, the problem becomes an m \times n effort, rather than the hoped-for m + n effort. Variations in underlying operating systems can make this problem even worse. The consequence of this situation is a paucity of tools in distributed and Grid computing environments. In response to the problem, we have analyzed a variety of job scheduling environments and run-time tools to better understand their interactions. From this analysis, we isolated what we believe are the essential interactions between the run-time tool, job scheduler and resource manager, and application program. We are proposing a standard interface, called the Tool Dæmon Protocol (TDP) that codifies these interactions and provides the necessary communication functions. We have implemented a pilot TDP library and experimented with Parador, a prototype using the Paradyn Parallel Performance tools profiling jobs running under the Condor batch-scheduling environment.

REFERENCES

• 1: Susanne M. Balle , Bevin R. Brett , Chih-Ping Chen , David LaFrance-Linden, A New Approach to Parallel Debugger Architecture, Proceedings of the 6th International Conference on Applied Parallel Computing Advanced Scientific Computing, p.139-149, June 15-18, 2002
• 2: Ralph Butler , William Gropp , Ewing L. Lusk, A Scalable Process-Management Environment for Parallel Programs, Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, p.168-175, January 2000
• 3: Nicholas Carriero , David Gelernter, Linda in context, Communications of the ACM, v.32 n.4, p.444-458, April 1989 [doi>10.1145/63334.63337]
• 4: [4] Cray Computer Inc., "NQE Users Guide", Version 3.2, January 1997.
• 5: [5] Etnus LLC, "TotalView User's Guide", Document version 6.0.0-1, January 2003. ¿http://www.etnus.com¿
• 6: D. A. Evensky , A. C. Gentile , L. J. Camp , R. C. Armstrong, Lilith: Scalable Execution of User Code for Distributed Computing, Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing, p.305, August 05-08, 1997
• 7: I. Foster , C. Kesselman, The Globus Project: A Status Report, Proceedings of the Seventh Heterogeneous Computing Workshop, p.4, March 30-30, 1998
• 8: A. S. Grimshaw , W. A. Wulf, Legion-a view from 50,000 feet, Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing, p.89, August 06-09, 1996
• 9: [9] IBM Corporation, "Load Leveler Users Guide", Version 1.2. 1995.
• 10: Thomas Ludwig, II , Roland Wismüller , Michael Oberhuber, OCM - An OMIS Compliant Monitoring System, Proceedings of the Third European PVM Conference on Parallel Virtual Machine, p.81-90, October 07-09, 1996
• 11: Samuel Madden , Michael J. Franklin , Joseph M. Hellerstein , Wei Hong, TAG: a Tiny AGgregation service for Ad-Hoc sensor networks, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060303]
• 12: Barton P. Miller , Mark D. Callaghan , Jonathan M. Cargille , Jeffrey K. Hollingsworth , R. Bruce Irvin , Karen L. Karavanic , Krishna Kunchithapadam , Tia Newhall, The Paradyn Parallel Performance Measurement Tool, Computer, v.28 n.11, p.37-46, November 1995 [doi>10.1109/2.471178]
• 13: [13] M.J. Mutka, M. Livny, and M.W. Litzkow, "Condor - A Hunter of Idle Workstations", 8th Int'l Conf. on Distributed Systems, San Francisco, Calif., June 1988.
• 14: Adrian Nye, Xlib programming manual (3rd ed.), O'Reilly & Associates, Inc., Sebastopol, CA, 1993
• 15: [15] Platform Computing Inc, "LSF Users Guide".
• 16: Philip C. Roth , Dorian C. Arnold , Barton P. Miller, MRNet: A Software-Based Multicast/Reduction Network for Scalable Tools, Proceedings of the 2003 ACM/IEEE conference on Supercomputing, p.21, November 15-21, 2003