StormWatch: a tool for visualizing memory system protocols

ABSTRACT

Recent research has offered programmers increased options for programming parallel computers by exposing system policies (e.g., memory coherence protocols) or by providing several programming paradigms (e.g. message passing and shared memory) on the same platform. Increased flexibility can lead to higher performance, but it is also a double-edged sword that demands a programmer understand his or her application and system at a more fundamental level. Our system, Tempest, allows a programmer to select or implement communication and memory coherence policies that fit an application's communication patterns. With it, we have achieved substantial performance gains without making major changes in programs. However, the process of selecting, designing, and implementing coherence protocols is difficult and time consuming, without tools to supply detailed information about an application's behavior and interaction with the memory system. StormWatch is a new visualization tool that aids a programmer through four mechanisms: tightly-coupled bidirectionally linked views, interactive filters, animation, and performance slicing. Multiple views present several aspects of program behavior simultaneously and show the same phenomenon from different perspectives. Real-time linking between views enables a programmer to explore levels of abstraction by changing a view and observing the effect on other views. Interactive filters, along with bidirectional linking, can isolate the effects of statements, loops, procedures, or files. StormWatch can also animate a program's dynamic behavior to show the evolution of program execution and communication. Finally, performance slicing captures causality among events. The examples in the paper illustrate how StormWatch helped us substantially improve the performance of two applications.

REFERENCES

• 1: David Bailey, John Barton, Thomas Lasinski, and Horst Simon. The NAS Parallel Benchmarks. Technical Report RNR-91-002 Revision 2, Ames Research Center, August 1991.
• 2: Stephen G. Eick , Joseph L. Steffen , Eric E. Sumner, Jr., Seesoft-A Tool for Visualizing Line Oriented Software Statistics, IEEE Transactions on Software Engineering, v.18 n.11, p.957-968, November 1992 [doi>10.1109/32.177365]
• 3: Barton P. Miller et al. The Paradyn Performance Measurement Tools. Available via anonymous ftp from grilled.cs.wisc.edu:techinical_papers/overview.ps.
• 4: Babak Falsafi , Alvin R. Lebeck , Steven K. Reinhardt , Ioannis Schoinas , Mark D. Hill , James R. Larus , Anne Rogers , David A. Wood, Application-specific protocols for user-level shared memory, Proceedings of the 1994 conference on Supercomputing, p.380-389, December 1994, Washington, D.C., United States
• 5: GIST User's Manual. Bolt, Beranek, and Newman, 1988.
• 6: Michael T. Heath , Jennifer A. Etheridge, Visualizing the Performance of Parallel Programs, IEEE Software, v.8 n.5, p.29-39, September 1991 [doi>10.1109/52.84214]
• 7: James R. Larus , Brad Richards , Guhan Viswanathan, LCM: memory system support for parallel language implementation, Proceedings of the sixth international conference on Architectural support for programming languages and operating systems, p.208-218, October 05-07, 1994, San Jose, California, United States
• 17: Thomas J. LeBlanc , John M. Mellor-Crummey , Robert J. Fowler, Analyzing parallel program executions using multiple views, Journal of Parallel and Distributed Computing, v.9 n.2, p.203-217, June 1990 [doi>10.1016/0743-7315(90)90046-R]
• 18: T. Lehr , Z. Segall , D. F. Vrsalovic , E. Caplan , A. L. Chung , C. E. Fineman, Visualizing Performance Debugging, Computer, v.22 n.10, p.38-51, October 1989 [doi>10.1109/2.42013]
• 19: Allen D. Malony , David H. Hammerslag , David J. Jablonowski, Traceview: A Trace Visualization Tool, IEEE Software, v.8 n.5, p.19-28, September 1991 [doi>10.1109/52.84213]
• 20: Allen D. Malony, JED: just an event display, Parallel computer systems: performance instrumentation and visualization, ACM Press, New York, NY, 1990 [doi>10.1145/100215.100248]
• 21: S. K. Reinhardt , J. R. Larus , D. A. Wood, Tempest and typhoon: user-level shared memory, Proceedings of the 21ST annual international symposium on Computer architecture, p.325-336, April 18-21, 1994, Chicago, Illinois, United States
• 23: Joel Saltz , Ravi Ponnusamy , Shamik D. Sharma , Bongki Moon , Yuan-Shin Hwang , Mustafa Uysal , Raja Das, A manual for the CHAOS runtime library, University of Maryland at College Park, College Park, MD, 1995
• 24: Ioannis Schoinas, Babak Falsafi, Alvin R. Lebeck, Steven K. Reinhardt, James R. Larus, and David A. Wood.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization

Additional Classification:
  B. Hardware
  B.3 MEMORY STRUCTURES
      B.3.2 Design Styles
          Subjects: Shared memory

  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.1 Large and Medium ("Mainframe") Computers
          Subjects: Super (very large) computers

  D. Software
  D.4 OPERATING SYSTEMS
      D.4.4 Communications Management
          Subjects: Message sending

General Terms:
Design, Performance

Keywords:
parallel programming, shared-memory, message passing, software coherence