Power-aware dynamic placement of HPC applications

ABSTRACT

High Performance Computing applications and platforms have been typically designed without regard to power consumption. With increased awareness of energy cost, power management is now an issue even for compute-intensive server clusters. In this work, we investigate the use of power management techniques for high performance applications on modern power-efficient servers with virtualization support. We consider power management techniques such as dynamic consolidation and usage of dynamic power range enabled by low power states on servers. We identify application performance isolation and virtualization overhead with multiple virtual machines as the key bottlenecks for server consolidation. We perform a comprehensive experimental study to identify the scenarios where applications are isolated from each other. We also establish that the power consumed by HPC applications may be application dependent, non-linear and have a large dynamic range. We show that for HPC applications, working set size is a key parameter to take care of while placing applications on virtualized servers. We use the insights obtained from our experimental study to present a framework and methodology for power-aware application placement for HPC applications.

REFERENCES

• 1: Hpl- a portable implementation of the high performance linpack benchmark for distributed memory computers. In http://www.netlib.org/benchmark/hpl/.
• 2: Norman Bobroff, Andrzej Kochut, and Kirk Beaty. Dynamic placement of virtual machines for managing sla violations. In IEEE Conf. Integrated Network Management, 2007.
• 3: R. Doyle, Energy Management for Server Clusters, Proceedings of the Eighth Workshop on Hot Topics in Operating Systems, p.165, May 20-22, 2001
• 4: Jeffrey S. Chase , Darrell C. Anderson , Prachi N. Thakar , Amin M. Vahdat , Ronald P. Doyle, Managing energy and server resources in hosting centers, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 5: DAXPY. http://www.netlib.org/blas/daxpy.f.
• 6: E. Elnozahy, M. Kistler, and R. Rajamony. Energy- efficient server clusters. In Proc. of Workshop on Power-Aware Computing Systems., 2002.
• 7: M. S. Floyd , S. Ghiasi , T. W. Keller , K. Rajamani , F. L. Rawson , J. C. Rubio , M. S. Ware, System power management support in the IBM POWER6 microprocessor, IBM Journal of Research and Development, v.51 n.6, p.733-746, November 2007
• 8: Wes Felter , Karthick Rajamani , Tom Keller , Cosmin Rusu, A performance-conserving approach for reducing peak power consumption in server systems, Proceedings of the 19th annual international conference on Supercomputing, June 20-22, 2005, Cambridge, Massachusetts [doi>10.1145/1088149.1088188]
• 9: Renato J. Figueiredo , Peter A. Dinda , José A. B. Fortes, A Case For Grid Computing On Virtual Machines, Proceedings of the 23rd International Conference on Distributed Computing Systems, p.550, May 19-22, 2003
• 10: Taliver Heath , Bruno Diniz , Enrique V. Carrera , Wagner Meira Jr. , Ricardo Bianchini, Energy conservation in heterogeneous server clusters, Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, June 15-17, 2005, Chicago, IL, USA [doi>10.1145/1065944.1065969]
• 11: Tibor Horvath , Tarek Abdelzaher , Kevin Skadron , Xue Liu, Dynamic Voltage Scaling in Multitier Web Servers with End-to-End Delay Control, IEEE Transactions on Computers, v.56 n.4, p.444-458, April 2007 [doi>10.1109/TC.2007.1003]
• 12: Wei Huang , Jiuxing Liu , Bulent Abali , Dhabaleswar K. Panda, A case for high performance computing with virtual machines, Proceedings of the 20th annual international conference on Supercomputing, June 28-July 01, 2006, Cairns, Queensland, Australia [doi>10.1145/1183401.1183421]
• 13: Jiuxing Liu , Wei Huang , Bulent Abali , Dhabaleswar K. Panda, High performance VMM-bypass I/O in virtual machines, Proceedings of the annual conference on USENIX '06 Annual Technical Conference, p.3-3, May 30-June 03, 2006, Boston, MA
• 14: Jeffrey O. Kephart , Hoi Chan , Rajarshi Das , David W. Levine , Gerald Tesauro , Freeman Rawson , Charles Lefurgy, Coordinating Multiple Autonomic Managers to Achieve Specified Power-Performance Tradeoffs, Proceedings of the Fourth International Conference on Autonomic Computing, p.24, June 11-15, 2007 [doi>10.1109/ICAC.2007.12]
• 15: Charles Lefurgy , Karthick Rajamani , Freeman Rawson , Wes Felter , Michael Kistler , Tom W. Keller, Energy Management for Commercial Servers, Computer, v.36 n.12, p.39-48, December 2003 [doi>10.1109/MC.2003.1250880]
• 16: The OSC Linux Cluster log. http://www.cs.huji.ac.il/labs/parallel/\\workload/l\_osc/index.html.
• 17: LPC EGEE Cluster Logs. http://www.cs.huji.ac.il/labs/parallel/\\workload/l\_lpc/index.html.
• 18: Arun Babu Nagarajan , Frank Mueller , Christian Engelmann , Stephen L. Scott, Proactive fault tolerance for HPC with Xen virtualization, Proceedings of the 21st annual international conference on Supercomputing, June 17-21, 2007, Seattle, Washington [doi>10.1145/1274971.1274978]
• 19: Ripal Nathuji , Karsten Schwan, VirtualPower: coordinated power management in virtualized enterprise systems, Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, October 14-17, 2007, Stevenson, Washington, USA
• 20: Logs of Real Parallel Workloads from Production Systems. http://www.cs.huji.ac.il/labs/parallel/workload/logs.html.
• 21: D. Oppenheimer, D. A. Patterson, , and A. Vahdat. A case for informed service placement in planet lab. In Planetlab Technical Report, PDN-04-025, 2004.
• 22: E. Pinheiro, R. Bianchini, E. Carrera, and T. Heath. Load balancing and unbalancing for power and performance in cluster-based systems, 2001.
• 23: Control power and cooling for data center efficiency HP thermal logic technology. An HP Bladesystem innovation primer. http://h71028.www7.hp.com/erc/downloads/4aa0-5820enw.pdf.
• 24: K. Rajamani and C. Lefurgy. On evaluating request-distribution schemes for saving energy in server clusters, 2003.
• 25: Karthick Rajamani, Heather Hanson, Juan Rubio, Soraya Ghiasi, and Freeman L. Rawson III. Application-aware power management. In IISWC, pages 39--48, 2006.
• 26: Cosmin Rusu , Alexandre Ferreira , Claudio Scordino , Aaron Watson, Energy-Efficient Real-Time Heterogeneous Server Clusters, Proceedings of the 12th IEEE Real-Time and Embedded Technology and Applications Symposium, p.418-428, April 04-07, 2006 [doi>10.1109/RTAS.2006.16]
• 27: VMWare Distributed Resource Scheduler. http://www.vmware.com/products/vi/vc/drs.html.
• 28: David C. Snowdon, Sergio Ruocco, and Gernot Heiser. Power management and dynamic voltage scaling: Myths and facts, September 2005.
• 29: A. Verma, P. Ahuja, and A. Neogi. pmapper: Power and migration cost aware application placement in virtualized systems. In IBM Research Report RI07010 (also under review), 2007.
• 30: Akshat Verma , Ashok Anand, On Store Placement for Response Time Minimization in Parallel Disks, Proceedings of the 26th IEEE International Conference on Distributed Computing Systems, p.31, July 04-07, 2006 [doi>10.1109/ICDCS.2006.59]
• 31: Intel Xeon. http://www.intel.com/products/processor/xeon5000/.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Modeling techniques

General Terms:
Performance

Keywords:
high performance, placement, power management