Vpm tokens: virtual machine-aware power budgeting in datacenters

ABSTRACT

Power consumption and cooling overheads are becoming increasingly significant for large scale machines, affecting overall costs and the ability to extend resource capacities and performance capabilities. To help mitigate these issues, active power management technologies are being deployed aggressively, including power budgeting, which enables improved power provisioning and can address critical periods when power delivery or cooling capabilities are temporarily reduced. Given the use of virtualization to encapsulate application components into virtual machines (VMs), however, such power management capabilities must address the interplay between budgeting physical resources and the performance of the virtual machines used to run these applications. This paper proposes a set of cluster- and datacenter-level management components and abstractions for use by power budgeting policies. The key idea is to manage power from a VM-centric point of view, where the goal is to be aware of global utility tradeoffs between different virtual machines (and their applications) when maintaining power constraints for the physical hardware on which they run. Our approach to VM-aware power budgeting uses multiple distributed managers integrated into the VirtualPower Management (VPM) framework whose actions are coordinated via a new abstraction, termed VPM tokens. An implementation with the Xen hypervisor illustrates technical benefits of VPM tokens that include up to 43% improvements in global utility, highlighting the ability to dynamically improve cluster performance while still meeting power budgets.

REFERENCES

• 1: H. Abbasi, M. Wolf, and K. Schwan. Live data workspace: A flexible, dynamic and extensible platform for petascale applications. In Proceedings of IEEE Cluster Computing Conference, 2007.
• 2: Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2.
• 3: Paul Barham , Boris Dragovic , Keir Fraser , Steven Hand , Tim Harris , Alex Ho , Rolf Neugebauer , Ian Pratt , Andrew Warfield, Xen and the art of virtualization, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 4: Jeffrey S. Chase , Darrell C. Anderson , Prachi N. Thakar , Amin M. Vahdat , Ronald P. Doyle, Managing energy and server resources in hosting centers, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 5: Christopher Clark , Keir Fraser , Steven Hand , Jacob Gorm Hansen , Eric Jul , Christian Limpach , Ian Pratt , Andrew Warfield, Live migration of virtual machines, Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, p.273-286, May 02-04, 2005
• 6: E. N. Elnozahy, M. Kistler, and R. Rajamony. Energy-efficient server clusters. In Proceedings of the Workshop on Power-Aware Computing Systems, February 2002.
• 7: Xiaobo Fan , Wolf-Dietrich Weber , Luiz Andre Barroso, Power provisioning for a warehouse-sized computer, Proceedings of the 34th annual international symposium on Computer architecture, June 09-13, 2007, San Diego, California, USA
• 8: Mark E. Femal , Vincent W. Freeh, Boosting Data Center Performance Through Non-Uniform Power Allocation, Proceedings of the Second International Conference on Automatic Computing, p.250-261, June 13-16, 2005 [doi>10.1109/ICAC.2005.17]
• 9: Rong Ge , Xizhou Feng , Wu-chun Feng , Kirk W. Cameron, CPU MISER: A Performance-Directed, Run-Time System for Power-Aware Clusters, Proceedings of the 2007 International Conference on Parallel Processing, p.18, September 10-14, 2007 [doi>10.1109/ICPP.2007.29]
• 10: Soraya Ghiasi , Tom Keller , Freeman Rawson, Scheduling for heterogeneous processors in server systems, Proceedings of the 2nd conference on Computing frontiers, May 04-06, 2005, Ischia, Italy [doi>10.1145/1062261.1062295]
• 11: Taliver Heath , Ana Paula Centeno , Pradeep George , Luiz Ramos , Yogesh Jaluria , Ricardo Bianchini, Mercury and freon: temperature emulation and management for server systems, Proceedings of the 12th international conference on Architectural support for programming languages and operating systems, October 21-25, 2006, San Jose, California, USA
• 12: Taliver Heath , Bruno Diniz , Enrique V. Carrera , Wagner Meira Jr. , Ricardo Bianchini, Energy conservation in heterogeneous server clusters, Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, June 15-17, 2005, Chicago, IL, USA [doi>10.1145/1065944.1065969]
• 13: Hewlett-Packard, Intel, Microsoft, Phoenix, and Toshiba. Advanced configuration and power interface specification. http://www.acpi.info, September 2004.
• 14: Y. Koh, R. Knauerhase, P. Brett, M. Bowman, Z. Wen, and C. Pu. An analysis of performance interference effects in virtual environments. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2007.
• 15: R. Kotla, S. Ghiasi, T. Keller, and F. Rawson. Scheduling processor voltage and frequency in server and cluster systems. In Proceedings of the Workshop on High-Performance, Power-Aware Computing (HP-PAC), 2005.
• 16: Rakesh Kumar , Dean M. Tullsen , Parthasarathy Ranganathan , Norman P. Jouppi , Keith I. Farkas, Single-ISA Heterogeneous Multi-Core Architectures for Multithreaded Workload Performance, Proceedings of the 31st annual international symposium on Computer architecture, p.64, June 19-23, 2004, München, Germany
• 17: the International Symposium on Computer Architecture (ISCA), June 2004.
• 18: Min Yeol Lim , Vincent W. Freeh , David K. Lowenthal, Adaptive, transparent frequency and voltage scaling of communication phases in MPI programs, Proceedings of the 2006 ACM/IEEE conference on Supercomputing, November 11-17, 2006, Tampa, Florida [doi>10.1145/1188455.1188567]
• 19: Arindam Mallik , Jack Cosgrove , Robert P. Dick , Gokhan Memik , Peter Dinda, PICSEL: measuring user-perceived performance to control dynamic frequency scaling, Proceedings of the 13th international conference on Architectural support for programming languages and operating systems, March 01-05, 2008, Seattle, WA, USA
• 20: Justin Moore , Jeff Chase , Parthasarathy Ranganathan , Ratnesh Sharma, Making scheduling "cool": temperature-aware workload placement in data centers, Proceedings of the annual conference on USENIX Annual Technical Conference, p.5-5, April 10-15, 2005, Anaheim, CA
• 21: Ripal Nathuji , Canturk Isci , Eugene Gorbatov, Exploiting Platform Heterogeneity for Power Efficient Data Centers, Proceedings of the Fourth International Conference on Autonomic Computing, p.5, June 11-15, 2007 [doi>10.1109/ICAC.2007.16]
• 22: Ripal Nathuji , Karsten Schwan, VirtualPower: coordinated power management in virtualized enterprise systems, Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, October 14-17, 2007, Stevenson, Washington, USA
• 23: G. Neiger, A. Santoni, F. Leung, D. Rodgers, and R. Uhlig. Intel virtualization technology: Hardware support for efficient processor virtualization. In Intel Technology Journal (http://www.intel.com/technology/itj/2006/v10i3/), August 2006.
• 24: Nutch. http://lucene.apache.org/nutch.
• 25: K. Rajamani , C. Lefurgy, On evaluating request-distribution schemes for saving energy in server clusters, Proceedings of the 2003 IEEE International Symposium on Performance Analysis of Systems and Software, p.111-122, March 06-08, 2003
• 26: Parthasarathy Ranganathan , Phil Leech , David Irwin , Jeffrey Chase, Ensemble-level Power Management for Dense Blade Servers, Proceedings of the 33rd annual international symposium on Computer Architecture, p.66-77, June 17-21, 2006
• 27: Barry Rountree , David K. Lowenthal , Shelby Funk , Vincent W. Freeh , Bronis R. de Supinski , Martin Schulz, Bounding energy consumption in large-scale MPI programs, Proceedings of the 2007 ACM/IEEE conference on Supercomputing, November 10-16, 2007, Reno, Nevada [doi>10.1145/1362622.1362688]
• 28: Jan Stoess , Christian Lang , Frank Bellosa, Energy management for hypervisor-based virtual machines, 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference, p.1-14, June 17-22, 2007, Santa Clara, CA
• 29: Jeremy Sugerman , Ganesh Venkitachalam , Beng-Hong Lim, Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.1-14, June 25-30, 2001
• 30: Carl A. Waldspurger , William E. Weihl, Lottery scheduling: flexible proportional-share resource management, Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation, p.1-es, November 14-17, 1994, Monterey, California
• 31: Gerald Tesauro , Jeffrey O. Kephart, Utility Functions in Autonomic Systems, Proceedings of the First International Conference on Autonomic Computing, p.70-77, May 17-18, 2004

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.0 GENERAL
      Subjects: System architectures

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.7 Organization and Design

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.4 System Management

General Terms:
Design, Experimentation, Management

Keywords:
power management, virtualization