No "power" struggles: coordinated multi-level power management for the data center

ABSTRACT

Power delivery, electricity consumption, and heat management are becoming key challenges in data center environments. Several past solutions have individually evaluated different techniques to address separate aspects of this problem, in hardware and software, and at local and global levels. Unfortunately, there has been no corresponding work on coordinating all these solutions. In the absence of such coordination, these solutions are likely to interfere with one another, in unpredictable (and potentially dangerous) ways. This paper seeks to address this problem. We make two key contributions. First, we propose and validate a power management solution that coordinates different individual approaches. Using simulations based on 180 server traces from nine different real-world enterprises, we demonstrate the correctness, stability, and efficiency advantages of our solution. Second, using our unified architecture as the base, we perform a detailed quantitative sensitivity analysis and draw conclusions about the impact of different architectures, implementations, workloads, and system design choices.

REFERENCES

• 1: Luiz André Barroso, The price of performance, Queue, v.3 n.7, September 2005 [doi>10.1145/1095408.1095420]
• 2: Pat Bohrer , Elmootazbellah N. Elnozahy , Tom Keller , Michael Kistler , Charles Lefurgy , Chandler McDowell , Ram Rajamony, The case for power management in web servers, Power aware computing, Kluwer Academic Publishers, Norwell, MA, 2002
• 3: David Brooks , Margaret Martonosi, Dynamic Thermal Management for High-Performance Microprocessors, Proceedings of the 7th International Symposium on High-Performance Computer Architecture, p.171, January 20-24, 2001
• 4: Enrique V. Carrera , Eduardo Pinheiro , Ricardo Bianchini, Conserving disk energy in network servers, Proceedings of the 17th annual international conference on Supercomputing, June 23-26, 2003, San Francisco, CA, USA [doi>10.1145/782814.782829]
• 5: Jeffrey S. Chase , Darrell C. Anderson , Prachi N. Thakar , Amin M. Vahdat , Ronald P. Doyle, Managing energy and server resources in hosting centers, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 6: R. Doyle, Energy Management for Server Clusters, Proceedings of the Eighth Workshop on Hot Topics in Operating Systems, p.165, May 20-22, 2001
• 7: Yiyu Chen , Amitayu Das , Wubi Qin , Anand Sivasubramaniam , Qian Wang , Natarajan Gautam, Managing server energy and operational costs in hosting centers, Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, June 06-10, 2005, Banff, Alberta, Canada
• 8: CIM Specification, DMTF industry group, www.dmtf,org
• 9: Bruno Diniz , Dorgival Guedes , Wagner Meira, Jr. , Ricardo Bianchini, Limiting the power consumption of main memory, Proceedings of the 34th annual international symposium on Computer architecture, June 09-13, 2007, San Diego, California, USA
• 10: James Donald , Margaret Martonosi, Techniques for Multicore Thermal Management: Classification and New Exploration, Proceedings of the 33rd annual international symposium on Computer Architecture, p.78-88, June 17-21, 2006
• 11: M. Elnozahy, M. Kistler, and R. Rajamony. Energy-efficient server clusters. In Power Aware Computing Systems (PACS), February 2002.
• 12: Xiaobo Fan , Wolf-Dietrich Weber , Luiz Andre Barroso, Power provisioning for a warehouse-sized computer, Proceedings of the 34th annual international symposium on Computer architecture, June 09-13, 2007, San Diego, California, USA
• 13: Wes Felter , Karthick Rajamani , Tom Keller , Cosmin Rusu, A performance-conserving approach for reducing peak power consumption in server systems, Proceedings of the 19th annual international conference on Supercomputing, June 20-22, 2005, Cambridge, Massachusetts [doi>10.1145/1088149.1088188]
• 14: M. Femal and V. Freeh. Safe over-provisioning: Using power limits to increase aggregate throughput. In Power-Aware Computing Systems (PACS), December 2004.
• 15: P. Gelsinger. Intel Developer Forum, Keynote, April 2006.
• 16: The Green Grid", http://www.thegreengrid.org/home
• 17: T. Heath et al. Self-configuring heterogeneous server clusters. In Workshop on Compilers and Operating Systems for Low Power (COLP), 2003.
• 18: Hewlett Packard. HP Power Regulator for Proliant. Online. http://h18004.www1.hp.com/products/servers/management/ilo/powerregulator.html.
• 19: Intel Corporation, Motorola Corporation, and Toshiba Corporation. Advanced configuration and power interface specification, December 1996. http://www.teleport.com/acpi.
• 20: Philo Juang , Qiang Wu , Li-Shiuan Peh , Margaret Martonosi , Douglas W. Clark, Coordinated, distributed, formal energy management of chip multiprocessors, Proceedings of the 2005 international symposium on Low power electronics and design, August 08-10, 2005, San Diego, CA, USA [doi>10.1145/1077603.1077637]
• 21: Charles Lefurgy , Karthick Rajamani , Freeman Rawson , Wes Felter , Michael Kistler , Tom W. Keller, Energy Management for Commercial Servers, Computer, v.36 n.12, p.39-48, December 2003 [doi>10.1109/MC.2003.1250880]
• 22: Ripal Nathuji , Karsten Schwan, VirtualPower: coordinated power management in virtualized enterprise systems, Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, October 14-17, 2007, Stevenson, Washington, USA
• 23: C. Patel and P. Ranganathan. Enterprise power and cooling. ASPLOS Tutorial, October 2006.
• 24: C. Patel et al. Energy flow in the information technology stack: Introducing the coefficient of the ensemble at its impact on total cost of ownership. In HP Labs Technical Report HPL-2006-55, 2006.
• 25: E. Pinheiro et al. Load balancing and unbalancing for power and performance in cluster-based systems. In Proc. of the Workshop on Compilers and Operating Systems for Low Power (COLP), 2001.
• 26: R. Raghavendra et al. "No power struggles: Coordinated multi-level power management for the data center," Hewlett Packard Technical Report, HPL-TR-2007-194, December 2007.
• 27: P. Ranganathan and P. Leech. Simulating complex enterprise workloads using utilization traces. In 10th Workshop on Computer Architecture Evaluation using Commercial Workloads (CAECW), February 2007.
• 28: Parthasarathy Ranganathan , Phil Leech , David Irwin , Jeffrey Chase, Ensemble-level Power Management for Dense Blade Servers, Proceedings of the 33rd annual international symposium on Computer Architecture, p.66-77, June 17-21, 2006
• 29: J. Rolia , X. Zhu , M. Arlitt , A. Andrzejak, Statistical Service Assurances for Applications in Utility Grid Environments, Proceedings of the 10th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS'02), p.247, October 11-16, 2002
• 30: D.G. Sachs et al. Grace: A cross-layer adaptation framework for saving energy. In IEEE Computer, special issue on Power-Aware Computing, December 2003.
• 31: Vivek Sharma , Arun Thomas , Tarek Abdelzaher , Kevin Skadron , Zhijian Lu, Power-aware QoS Management in Web Servers, Proceedings of the 24th IEEE International Real-Time Systems Symposium, p.63, December 03-05, 2003
• 32: United States Environmental Protection Agency (EPA). Enterprise server and data center efficiency initiatives. http://www.energystar.gov/index.cfm?c=prod_development.server_efficiency.
• 33: Amin Vahdat , Alvin Lebeck , Carla Schlatter Ellis, Every joule is precious: the case for revisiting operating system design for energy efficiency, Proceedings of the 9th workshop on ACM SIGOPS European workshop: beyond the PC: new challenges for the operating system, September 17-20, 2000, Kolding, Denmark [doi>10.1145/566726.566735]
• 34: VMware. Vmotion: Virtual machine migration. http://www.vmware.com/products/vi/vc/vmotion.html.
• 35: Z. Wang, X. Zhu, and S. Singhal. Utilization and SLO-based control for dynamic sizing of resource partitions. In 16th IFIP/IEEE Distributed Systems: Operations and Management, Oct. 2005.
• 36: Qiang Wu , Philo Juang , Margaret Martonosi , Li-Shiuan Peh , Douglas W. Clark, Formal Control Techniques for Power-Performance Management, IEEE Micro, v.25 n.5, p.52-62, September 2005 [doi>10.1109/MM.2005.87]
• 37: Heng Zeng , Carla S. Ellis , Alvin R. Lebeck , Amin Vahdat, ECOSystem: managing energy as a first class operating system resource, Proceedings of the 10th international conference on Architectural support for programming languages and operating systems, October 05-09, 2002, San Jose, California
• 38: Heng Zeng , Carla S. Ellis , Alvin R. Lebeck , Amin Vahdat, Currentcy: a unifying abstraction for expressing energy management policies, Proceedings of the annual conference on USENIX Annual Technical Conference, p.4-4, June 09-14, 2003, San Antonio, Texas

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.0 GENERAL
      Subjects: Hardware/software interfaces

Additional Classification:
  C. Computer Systems Organization
  C.0 GENERAL
      Subjects: System architectures

General Terms:
Algorithms, Design, Management, Measurement, Performance

Keywords:
capping, control theory, coordination, data center, efficiency, power management, virtualization