Multi-mode energy management for multi-tier server clusters

ABSTRACT

This paper presents an energy management policy for reconfigurable clusters running a multi-tier application, exploiting DVS together with multiple sleep states. We develop a theoretical analysis of the corresponding power optimization problem and design an algorithm around the solution. Moreover, we rigorously investigate selection of the optimal number of spare servers for each power state, a problem that has only been approached in an ad-hoc manner in current policies.

To validate our results and policies, we implement them on an actual multi-tier server cluster where nodes support all power management techniques considered. Experimental results using realistic dynamic workloads based on the TPCW benchmark show that exploiting multiple sleep states results in significant additional cluster-wide energy savings up to 23% with little or no performance degradation.

REFERENCES

• 1: Luca Benini , Alessandro Bogliolo , Giovanni De Micheli, A survey of design techniques for system-level dynamic power management, IEEE Transactions on Very Large Scale Integration (VLSI) Systems, v.8 n.3, p.299-316, June 2000 [doi>10.1109/92.845896]
• 2: Pat Bohrer , Elmootazbellah N. Elnozahy , Tom Keller , Michael Kistler , Charles Lefurgy , Chandler McDowell , Ram Rajamony, The case for power management in web servers, Power aware computing, Kluwer Academic Publishers, Norwell, MA, 2002
• 3: Yiyu Chen , Amitayu Das , Wubi Qin , Anand Sivasubramaniam , Qian Wang , Natarajan Gautam, Managing server energy and operational costs in hosting centers, ACM SIGMETRICS Performance Evaluation Review, v.33 n.1, June 2005
• 4: E. Elnozahy, M. Kistler, and R. Rajamony. Energy-efficient server clusters. In Proc. Workshop on Power-Aware Computing Systems, Feb. 2002.
• 5: Xiaobo Fan , Wolf-Dietrich Weber , Luiz Andre Barroso, Power provisioning for a warehouse-sized computer, Proceedings of the 34th annual international symposium on Computer architecture, June 09-13, 2007, San Diego, California, USA
• 6: C. Hang, K. Astrom, and W. Ho. Refinements of the Ziegler-Nichols tuning formula. IEE Proceedings D, Control Theory and Applications, 138(2):111--118, Mar. 1991.
• 7: Taliver Heath , Bruno Diniz , Enrique V. Carrera , Wagner Meira Jr. , Ricardo Bianchini, Energy conservation in heterogeneous server clusters, Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, June 15-17, 2005, Chicago, IL, USA [doi>10.1145/1065944.1065969]
• 8: C. hsing Hsu and W. chun Feng. When discreteness meets continuity: Energy-optimal dvs scheduling revisited. Technical Report LA-UR 05-3104, Los Alamos National Laboratory, Feb. 2005.
• 9: Charles Lefurgy , Karthick Rajamani , Freeman Rawson , Wes Felter , Michael Kistler , Tom W. Keller, Energy Management for Commercial Servers, Computer, v.36 n.12, p.39-48, December 2003 [doi>10.1109/MC.2003.1250880]
• 10: Akihiko Miyoshi , Charles Lefurgy , Eric Van Hensbergen , Ram Rajamony , Raj Rajkumar, Critical power slope: understanding the runtime effects of frequency scaling, Proceedings of the 16th international conference on Supercomputing, June 22-26, 2002, New York, New York, USA [doi>10.1145/514191.514200]
• 11: Trevor Mudge, Power: A First-Class Architectural Design Constraint, Computer, v.34 n.4, p.52-58, April 2001 [doi>10.1109/2.917539]
• 12: Eduardo Pinheiro , Ricardo Bianchini , Enrique V. Carrera , Taliver Heath, Dynamic cluster reconfiguration for power and performance, Compilers and operating systems for low power, Kluwer Academic Publishers, Norwell, MA, 2003
• 13: Ramya Raghavendra , Parthasarathy Ranganathan , Vanish Talwar , Zhikui Wang , Xiaoyun Zhu, No "power" struggles: coordinated multi-level power management for the data center, ACM SIGARCH Computer Architecture News, v.36 n.1, March 2008
• 14: K. Rajamani , C. Lefurgy, On evaluating request-distribution schemes for saving energy in server clusters, Proceedings of the 2003 IEEE International Symposium on Performance Analysis of Systems and Software, p.111-122, March 06-08, 2003
• 15: Parthasarathy Ranganathan , Phil Leech , David Irwin , Jeffrey Chase, Ensemble-level Power Management for Dense Blade Servers, Proceedings of the 33rd annual international symposium on Computer Architecture, p.66-77, June 17-21, 2006
• 16: Cosmin Rusu , Alexandre Ferreira , Claudio Scordino , Aaron Watson, Energy-Efficient Real-Time Heterogeneous Server Clusters, Proceedings of the 12th IEEE Real-Time and Embedded Technology and Applications Symposium, p.418-428, April 04-07, 2006 [doi>10.1109/RTAS.2006.16]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Performance attributes

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.0 General

General Terms:
Algorithms, Design, Experimentation, Management, Performance

Keywords:
dynamic power management, dynamic voltage scaling, end-to-end latency, energy management, internet servers, multi-tier applications, reconfigurable clusters, sleep states