Managing energy and server resources in hosting centers

ABSTRACT

Internet hosting centers serve multiple service sites from a common hardware base. This paper presents the design and implementation of an architecture for resource management in a hosting center operating system, with an emphasis on energy as a driving resource management issue for large server clusters. The goals are to provision server resources for co-hosted services in a way that automatically adapts to offered load, improve the energy efficiency of server clusters by dynamically resizing the active server set, and respond to power supply disruptions or thermal events by degrading service in accordance with negotiated Service Level Agreements (SLAs).Our system is based on an economic approach to managing shared server resources, in which services "bid" for resources as a function of delivered performance. The system continuously monitors load and plans resource allotments by estimating the value of their effects on service performance. A greedy resource allocation algorithm adjusts resource prices to balance supply and demand, allocating resources to their most efficient use. A reconfigurable server switching infrastructure directs request traffic to the servers assigned to each service. Experimental results from a prototype confirm that the system adapts to offered load and resource availability, and can reduce server energy usage by 29% or more for a typical Web workload.

REFERENCES

• 1: Tarek F. Abdelzaher and Chenyang Lu. Modeling and Performance Control of Interact Servers. In 39th IEEE Conference on Decision and Control, December 2000.
• 2: Tarek F. Abdelzaher , Kang G. Shin , Nina Bhatti, Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach, IEEE Transactions on Parallel and Distributed Systems, v.13 n.1, p.80-96, January 2002 [doi>10.1109/71.980028]
• 3: J. Aman , C. K. Eilert , D. Emmes , P. Yocom , D. Dillenberger, Adaptive algorithms for managing a distributed data processing workload, IBM Systems Journal, v.36 n.2, p.242-283, 1997
• 4: Darrell C. Anderson, Jeffrey S. Chase, and Amin M. Vahdat. Interposed Request Routing for Scalable Network Storage. In Proceedings of the Fourth Symposium on Operating System Design and Implementation ( OSD1), October 2000.
• 5: Karen Appleby, Sameh Fakhouri, Liana Fong, German Goldszmidt, Michael Kalantar, Srirama Krishnakumar, Donald Pazel, John Pershing, and Benny Rochwerger. Oceano - SLA Based Management of a Computing Utility. In Proceedings of the 7th IFIP/IEEE International Symposium on Integrated Network Management, May 2001.
• 6: Martin Arlitt and Tal Jin. Workload Characterization of the 1998 World Cup Web Site. Technical Report HPL-1999-35R1, HI" Laboratories, September 1999. The trace is available from the Internet Traffic Archive at ita.ee.lbl.gov.
• 7: Armando Fox , Steven D. Gribble , Yatin Chawathe , Eric A. Brewer , Paul Gauthier, Cluster-based scalable network services, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.78-91, October 05-08, 1997, Saint Malo, France
• 8: Mohit Aron , Peter Druschel, Differentiated and predictable quality of service in web server systems, 2001
• 9: Mohit Aron , Peter Druschel , Willy Zwaenepoel, Cluster reserves: a mechanism for resource management in cluster-based network servers, Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.90-101, June 18-21, 2000, Santa Clara, California, United States
• 10: Gaurav Banga , Peter Druschel , Jeffrey C. Mogul, Resource containers: a new facility for resource management in server systems, Proceedings of the third symposium on Operating systems design and implementation, p.45-58, February 1999, New Orleans, Louisiana, United States
• 11: Paul Barford , Mark Crovella, Generating representative Web workloads for network and server performance evaluation, Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, p.151-160, June 22-26, 1998, Madison, Wisconsin, United States
• 12: Pat Bohrer , Elmootazbellah N. Elnozahy , Tom Keller , Michael Kistler , Charles Lefurgy , Chandler McDowell , Ram Rajamony, The case for power management in web servers, Power aware computing, Kluwer Academic Publishers, Norwell, MA, 2002
• 13: David Brooks , Margaret Martonosi, Dynamic Thermal Management for High-Performance Microprocessors, Proceedings of the 7th International Symposium on High-Performance Computer Architecture, p.171, January 20-24, 2001
• 14: Jeffrey S. Chase , Henry M. Levy , Michael J. Feeley , Edward D. Lazowska, Sharing and protection in a single-address-space operating system, ACM Transactions on Computer Systems (TOCS), v.12 n.4, p.271-307, Nov. 1994 [doi>10.1145/195792.195795]
• 15: Fred Douglis , P. Krishnan , Brian N. Bershad, Adaptive Disk Spin-down Policies for Mobile Computers, Proceedings of the 2nd Symposium on Mobile and Location-Independent Computing, p.121-137, April 10-11, 1995
• 16: Donald F. Ferguson , Christos Nikolaou , Jakka Sairamesh , Yechiam Yemini, Economic models for allocating resources in computer systems, Market-based control: a paradigm for distributed resource allocation, World Scientific Publishing Co., Inc., River Edge, NJ, 1996
• 17: Jason Flinn , M. Satyanarayanan, Energy-aware adaptation for mobile applications, Proceedings of the seventeenth ACM symposium on Operating systems principles, p.48-63, December 12-15, 1999, Charleston, South Carolina, United States
• 18: Syam Gadde. The Proxycizer Web Proxy Tool Suite. http : //www. cs. duke. edu/ari/Proxycizer/.
• 19: Toshihide Ibaraki , Naoki Katoh, Resource allocation problems: algorithmic approaches, MIT Press, Cambridge, MA, 1988
• 20: Arun Iyengar , Jim Challenger , Daniel Dias , Paul Dantzig, High-Performance Web Site Design Techniques, IEEE Internet Computing, v.4 n.2, p.17-26, March 2000 [doi>10.1109/4236.832942]
• 21: V. Jacobson, Congestion avoidance and control, ACM SIGCOMM Computer Communication Review, v.18 n.4, p.314-329, August 1988
• 22: Sugih Jamin , Peter B. Danzig , Scott J. Shenker , Lixia Zhang, A measurement-based admission control algorithm for integrated service packet networks, IEEE/ACM Transactions on Networking (TON), v.5 n.1, p.56-70, Feb. 1997 [doi>10.1109/90.554722]
• 23: Sugih Jamin , Scott J. Shenker , Peter B. Danzig, Comparison of Measurement-based Admission Control Algorithms for Controlled-Load Service, Proceedings of the INFOCOM '97. Sixteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Driving the Information Revolution, p.973, April 09-11, 1997
• 24: Michael B. Jones , Daniela Roşu , Marcel-Cătălin Roşu, CPU reservations and time constraints: efficient, predictable scheduling of independent activities, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.198-211, October 05-08, 1997, Saint Malo, France
• 25: Minkyong Kim , Brian Noble, Mobile network estimation, Proceedings of the 7th annual international conference on Mobile computing and networking, p.298-309, July 2001, Rome, Italy [doi>10.1145/381677.381705]
• 26: Alvin R. Lebeck , Xiaobo Fan , Heng Zeng , Carla Ellis, Power aware page allocation, Proceedings of the ninth international conference on Architectural support for programming languages and operating systems, p.105-116, November 2000, Cambridge, Massachusetts, United States
• 27: Kelvin Li and Sugih Jamin. A Meaanrement-Based Admission-Controlled Web Server. In Proceedings oflEEE lnfocom 2000, March 2000.
• 28: Lee W. McKnight , Joseph P. Bailey, Internet economics, MIT Press, Cambridge, MA, 1997
• 29: Jennifer D. Mitebell-Jacksun. Energy Needs in an Interuet Economy: A Closer Look at Data Centers. Master's thesis, Energy and Resources Group, University of California at Berkeley, July 2001.
• 30: Rolf Neugebauer , Derek McAuley, Energy Is Just Another Resource: Energy Accounting and Energy Pricing in the Nemesis OS, Proceedings of the Eighth Workshop on Hot Topics in Operating Systems, p.67, May 20-22, 2001
• 31: Brian D. Noble , M. Satyanarayanan , Dushyanth Narayanan , James Eric Tilton , Jason Flinn , Kevin R. Walker, Agile application-aware adaptation for mobility, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.276-287, October 05-08, 1997, Saint Malo, France
• 32: Vivek S. Pai , Mohit Aron , Gaurov Banga , Michael Svendsen , Peter Druschel , Willy Zwaenepoel , Erich Nahum, Locality-aware request distribution in cluster-based network servers, Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, p.205-216, October 02-07, 1998, San Jose, California, United States
• 33: Eduardo Pinheiro, Ricardo Bianchini, Eurique V. Carrera, and Taliver Heath. Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. Technical Report DCS-TR-440, Department of Computer Science, Rutgers University, May 2001.
• 34: John Reumann, Ashish Mehra, Kang G. Shin, and Dilip Kandlur. Virtual Services: A New Abstraction for Server Consolidation. In Proceedings of the USENIX 2000 Technical Conference, June 2000.
• 35: Timothy Roscoe , Prashant J. Shenoy, New Resource Control Issues in Shared Clusters, Proceedings of the 8th International Workshop on Interactive Distributed Multimedia Systems, p.2-9, September 04-07, 2001
• 36: Yasushi Saito , Brian N. Bershad , Henry M. Levy, Manageability, availability and performance in Porcupine: a highly scalable, cluster-based mail service, Proceedings of the seventeenth ACM symposium on Operating systems principles, p.1-15, December 12-15, 1999, Charleston, South Carolina, United States
• 37: Barry C. Smith, John F. Leimkuhler, and Ross M. Darrow. Yield Management at American Airlines. Interfaces, 22(1), January 1992.
• 38: David C. Steere , Ashvin Goel , Joshua Gruenberg , Dylan McNamee , Calton Pu , Jonathan Walpole, A feedback-driven proportion allocator for real-rate scheduling, Proceedings of the third symposium on Operating systems design and implementation, p.145-158, February 1999, New Orleans, Louisiana, United States
• 39: Michael Stonebraker , Paul M. Aoki , Witold Litwin , Avi Pfeffer , Adam Sah , Jeff Sidell , Carl Staelin , Andrew Yu, Mariposa: a wide-area distributed database system, The VLDB Journal — The International Journal on Very Large Data Bases, v.5 n.1, p.048-063, January 1996 [doi>10.1007/s007780050015]
• 40: David G. Sullivan and Margo I. Seltzer. Isolation with Flexibility: A Resource Management Framework for Central Servers. In Proceedings of the 2000 USENIX Annual Technical Conference, pages 337-350, June 2000.
• 41: Kevin Thompson, Gregory J. Miller, and Rick Wilder. Wide-Area lnternet Traffic Patterns and Characteristics. In IEEENetwork, November 1997.
• 42: A. Vahdat , T. Anderson , M. Dahlin , E. Belani , D. Culler , P. Eastham , C. Yoshikawa, WebOS: Operating System Services for Wide Area Applications, Proceedings of the The Seventh IEEE International Symposium on High Performance Distributed Computing, p.52, July 28-31, 1998
• 43: Amin Vahdat , Alvin Lebeck , Carla Schlatter Ellis, Every joule is precious: the case for revisiting operating system design for energy efficiency, Proceedings of the 9th workshop on ACM SIGOPS European workshop: beyond the PC: new challenges for the operating system, September 17-20, 2000, Kolding, Denmark [doi>10.1145/566726.566735]
• 44: Ben Verghese , Anoop Gupta , Mendel Rosenblum, Performance isolation: sharing and isolation in shared-memory multiprocessors, Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, p.181-192, October 02-07, 1998, San Jose, California, United States
• 45: Carl A. Waldspurger , Tad Hogg , Bernardo A. Huberman , Jeffrey O. Kephart , W. Scott Stornetta, Spawn: A Distributed Computational Economy, IEEE Transactions on Software Engineering, v.18 n.2, p.103-117, February 1992 [doi>10.1109/32.121753]
• 46: Carl A. Waldspurger and William E. Weihl. Lottery Scheduling: Flexible Proportional-Share Resource Management. In Proceedings of the First Symposium on Operating Systems Design and Implementation (OSDI), pages 1-11, November 1994.
• 47: Huiean Zhu, Hung Tang, and Tao Yang. Demand-driven Service Differentiation in Cluster-Based Network Servers. In Proceedings of IEEE Infocom 2001, April 2001.

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.7 Organization and Design
          Subjects: Distributed systems

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Client/server

General Terms:
Design, Experimentation, Management, Performance