Hibernator: helping disk arrays sleep through the winter

ABSTRACT

Energy consumption has become an important issue in high-end data centers, and disk arrays are one of the largest energy consumers within them. Although several attempts have been made to improve disk array energy management, the existing solutions either provide little energy savings or significantly degrade performance for data center workloads.Our solution, Hibernator, is a disk array energy management system that provides improved energy savings while meeting performance goals. Hibernator combines a number of techniques to achieve this: the use of disks that can spin at different speeds, a coarse-grained approach for dynamically deciding which disks should spin at which speeds, efficient ways to migrate the right data to an appropriate-speed disk automatically, and automatic performance boosts if there is a risk that performance goals might not be met due to disk energy management.In this paper, we describe the Hibernator design, and present evaluations of it using both trace-driven simulations and a hybrid system comprised of a real database server (IBM DB2) and an emulated storage server with multi-speed disks. Our file-system and on-line transaction processing (OLTP) simulation results show that Hibernator can provide up to 65% energy savings while continuing to satisfy performance goals (6.5--26 times better than previous solutions). Our OLTP emulated system results show that Hibernator can save more energy (29%) than previous solutions, while still providing an OLTP transaction rate comparable to a RAID5 array with no energy management.

REFERENCES

• 1: ILOG CPLEX 7.0 documentation home page. http://www.ise.ufl.edu/ilog/cplex70/.
• 2: Panel computer hard disk drive precautions. http://www.pro-face.com/support/technical/00apr3.htm.
• 3: Symmetrix 3000 and 5000 Enterprise Storage Systems product description guide. http://www.emc.com/, 1999.
• 4: Dell PowerEdge 6650 executive summary. http://www.tpc.org/results/individual_results/Dell/dell_6650_010603_es.pdf, Mar. 2003.
• 5: HP announces "smart" cooling solution for data centers. http://www.hp.com/hpinfo/newsroom/press/2003/030304b.html, March 4 2003.
• 6: HP Integrity RX5670 Cluster 64P Executive Summary. http://www.tpc.org/results/individual_results/HP/HP20Integrity20rx5670\20Cluster\2064P_ES.pdf, Dec. 2003.
• 7: David H. Albonesi, Selective cache ways: on-demand cache resource allocation, Proceedings of the 32nd annual ACM/IEEE international symposium on Microarchitecture, p.248-259, November 16-18, 1999, Haifa, Israel
• 8: American Power Convension. Determining total cost of ownership for date centers and network room infrastructure. ftp://www.apcmedia.com/salestools/CMRP-5T9PQG_R2_EN.pdf, 2003.
• 9: Eric Anderson , Michael Hobbs , Kimberly Keeton , Susan Spence , Mustafa Uysal , Alistair Veitch, Hippodrome: Running Circles Around Storage Administration, Proceedings of the 1st USENIX Conference on File and Storage Technologies, January 28-30, 2002, Monterey, CA
• 10: Enrique V. Carrera , Eduardo Pinheiro , Ricardo Bianchini, Conserving disk energy in network servers, Proceedings of the 17th annual international conference on Supercomputing, June 23-26, 2003, San Francisco, CA, USA [doi>10.1145/782814.782829]
• 11: R. Doyle, Energy Management for Server Clusters, Proceedings of the Eighth Workshop on Hot Topics in Operating Systems, p.165, May 20-22, 2001
• 12: Peter M. Chen , Edward K. Lee , Garth A. Gibson , Randy H. Katz , David A. Patterson, RAID: high-performance, reliable secondary storage, ACM Computing Surveys (CSUR), v.26 n.2, p.145-185, June 1994 [doi>10.1145/176979.176981]
• 13: Yiyu Chen , Amitayu Das , Wubi Qin , Anand Sivasubramaniam , Qian Wang , Natarajan Gautam, Managing server energy and operational costs in hosting centers, Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, June 06-10, 2005, Banff, Alberta, Canada
• 14: Dennis Colarelli , Dirk Grunwald, Massive arrays of idle disks for storage archives, Proceedings of the 2002 ACM/IEEE conference on Supercomputing, p.1-11, November 16, 2002, Baltimore, Maryland
• 15: Fred Douglis , P. Krishnan , Brian N. Bershad, Adaptive Disk Spin-down Policies for Mobile Computers, Proceedings of the 2nd Symposium on Mobile and Location-Independent Computing, p.121-137, April 10-11, 1995
• 16: G. Ganger, B. Worthington, and Y. Patt. The DiskSim simulation environment - version 2.0 reference manual. http://www.pdl.cmu.edu/DiskSim/disksim2.0.html.
• 17: Chris Gniady , Y Charlie Hu , Yung-Hsiang Lu, Program Counter Based Techniques for Dynamic Power Management, Proceedings of the 10th International Symposium on High Performance Computer Architecture, p.24, February 14-18, 2004 [doi>10.1109/HPCA.2004.10021]
• 18: R. Golding, P. Bosch, C. Staelin, T. Sullivan, and J. Wilkes. Idleness is not sloth. In Proc. of the USENIX Winter Technical Conference, Jan. 1995.
• 19: Sudhanva Gurumurthi , Anand Sivasubramaniam , Mahmut Kandemir , Hubertus Franke, DRPM: dynamic speed control for power management in server class disks, Proceedings of the 30th annual international symposium on Computer architecture, June 09-11, 2003, San Diego, California
• 20: David P. Helmbold , Darrell D. E. Long , Tracey L. Sconyers , Bruce Sherrod, Adaptive disk spin—down for mobile computers, Mobile Networks and Applications, v.5 n.4, p.285-297, Dec. 2000 [doi>10.1023/A:1019129116852]
• 21: Ultrastar 36Z15 D atasheet. http://www.hitachigst.com/hdd/ultra/ul36z15.htm, Jan. 2003.
• 22: D. Li, P. Gu, H. Cai, and J. Wang. EERAID: energy-efficient redundant and inexpensive disk array. The 11th ACM SIGOPS European Workshop, Sept. 2004.
• 23: Xiaodong Li , Zhenmin Li , Francis David , Pin Zhou , Yuanyuan Zhou , Sarita Adve , Sanjeev Kumar, Performance directed energy management for main memory and disks, Proceedings of the 11th international conference on Architectural support for programming languages and operating systems, October 07-13, 2004, Boston, MA, USA
• 24: C. Lumb, J. Schindler, G. Ganger, D. Nagle, and E. Riedel. Towards higher disk head utilization: Extracting "free" bandwidth from busy disk drives. In Proc. of the Fourth USENIX Symposium on Operating Systems Design and Implementation, Oct. 2000.
• 25: Grigorios Magklis , Michael L. Scott , Greg Semeraro , David H. Albonesi , Steven Dropsho, Profile-based dynamic voltage and frequency scaling for a multiple clock domain microprocessor, ACM SIGARCH Computer Architecture News, v.31 n.2, May 2003
• 26: Philip S. Yu , Arif Merchant, Analytic Modeling and Comparisons of Striping Strategies for Replicated Disk Arrays, IEEE Transactions on Computers, v.44 n.3, p.419-433, March 1995 [doi>10.1109/12.372034]
• 27: B. Moore. Take the data center power and cooling challenge. Energy User News, August 27 2002.
• 28: F. Moore. More power needed. Energy User News, 2002.
• 29: K. Okada, N. Kojima, and K. Yamashita. A novel drive architecture of HDD : multimode hard disc drive. In Proc. of the International Conference on Consumer Electronics, 2000.
• 30: A. E. Papathanasiou and M. L. Scott. Energy efficient prefetching and caching. In Proc. of the USENIX Annual Technical Conference, June 2004.
• 31: David A. Patterson , Garth Gibson , Randy H. Katz, A case for redundant arrays of inexpensive disks (RAID), Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.109-116, June 01-03, 1988, Chicago, Illinois, United States
• 32: Eduardo Pinheiro , Ricardo Bianchini, Energy conservation techniques for disk array-based servers, Proceedings of the 18th annual international conference on Supercomputing, June 26-July 01, 2004, Malo, France [doi>10.1145/1006209.1006220]
• 33: P. Ranganathan. The power management challenge: Getting the next 100x. Keynote presentation at the 2nd workshop on optimizations for DSPs and Embedded Systems, March 12 2004.
• 34: C. Ruemmler and J. Wilkes. UNIX disk access patterns. In Proc. of the USENIX Winter Technical Conference, 1993.
• 35: S. Savage and J. Wilkes. AFRAID -- a frequently redundant array of independent disks. In USENIX Annual Technical Conference, pages 27--39, 1996.
• 36: Elizabeth Shriver , Arif Merchant , John Wilkes, An analytic behavior model for disk drives with readahead caches and request reordering, Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, p.182-191, June 22-26, 1998, Madison, Wisconsin, United States
• 37: S. W. Son , G. Chen , M. Kandemir, Disk layout optimization for reducing energy consumption, Proceedings of the 19th annual international conference on Supercomputing, June 20-22, 2005, Cambridge, Massachusetts [doi>10.1145/1088149.1088186]
• 38: Gerhard Weikum , Peter Zabback , Peter Scheuermann, Dynamic file allocation in disk arrays, Proceedings of the 1991 ACM SIGMOD international conference on Management of data, p.406-415, May 29-31, 1991, Denver, Colorado, United States
• 39: Andreas Weissel , Björn Beutel , Frank Bellosa, Cooperative I/O: a novel I/O semantics for energy-aware applications, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060301]
• 40: John Wilkes , Richard Golding , Carl Staelin , Tim Sullivan, The HP AutoRAID hierarchical storage system, ACM Transactions on Computer Systems (TOCS), v.14 n.1, p.108-136, Feb. 1996 [doi>10.1145/225535.225539]
• 41: E. Wusterenhoff. Service level agreement in the data center. http://www.sun.com/blueprints/0402/sla.pdf, Apr. 2002.
• 42: H. Yada, H. Ishioka, T. Yamakoshi, Y. Onuki, Y. Shimano, M. Uchida, H. Kanno, and N. Hayashi. Head positioning servo and data channel for HDD s with multiple spindle speeds. IEEE Transactions on Magnetics, 36(5):2213--2215, Sept. 2000.
• 43: Yuanyuan Zhou , Angelos Bilas , Suresh Jagannathan , Cezary Dubnicki , James F. Philbin , Kai Li, Experiences with VI communication for database storage, Proceedings of the 29th annual international symposium on Computer architecture, p.257, May 25-29, 2002, Anchorage, Alaska
• 44: Qingbo Zhu , Yuanyuan Zhou, Power-Aware Storage Cache Management, IEEE Transactions on Computers, v.54 n.5, p.587-602, May 2005 [doi>10.1109/TC.2005.82]

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS

General Terms:
Algorithms, Experimentation, Management, Performance

Keywords:
disk array, disk layout, energy management, performance guarantee, storage system