Storage modeling for power estimation

ABSTRACT

Power consumption is a major issue in today's datacenters. Storage typically comprises a significant percentage of datacenter power. Thus, understanding, managing, and reducing storage power consumption is an essential aspect of any efforts that address the total power consumption of datacenters. We developed a scalable power modeling method that estimates the power consumption of storage workloads. The modeling concept is based on identifying the major workload contributors to the power consumed by the disk arrays.

To estimate the power consumed by a given host workload, our method translates the workload to the primitive activities induced on the disks. In addition, we identified that I/O queues have a fundamental influence on the power consumption. Our power estimation results are highly accurate, with only 2% deviation for typical random workloads with small transfer sizes (up to 8K), and a deviation of up to 8% for workloads with large transfer sizes. We successfully integrated our modeling into a power-aware capacity planning tool to predict system power requirements and integrated it into an online storage system to provide online estimation for the power consumed.

REFERENCES

• 1: Copan, Systems. http://www.copansys.com/.
• 2: Iometer, performance analysis tool. http://www.iometer.org/.
• 3: EPA Report to Congress on Server and Data Center Energy Efficiency, Public Law 109--431, 2007.
• 4: T. Bisson, S. A. Brandt, and D. D. E. Long. A hybrid disk-aware spin-down algorithm with i/o subsystem support. In IPCCC, 2007.
• 5: Enrique V. Carrera , Eduardo Pinheiro , Ricardo Bianchini, Conserving disk energy in network servers, Proceedings of the 17th annual international conference on Supercomputing, June 23-26, 2003, San Francisco, CA, USA [doi>10.1145/782814.782829]
• 6: Dennis Colarelli , Dirk Grunwald, Massive arrays of idle disks for storage archives, Proceedings of the 2002 ACM/IEEE conference on Supercomputing, p.1-11, November 16, 2002, Baltimore, Maryland
• 7: G. Ganger, B. Worthington, and Y. Patt. The DiskSim Simulation Environment Version 2.0 Reference Manual, December 1999.
• 8: A. Hylick, R. Sohan, A. Rice, and B. Jones. An analysis of hard drive energy consumption. In MASCOTS, pages 103--112. IEEE Computer Society, 2008.
• 9: Dushyanth Narayanan , Austin Donnelly , Antony Rowstron, Write off-loading: practical power management for enterprise storage, Proceedings of the 6th USENIX Conference on File and Storage Technologies, p.1-15, February 26-29, 2008, San Jose, California
• 10: Daniel Peek , Jason Flinn, Drive-Thru: fast, accurate evaluation of storage power management, Proceedings of the annual conference on USENIX Annual Technical Conference, p.30-30, April 10-15, 2005, Anaheim, CA
• 11: Eduardo Pinheiro , Ricardo Bianchini, Energy conservation techniques for disk array-based servers, Proceedings of the 18th annual international conference on Supercomputing, June 26-July 01, 2004, Malo, France [doi>10.1145/1006209.1006220]
• 12: Eduardo Pinheiro , Ricardo Bianchini , Cezary Dubnicki, Exploiting redundancy to conserve energy in storage systems, ACM SIGMETRICS Performance Evaluation Review, v.34 n.1, June 2006
• 13: G. Schulz. Storage power and cooling issues heat up. 2007.
• 14: Jan Stoess , Christian Lang , Frank Bellosa, Energy management for hypervisor-based virtual machines, 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference, p.1-14, June 17-22, 2007, Santa Clara, CA
• 15: Charles Weddle , Mathew Oldham , Jin Qian , An-I Andy Wang , Peter Reiher , Geoff Kuenning, PARAID: A gear-shifting power-aware RAID, ACM Transactions on Storage (TOS), v.3 n.3, p.13-es, October 2007 [doi>10.1145/1289720.1289721]
• 16: John Zedlewski , Sumeet Sobti , Nitin Garg , Fengzhou Zheng , Arvind Krishnamurthy , Randolph Wang, Modeling Hard-Disk Power Consumption, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
• 17: Yan Zhang , Sudhanva Gurumurthi , Mircea R Stan, SODA: sensitivity based optimization of disk architecture, Proceedings of the 44th annual Design Automation Conference, June 04-08, 2007, San Diego, California [doi>10.1145/1278480.1278694]
• 18: Qingbo Zhu , Zhifeng Chen , Lin Tan , Yuanyuan Zhou , Kimberly Keeton , John Wilkes, Hibernator: helping disk arrays sleep through the winter, Proceedings of the twentieth ACM symposium on Operating systems principles, October 23-26, 2005, Brighton, United Kingdom
• 19: Qingbo Zhu , Francis M. David , Christo F. Devaraj , Zhenmin Li , Yuanyuan Zhou , Pei Cao, Reducing Energy Consumption of Disk Storage Using Power-Aware Cache Management, Proceedings of the 10th International Symposium on High Performance Computer Architecture, p.118, February 14-18, 2004 [doi>10.1109/HPCA.2004.10022]
• 20: Qingbo Zhu , Yuanyuan Zhou, Power-Aware Storage Cache Management, IEEE Transactions on Computers, v.54 n.5, p.587-602, May 2005 [doi>10.1109/TC.2005.82]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

General Terms:
Experimentation, Management, Measurement, Performance

Keywords:
modeling, power, storage