Data analysis, visualization and knowledge discovery in sustainable data centers

ABSTRACT

A significant amount of energy consumption is now attributed to data centers due to their ever increasing numbers, size and power densities. Thus, there are efforts focused at making a data center more sustainable by reducing its energy consumption and carbon footprint. This requires an end-to-end management approach with requirements derived from service level agreements (SLAs) and a flexible infrastructure that can be closely monitored and finely controlled. The infrastructure can then be manipulated to satisfy the requirements while optimizing for sustainability metrics and total cost of operations. In this paper, we explore the role of data analysis, visualization and knowledge discovery techniques in improving the sustainability of a data center. We present use cases from a large, sensor-rich, state-of-the-art data center on the application of these techniques to the three main sub-systems of a data center, namely, power, cooling and compute. Furthermore, we provide recommendations for where these techniques can be used within these sub-systems for improving sustainability metrics of a data center.

REFERENCES

• 1: Cloud Computing, http://wikipedia.org/Cloud_computing
• 2: Software as a Service (SaaS), http://wikipedia.org/Software_as_a_service
• 3: U.S. Environmental Protection Agency, Report to Congress on Server and Data Center Energy Efficiency Public Law 109--431, Aug 2007
• 4: Patel, C. D., Bash, C. E., Sharma, R. K, Beitelmal, A, Friedrich, R. J., "smart Cooling of Datacenters", Proceedings of ASME International Electronics Packaging Technical Conference and Exhibition, Maui, HI, IPACK-03, July 2003
• 5: A. J. Shah, V. P. Carey, C. E. Bash, C. D. Patel, "Exergy Analysis of Data Center Thermal Management Systems," ASME Journal of Heat Transfer, vol. 130, no. 2, pp. 021401--10, February 2008.
• 6: C. Marnay, "Microgrids and Heterogeneous Security, Quality, Reliability, and Availability," Proc. 4th Power Conversion Conf., IEEE Press, 2007, pp. 629--634.
• 7: Cullen Bash , George Forman, Cool job allocation: measuring the power savings of placing jobs at cooling-efficient locations in the data center, 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference, p.1-6, June 17-22, 2007, Santa Clara, CA
• 8: S. Greenberg, E. Mills, B. Tschudi, P. Rumsey, and B. Myatt. Best practices for data centers: Results from benchmarking 22 data centers. In Proc. of the 2006 ACEEE Summer Study on Energy Efficiency in Buildings., Pacific Grove, CA, Aug. 2006.
• 9: Hao et. al., Interactive Poster: Visual Monitoring of Temperature Data In a Smart Data Center, IEEE VisWeek 2008.
• 10: Ratnesh K. Sharma , Rocky Shih , Cullen Bash , Chandrakant Patel , Philip Varghese , Mohandas Mekanapurath , Sankaragopal Velayudhan , Manu Kumar, V, On building next generation data centers: energy flow in the information technology stack, Proceedings of the 1st Bangalore annual Compute conference, January 18-20, 2008, Bangalore, India [doi>10.1145/1341771.1341780]
• 11: I. T. Jolliffe. Principal Component Analysis. Springer, 2002.
• 12: Spiros Papadimitriou , Jimeng Sun , Christos Faloutsos, Streaming pattern discovery in multiple time-series, Proceedings of the 31st international conference on Very large data bases, August 30-September 02, 2005, Trondheim, Norway
• 13: Luiz André Barroso , Urs Hölzle, The Case for Energy-Proportional Computing, Computer, v.40 n.12, p.33-37, December 2007 [doi>10.1109/MC.2007.443]
• 14: Yiyu Chen , Amitayu Das , Wubi Qin , Anand Sivasubramaniam , Qian Wang , Natarajan Gautam, Managing server energy and operational costs in hosting centers, Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, June 06-10, 2005, Banff, Alberta, Canada
• 15: Christopher Clark , Keir Fraser , Steven Hand , Jacob Gorm Hansen , Eric Jul , Christian Limpach , Ian Pratt , Andrew Warfield, Live migration of virtual machines, Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, p.273-286, May 02-04, 2005
• 16: James Aweya , Michel Ouellette , Delfin Y. Montuno , Bernard Doray , Kent Felske, An adaptive load balancing scheme for web servers, International Journal of Network Management, v.12 n.1, p.3-39, January/February 2002 [doi>10.1002/nem.421]
• 17: N. Tolia, Z. Wang, M. Marwah, C. Bash, P. Ranganathan, and X. Zhu. Zephyr: a unified predictive approach to improve server cooling and power efficiency. Technical Report HPL-2008-107, HP Laboratories, Palo Alto, CA, 2008.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Additional Classification:
  B. Hardware
  B.8 Performance and Reliability

  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

General Terms:
Design, Economics, Management, Measurement, Reliability, Verification

Keywords:
compute, cooling, data analysis, data centers, knowledge discovery, power, sustainability, visualization