Sustainable operation and management of data center chillers using temporal data mining

ABSTRACT

Motivation: Data centers are a critical component of modern IT infrastructure but are also among the worst environmental offenders through their increasing energy usage and the resulting large carbon footprints. Efficient management of data centers, including power management, networking, and cooling infrastructure, is hence crucial to sustainability. In the absence of a 'first-principles' approach to manage these complex components and their interactions, data-driven approaches have become attractive and tenable.

Results: We present a temporal data mining solution to model and optimize performance of data center chillers, a key component of the cooling infrastructure. It helps bridge raw, numeric, time-series information from sensor streams toward higher level characterizations of chiller behavior, suitable for a data center engineer. To aid in this transduction, temporal data streams are first encoded into a symbolic representation, next run-length encoded segments are mined to form frequent motifs in time series, and finally these metrics are evaluated by their contributions to sustainability. A key innovation in our application is the ability to intersperse "don't care" transitions (e.g., transients) in continuous-valued time series data, an advantage we inherit by the application of frequent episode mining to symbolized representations of numeric time series. Our approach provides both qualitative and quantitative characterizations of the sensor streams to the data center engineer, to aid him in tuning chiller operating characteristics. This system is currently being prototyped for a data center managed by HP and experimental results from this application reveal the promise of our approach.

REFERENCES

• 1: L. Bautista and R. Sharma. Analysis of environmental data in datacenters. Technical report, HP Labs, 2007.
• 2: C.L. Belady. In the data center, power and cooling costs more than the IT equipment it supports. Electronics Cooling, 13(1), Feb 2007.
• 3: T. Boucher et al. Viability of Dynamic Cooling Control in a Data Center Environment, Journal of Electronic Packaging, June, 2006.
• 4: Bill Chiu , Eamonn Keogh , Stefano Lonardi, Probabilistic discovery of time series motifs, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C. [doi>10.1145/956750.956808]
• 5: Hui Ding , Goce Trajcevski , Peter Scheuermann , Xiaoyue Wang , Eamonn Keogh, Querying and mining of time series data: experimental comparison of representations and distance measures, Proceedings of the VLDB Endowment, v.1 n.2, August 2008 [doi>10.1145/1454159.1454226]
• 6: Evan Hoke , Jimeng Sun , John D. Strunk , Gregory R. Ganger , Christos Faloutsos, InteMon: continuous mining of sensor data in large-scale self-infrastructures, ACM SIGOPS Operating Systems Review, v.40 n.3, July 2006 [doi>10.1145/1151374.1151384]
• 7: Evan Hoke , Jimeng Sun , Christos Faloutsos, InteMon: intelligent system monitoring on large clusters, Proceedings of the 32nd international conference on Very large data bases, September 12-15, 2006, Seoul, Korea
• 8: Srivatsan Laxman , P. S. Sastry , K. P. Unnikrishnan, Discovering Frequent Episodes and Learning Hidden Markov Models: A Formal Connection, IEEE Transactions on Knowledge and Data Engineering, v.17 n.11, p.1505-1517, November 2005 [doi>10.1109/TKDE.2005.181]
• 9: Srivatsan Laxman , Vikram Tankasali , Ryen W. White, Stream prediction using a generative model based on frequent episodes in event sequences, Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2008, Las Vegas, Nevada, USA [doi>10.1145/1401890.1401947]
• 10: Yinglung Liang , Yanyong Zhang , Hui Xiong , Ramendra Sahoo, Failure Prediction in IBM BlueGene/L Event Logs, Proceedings of the 2007 Seventh IEEE International Conference on Data Mining, p.583-588, October 28-31, 2007 [doi>10.1109/ICDM.2007.46]
• 11: J. Lin et al. Finding motifs in time series. In Proceedings of the Second Workshop on Temporal Data Mining, pages 53--68, 2002.
• 12: Jessica Lin , Eamonn Keogh , Stefano Lonardi , Bill Chiu, A symbolic representation of time series, with implications for streaming algorithms, Proceedings of the 8th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery, June 13-13, 2003, San Diego, California [doi>10.1145/882082.882086]
• 13: Jessica Lin , Eamonn Keogh , Li Wei , Stefano Lonardi, Experiencing SAX: a novel symbolic representation of time series, Data Mining and Knowledge Discovery, v.15 n.2, p.107-144, October 2007 [doi>10.1007/s10618-007-0064-z]
• 14: S. Lohr. Demand for data puts engineers in spotlight. New York Times. Published June 17, 2008.
• 15: Heikki Mannila , Hannu Toivonen , A. Inkeri Verkamo, Discovery of Frequent Episodes in Event Sequences, Data Mining and Knowledge Discovery, v.1 n.3, p.259-289, 1997 [doi>10.1023/A:1009748302351]
• 16: M. Marwah et al. Stream mining of sensor data for anomalous behavior detection in data centers. Technical report, HP Labs, 2008.
• 17: Peter McLachlan , Tamara Munzner , Eleftherios Koutsofios , Stephen North, LiveRAC: interactive visual exploration of system management time-series data, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357286]
• 18: Spiros Papadimitriou , Jimeng Sun , Christos Faloutsos, Streaming pattern discovery in multiple time-series, Proceedings of the 31st international conference on Very large data bases, August 30-September 02, 2005, Trondheim, Norway
• 19: Pranav Patel , Eamonn Keogh , Jessica Lin , Stefano Lonardi, Mining Motifs in Massive Time Series Databases, Proceedings of the 2002 IEEE International Conference on Data Mining, p.370, December 09-12, 2002
• 20: D. Patnaik, P.S. Sastry, and K.P. Unnikrishnan. Inferring neuronal network connectivity from spike data: A temporal data mining approach. Scientific Programming, 16(1):49--77, 2008.
• 21: John F. Roddick , Myra Spiliopoulou , Daniel Lister , Aaron Ceglar, Higher order mining, ACM SIGKDD Explorations Newsletter, v.10 n.1, June 2008 [doi>10.1145/1412734.1412736]
• 22: A.J. Shah et al. Exergy analysis of data center thermal management systems. Journal of Heat Transfer, 130(2):021401, 2008.
• 23: R. Sharma et al. Application of exploratory data analysis (eda) techniques to temperature data in a conventional data center. In Proceedings of ASME IPACK'07, 2007.
• 24: Ratnesh K. Sharma , Rocky Shih , Cullen Bash , Chandrakant Patel , Philip Varghese , Mohandas Mekanapurath , Sankaragopal Velayudhan , Manu Kumar, V, On building next generation data centers: energy flow in the information technology stack, Proceedings of the 1st Bangalore annual Compute conference, January 18-20, 2008, Bangalore, India [doi>10.1145/1341771.1341780]
• 25: A. Wissner-Gross. Revealed: The environmental impact of google searches. The Sunday Times. Published Jan 11, 2009.
• 26: Xiang Xuan , Kevin Murphy, Modeling changing dependency structure in multivariate time series, Proceedings of the 24th international conference on Machine learning, p.1055-1062, June 20-24, 2007, Corvalis, Oregon [doi>10.1145/1273496.1273629]
• 27: Dragomir Yankov , Eamonn Keogh , Jose Medina , Bill Chiu , Victor Zordan, Detecting time series motifs under uniform scaling, Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, August 12-15, 2007, San Jose, California, USA [doi>10.1145/1281192.1281282]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.2 Installation Management
          Subjects: Computing equipment management

General Terms:
Algorithms, Experimentation, Management, Measurement, Reliability

Keywords:
chillers, clustering, data centers, frequent episodes, motifs, sustainability