Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Virtual machine (VM) technology enables multiple VMs to share resources on the same host. Resources allocated to the VMs should be re-configured dynamically in response to the change of application demands or resource supply. Because VM execution involves privileged domain and VM monitor, this causes uncertainties in VMs' resource to performance mapping and poses challenges in online determination of appropriate VM configurations. In this paper, we propose a reinforcement learning (RL) based approach, namely VCONF, to automate the VM configuration process. VCONF employs model-based RL algorithms to address the scalability and adaptability issues in applying RL in systems management. Experimental results on both controlled environments and a testbed of clouds with Xen VMs and representative server workloads demonstrate the effectiveness of VCONF. The approach is able to find optimal (near optimal) configurations in small scale systems and shows good adaptability and scalability.

REFERENCES

• 1: http://www.research.ibm.com/autonomic.
• 2: C. G. Atkesonand J. C. Santamar'ia. A comparison of direct and model-based reinforcement learning. In In ICRA 1997.
• 3: Paul Barham , Boris Dragovic , Keir Fraser , Steven Hand , Tim Harris , Alex Ho , Rolf Neugebauer , Ian Pratt , Andrew Warfield, Xen and the art of virtualization, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA [doi>10.1145/945445.945462]
• 4: X. Bu, J. Rao, C. -Z. Xu. A reinforcement learning approach to online web systems auto-configuration. In ICDCS 2009.
• 5: George Candea , Emre Kiciman , Shinichi Kawamoto , Armando Fox, Autonomous recovery in componentized Internet applications, Cluster Computing, v.9 n.2, p.175-190, April 2006 [doi>10.1007/s10586-006-7562-4]
• 6: J. P. Cassaza, M. Greenfield, and K. shi. Redefining server performance characterization for virtualization benchmarking. In Intel technology Journal 2006.
• 7: Christopher Clark , Keir Fraser , Steven Hand , Jacob Gorm Hansen , Eric Jul , Christian Limpach , Ian Pratt , Andrew Warfield, Live migration of virtual machines, Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, p.273-286, May 02-04, 2005
• 8: Ira Cohen , Steve Zhang , Moises Goldszmidt , Julie Symons , Terence Kelly , Armando Fox, Capturing, indexing, clustering, and retrieving system history, Proceedings of the twentieth ACM symposium on Operating systems principles, October 23-26, 2005, Brighton, United Kingdom [doi>10.1145/1095810.1095821]
• 9: Diwaker Gupta , Ludmila Cherkasova , Rob Gardner , Amin Vahdat, Enforcing performance isolation across virtual machines in Xen, Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, November 01-01, 2006, Melbourne, Australia
• 10: Hyper-V server. http://www.microsoft.com/servers/hyper-v-server.
• 11: Engin Ipek , Onur Mutlu , José F. Martínez , Rich Caruana, Self-Optimizing Memory Controllers: A Reinforcement Learning Approach, Proceedings of the 35th International Symposium on Computer Architecture, p.39-50, June 21-25, 2008 [doi>10.1109/ISCA.2008.21]
• 12: A. Kamra, V. Misra, and E. M. Nahum. Yaksha:a self-tuning controller for managing the performance of 3-tiered web sites. In IWQoS 2004.
• 13: M. Karlsson, C. T. Karamanolis, and X. Zhu. Triage: performance isolation and differentiation for storage systems. In IWQoS 2004.
• 14: X. Liu, L. Sha, Y. Diao, S. Froehlich, J. L. Hellerstein, and S. S. Parekh. Online response time optimization of apache web server. In IWQoS 2003.
• 15: Diego Ongaro , Alan L. Cox , Scott Rixner, Scheduling I/O in virtual machine monitors, Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, March 05-07, 2008, Seattle, WA, USA [doi>10.1145/1346256.1346258]
• 16: Pradeep Padala , Kang G. Shin , Xiaoyun Zhu , Mustafa Uysal , Zhikui Wang , Sharad Singhal , Arif Merchant , Kenneth Salem, Adaptive control of virtualized resources in utility computing environments, Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, March 21-23, 2007, Lisbon, Portugal [doi>10.1145/1272996.1273026]
• 17: Jia Rao , Cheng-Zhong Xu, Online Measurement of the Capacity of Multi-Tier Websites Using Hardware Performance Counters, Proceedings of the 2008 The 28th International Conference on Distributed Computing Systems, p.705-712, June 17-20, 2008 [doi>10.1109/ICDCS.2008.97]
• 18: Ahmed A. Soror , Umar Farooq Minhas , Ashraf Aboulnaga , Kenneth Salem , Peter Kokosielis , Sunil Kamath, Automatic virtual machine configuration for database workloads, Proceedings of the 2008 ACM SIGMOD international conference on Management of data, June 09-12, 2008, Vancouver, Canada [doi>10.1145/1376616.1376711]
• 19: Ya-Yunn Su , Mona Attariyan , Jason Flinn, AutoBash: improving configuration management with operating system causality analysis, Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, October 14-17, 2007, Stevenson, Washington, USA [doi>10.1145/1294261.1294284]
• 20: R. S. Sutton. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In Advances in Neural Information Processing Systems 1996.
• 21: Richard S. Sutton , Andrew G. Barto, Introduction to Reinforcement Learning, MIT Press, Cambridge, MA, 1998
• 22: G. Tesauro. Online resource allocation using decompositional reinforcement learning. In AAAI 2005.
• 23: G. Tesauro, R. Das, H. Chan, J. Kephart, D. Levine, F. Rawson, and C. Lefurgy. Managing power consumption and performance of computing systems using reinforcement learning. In Advances in Neural Information Processing Systems 2007.
• 24: Gerald Tesauro , Nicholas K. Jong , Rajarshi Das , Mohamed N. Bennani, On the use of hybrid reinforcement learning for autonomic resource allocation, Cluster Computing, v.10 n.3, p.287-299, September 2007 [doi>10.1007/s10586-007-0035-6]
• 25: The SPECweb benchmark. http://www.spec.org/web2005.
• 26: http://www.tpc.org/tpcw.
• 27: http://www.tpc.org/tpcc.
• 28: VMware. http://www.vmware.com.
• 29: VMware VMmark. http://www.vmware.com/products/vmmark.
• 30: J. Wei and C.-Z. Xu. A self-tuning fuzzy control approach for end-to-end qos guarantees in web servers. In IWQoS 2005.
• 31: Andrew Whitaker , Richard S. Cox , Steven D. Gribble, Configuration debugging as search: finding the needle in the haystack, Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, p.6-6, December 06-08, 2004, San Francisco, CA
• 32: Jonathan Wildstrom , Peter Stone , Emmett Witchel, CARVE: A Cognitive Agent for Resource Value Estimation, Proceedings of the 2008 International Conference on Autonomic Computing, p.182-191, June 02-06, 2008 [doi>10.1109/ICAC.2008.27]
• 33: Steve Zhang , Ira Cohen , Julie Symons , Armando Fox, Ensembles of Models for Automated Diagnosis of System Performance Problems, Proceedings of the 2005 International Conference on Dependable Systems and Networks, p.644-653, June 28-July 01, 2005 [doi>10.1109/DSN.2005.44]

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.8 Performance
          Subjects: Measurements

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.8 Performance
          Subjects: Modeling and prediction

General Terms:
Management, Measurement, Performance

Keywords:
autonomic computing, cloud computing, reinforcement learning, virtual machines