Experimental study of virtual machine migration in support of reservation of cluster resources

ABSTRACT

Virtual Machines are becoming increasingly valuable to resource consolidation and management, providing efficient and secure resource containers, along with desired application execution environments. This paper focuses on the VM-based resource reservation problem, that is, the reservations of CPU, memory and network resources for individual VM instances, as well as for VM clusters. In particular, it considers the scenario where one or several physical servers need to be vacated to start a cluster of VMs for dedicated execution of parallel jobs. VMs provide a primitive for transparently vacating workloads through migration; however, the process of migrating several VMs can be time-consuming and needs to be estimated. To achieve this goal, this paper seeks to provide a model that can characterize the VM migration process and predict its performance, based on a comprehensive experimental analysis. The results show that, given a certain VM's migration time, it is feasible to predict the time for a VM with other configurations, as well as the time for migrating a number of VMs. The paper also shows that migration of VMs in parallel results in shorter aggregate migration times, but with higher per-VM migration latencies. Experimental results also quantify the benefits of buffering the state of migrated VMs in main memory without committing to hard disks.

REFERENCES

• 1: Sumalatha Adabala , Vineet Chadha , Puneet Chawla , Renato Figueiredo , José Fortes , Ivan Krsul , Andrea Matsunaga , Mauricio Tsugawa , Jian Zhang , Ming Zhao , Liping Zhu , Xiaomin Zhu, From virtualized resources to virtual computing grids: the In-VIGO system, Future Generation Computer Systems, v.21 n.6, p.896-909, June 2005 [doi>10.1016/j.future.2003.12.021]
• 2: Paul Barham , Boris Dragovic , Keir Fraser , Steven Hand , Tim Harris , Alex Ho , Rolf Neugebauer , Ian Pratt , Andrew Warfield, Xen and the art of virtualization, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 3: B. Callaghan , B. Pawlowski , P. Staubach, NFS Version 3 Protocol Specification, RFC Editor, 1995
• 4: Christopher Clark , Keir Fraser , Steven Hand , Jacob Gorm Hansen , Eric Jul , Christian Limpach , Ian Pratt , Andrew Warfield, Live migration of virtual machines, Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, p.273-286, May 02-04, 2005
• 5: Jack Digiovanna , Loris Marchal , Prapaporn Rattanatamrong , Ming Zhao , Shalom Darmanjian , Babak Mahmoudi , Justin C. Sanchez , José C. Príncipe , Linda Hermer-Vazquez , Renato Figueiredo , José A. Fortes, Towards Real-Time Distributed Signal Modeling for Brain-Machine Interfaces, Proceedings of the 7th international conference on Computational Science, Part I: ICCS 2007, p.964-971, May 27-30, 2007, Beijing, China [doi>10.1007/978-3-540-72584-8_127]
• 6: K. Keahey , I. Foster , T. Freeman , X. Zhang, Virtual workspaces: Achieving quality of service and quality of life in the Grid, Scientific Programming, v.13 n.4, p.265-275, October 2005
• 7: David Irwin , Jeffrey Chase , Laura Grit , Aydan Yumerefendi , David Becker , Kenneth G. Yocum, Sharing networked resources with brokered leases, Proceedings of the annual conference on USENIX '06 Annual Technical Conference, p.18-18, May 30-June 03, 2006, Boston, MA
• 8: Ivan Krsul , Arijit Ganguly , Jian Zhang , Jose A. B. Fortes , Renato J. Figueiredo, VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing, Proceedings of the 2004 ACM/IEEE conference on Supercomputing, p.7, November 06-12, 2004 [doi>10.1109/SC.2004.67]
• 9: Bin Lin , Peter A. Dinda, VSched: Mixing Batch And Interactive Virtual Machines Using Periodic Real-time Scheduling, Proceedings of the 2005 ACM/IEEE conference on Supercomputing, p.8, November 12-18, 2005 [doi>10.1109/SC.2005.80]
• 10: D. Mosberger, T. Jin, "httperf: A Tool for Measuring Web Server Performance", First Workshop on Internet Server Performance, 1998.
• 11: P. Ruth, J. Rhee, D. Xu, R. Kennell, S. Goasguen, "Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure", ICAC'06.
• 12: Constantine P. Sapuntzakis , Ramesh Chandra , Ben Pfaff , Jim Chow , Monica S. Lam , Mendel Rosenblum, Optimizing the migration of virtual computers, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060324]
• 13: Borja Sotomayor , Kate Keahey , Ian Foster, Overhead Matters: A Model for Virtual Resource Management, Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing, p.5, November 17-17, 2006 [doi>10.1109/VTDC.2006.9]
• 14: Jeremy Sugerman , Ganesh Venkitachalam , Beng-Hong Lim, Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.1-14, June 25-30, 2001
• 15: Carl A. Waldspurger, Memory resource management in VMware ESX server, ACM SIGOPS Operating Systems Review, v.36 n.SI, Winter 2002 [doi>10.1145/844128.844146]
• 16: T. Wood, P. Shenoy, A. Venkataramani, M. Yousif, "Black-box and Gray-box Strategies for Virtual Machine Migration", NSDI, 2007.
• 17: Jing Xu , Ming Zhao , Jose Fortes , Robert Carpenter , Mazin Yousif, On the Use of Fuzzy Modeling in Virtualized Data Center Management, Proceedings of the Fourth International Conference on Autonomic Computing, p.25, June 11-15, 2007 [doi>10.1109/ICAC.2007.28]
• 18: Michael Nelson , Beng-Hong Lim , Greg Hutchins, Fast transparent migration for virtual machines, Proceedings of the annual conference on USENIX Annual Technical Conference, p.25-25, April 10-15, 2005, Anaheim, CA
• 19: P. Rundberg, F. Warg, "The FreeBench v1.0 Benchmark Suite". URL: http://www.freebench.org