Memory buddies

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Memory buddies: exploiting page sharing for smart colocation in virtualized data centers

Full text

Pdf (626 KB)

Source

ACM/Usenix International Conference On Virtual Execution Environments archive
Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments table of contents

Washington, DC, USA

SESSION: Migration in the data center table of contents

Pages 31-40

Year of Publication: 2009

ISBN:978-1-60558-375-4

Authors

Timothy Wood	University of Massachusetts Amherst, Amherst, MA, USA
Gabriel Tarasuk-Levin	University of Massachusetts Amherst, Amherst, MA, USA
Prashant Shenoy	University of Massachusetts Amherst, Amherst, MA, USA
Peter Desnoyers	Northeastern University, Boston, USA
Emmanuel Cecchet	University of Massachusetts Amherst, Amherst, MA, USA
Mark D. Corner	University of Massachusetts Amherst, Amherst, MA, USA

Sponsors

ACM: Association for Computing Machinery
SIGPLAN: ACM Special Interest Group on Programming Languages
SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 36, Downloads (12 Months): 225, Citation Count: 0

Additional Information:

abstract references index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1508293.1508299 What is a DOI?

ABSTRACT

Many data center virtualization solutions, such as VMware ESX, employ content-based page sharing to consolidate the resources of multiple servers. Page sharing identifies virtual machine memory pages with identical content and consolidates them into a single shared page. This technique, implemented at the host level, applies only between VMs placed on a given physical host. In a multi-server data center, opportunities for sharing may be lost because the VMs holding identical pages are resident on different hosts. In order to obtain the full benefit of content-based page sharing it is necessary to place virtual machines such that VMs with similar memory content are located on the same hosts.

In this paper we present Memory Buddies, a memory sharing-aware placement system for virtual machines. This system includes a memory fingerprinting system to efficiently determine the sharing potential among a set of VMs, and compute more efficient placements. In addition it makes use of live migration to optimize VM placement as workloads change. We have implemented a prototype Memory Buddies system with VMware ESX Server and present experimental results on our testbed, as well as an analysis of an extensive memory trace study. Evaluation of our prototype using a mix of enterprise and e-commerce applications demonstrates an increase of data center capacity (i.e. number of VMs supported) of 17%, while imposing low overhead and scaling to as many as a thousand servers.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Burton H. Bloom, Space/time trade-offs in hash coding with allowable errors, Communications of the ACM, v.13 n.7, p.422-426, July 1970 [doi>10.1145/362686.362692]
	2	Andrei Broder and Michael Mitzenmacher. Network applications of Bloom filters: A survey. Internet Mathematics, 1(4):485--509, 2003.
	3	Edouard Bugnion , Scott Devine , Mendel Rosenblum, Disco: running commodity operating systems on scalable multiprocessors, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.143-156, October 05-08, 1997, Saint Malo, France
	4	Emmanuel Cecchet , Anupam Chanda , Sameh Elnikety , Julie Marguerite , Willy Zwaenepoel, Performance comparison of middleware architectures for generating dynamic web content, Proceedings of the ACM/IFIP/USENIX 2003 International Conference on Middleware, June 16-20, 2003, Rio de Janeiro, Brazil
	5	Christopher Clark , Keir Fraser , Steven Hand , Jacob Gorm Hansen , Eric Jul , Christian Limpach , Ian Pratt , Andrew Warfield, Live migration of virtual machines, Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, p.273-286, May 02-04, 2005
	6	Laura Grit , David Irwin , Aydan Yumerefendi , Jeff Chase, Virtual Machine Hosting for Networked Clusters: Building the Foundations for "Autonomic" Orchestration, Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing, p.7, November 17-17, 2006 [doi>10.1109/VTDC.2006.17]
	7	Deke Guo, Jie Wu, Honghui Chen, and Xueshan Luo. Theory and Network Applications of Dynamic Bloom Filters. In INFOCOM, 2006.
	8	Diwaker Gupta, Sangmin Lee, Michael Vrable, Stefan Savage, Alex C. Snoeren, George Varghese, Geoffrey M. Voelker, and Amin Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. In Usenix OSDI, December 2008.
	9	Paul Hsieh. Hash functions. http://www.azillionmonkeys.com/qed/ hash.html.
	10	Navendu Jain, Michael Dahlin, and Renu Tewari. Using Bloom Filters to Refine Web Search Results. In WebDB, pages 25--30, 2005.
	11	Jacob Kloster, Jesper Kristensen, and Arne Mejlholm. On the Feasibility of Memory Sharing: Content-Based Page Sharing in the Xen Virtual Machine Monitor. Master's thesis, Department of Computer Science, Aalborg University, June 2006.
	12	Michael Kozuch , M. Satyanarayanan, Internet Suspend/Resume, Proceedings of the Fourth IEEE Workshop on Mobile Computing Systems and Applications, p.40, June 20-21, 2002
	13	Purushottam Kulkarni , Prashant Shenoy , Weibo Gong, Scalable techniques for memory-efficient CDN simulations, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775238]
	14	libvirt. The Virtualization API. http://libvirt.org.
	15	Xucheng Luo , Zhiguang Qin , Ji Geng , Jiaqing Luo, IAC: Interest-Aware Caching for Unstructured P2P, Proceedings of the Second International Conference on Semantics, Knowledge, and Grid, p.58, November 01-03, 2006 [doi>10.1109/SKG.2006.54]
	16	David Mosberger and Tai Jin. httperf: A tool for measuring web server performance. In First Workshop on Internet Server Performance, pages 59--67. ACM, June 1998.
	17	E. Nahum. Deconstructing specweb, 2002.
	18	Michael Nelson , Beng-Hong Lim , Greg Hutchins, Fast transparent migration for virtual machines, Proceedings of the annual conference on USENIX Annual Technical Conference, p.25-25, April 10-15, 2005, Anaheim, CA
	19	Michael L. Powell , Barton P. Miller, Process migration in DEMOS/MP, ACM SIGOPS Operating Systems Review, v.17 n.5, p.110-119, October 1983
	20	Apache Open For Business Project. http://ofbiz.apache.org.
	21	P. Ruth , Junghwan Rhee , Dongyan Xu , R. Kennell , S. Goasguen, Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure, Proceedings of the 2006 IEEE International Conference on Autonomic Computing, p.5-14, June 12-16, 2006 [doi>10.1109/ICAC.2006.1662376]
	22	Constantine P. Sapuntzakis , Ramesh Chandra , Ben Pfaff , Jim Chow , Monica S. Lam , Mendel Rosenblum, Optimizing the migration of virtual computers, Proceedings of the 5th symposium on Operating systems design and implementation Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060324]
	23	W. Smith. TPC--W: Benchmarking An Ecommerce Solution. http://www.tpc.org/information/other/techarticles.asp.
	24	The standard performance evaluation corporation (spec). http://www.spec.org.
	25	A. I. Sundararaj , Ashish Gupta , P. A. Dinda, Increasing application performance in virtual environments through run-time inference and adaptation, Proceedings of the High Performance Distributed Computing, 2005. HPDC-14. Proceedings. 14th IEEE International Symposium, p.47-58, July 24-27, 2005 [doi>10.1109/HPDC.2005.1520935]
	26	M. M. Theimer, K. A. L., and D. R. Cheriton. Preemptable Remote Execution Facilities for the V-System. pages 2--12, December 1985.
	27	Carl A. Waldspurger, Memory resource management in VMware ESX server, Proceedings of the 5th symposium on Operating systems design and implementation Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060307]
	28	Andrew Whitaker , Marianne Shaw , Steven D. Gribble, Scale and performance in the Denali isolation kernel, Proceedings of the 5th symposium on Operating systems design and implementation Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060308]
	29	VMware Whitepaper. Drs performance and best practices.
	30	Timothy Wood , Ludmila Cherkasova , Kivanc Ozonat , Prashant Shenoy, Profiling and modeling resource usage of virtualized applications, Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware, December 01-05, 2008, Leuven, Belgium
	31	Timothy Wood, Prashant J. Shenoy, Arun Venkataramani, and Mazin S. Yousif. Black-box and Gray-box Strategies for Virtual Machine Migration. In Networked Systems Design and Implementation (NSDI '07), 2007.