Opening black boxes: using semantic information to combat virtual machine image sprawl

ABSTRACT

Virtual-machine images are currently distributed as disk-image files, which are files that mirror the content of physical disks. This format is convenient for the virtual machine monitors that execute these images. However, it is not well-suited for administering images because storing images as disk-image files forces administrators to maintain the software on images with the same tools that they use to maintain the software on physical machines. Already, these tools cannot cope with "physical server sprawl"; in the future, because images can be snapshotted and cloned easily, enterprises that migrate from physical machines to images will need tools that scale to cope with the larger problem of "virtual-machine image sprawl.

To address this problem, this paper proposes the Mirage image format (MIF), a new storage format that exposes the rich semantic information currently buried in disk-image files. Disk-image files contain a mapping from file name to file content (and file metadata). MIF decouples this mapping into a manifest that maps file names to content descriptors (and file metadata) and a store that holds the content. Each image has its own manifest and a store may contain content for many images. As with disk-image files, images in MIF fully encapsulate application state including all software dependences. In addition, conversion between MIF and traditional disk-image formats is easy.

This paper shows, through examples, that MIF makes some typical software management tasks--inventory control, customized deployment, and image update--faster and easier. The general technique is to operate on manifests instead of on content whenever possible. These tasks can be performed without starting images and, because manifests are simpler and orders of magnitude smaller than disk-image files, without accessing large amounts of data.

REFERENCES

• 1: Bowen Alpern , Joshua Auerbach , Vasanth Bala , Thomas Frauenhofer , Todd Mummert , Michael Pigott, PDS: a virtual execution environment for software deployment, Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments, June 11-12, 2005, Chicago, IL, USA [doi>10.1145/1064979.1065004]
• 2: M. Burgess. A tiny overview of cfengine: Convergent maintenance agent. In Proceedings of the First International Workshop on Multi-Agent and Robotic Systems (MARS/ICINCO), Barcelona, Spain, Sept. 2005.
• 3: Ramesh Chandra , Nickolai Zeldovich , Constantine Sapuntzakis , Monica S. Lam, The collective: a cache-based system management architecture, Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, p.259-272, May 02-04, 2005
• 4: Comprehensive Perl Archive Network. http://www.cpan.org/, Jan. 2008.
• 5: P. Deutsch, GZIP file format specification version 4.3, RFC Editor, 1996
• 6: Eelco Dolstra , Armijn Hemel, Purely functional system configuration management, Proceedings of the 11th USENIX workshop on Hot topics in operating systems, p.1-6, May 07-09, 2007, San Diego, CA
• 7: IBM. IBM Tivoli License Compliance Manager. http://www.ibm.com/software/tivoli/products/license-mgr/, Jan. 2008.
• 8: D. Lutterkort and M. McLouglin. Manageable virtual appliances. In Proceedings of the 2007 Ottawa Linux Symposium, pages 293--302, Ottawa, Ontario, Canada, June 2007.
• 9: moka5. Engine. http://www.moka5.com/, Jan. 2008.
• 10: Athicha Muthitacharoen , Benjie Chen , David Mazières, A low-bandwidth network file system, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 11: National Institute of Standards and Technology. FIPS PUB 180-1: Secure Hash Standard. Apr. 1995. Supersedes FIPS PUB 180 1993 May 11.
• 12: KyoungSoo Park , Sunghwan Ihm , Mic Bowman , Vivek S. Pai, Supporting practical content-addressable caching with CZIP compression, 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference, p.1-14, June 17-22, 2007, Santa Clara, CA
• 13: Ben Pfaff , Tal Garfinkel , Mendel Rosenblum, Virtualization aware file systems: getting beyond the limitations of virtual disks, Proceedings of the 3rd conference on Networked Systems Design & Implementation, p.26-26, May 08-10, 2006, San Jose, CA
• 14: Sean Quinlan , Sean Dorward, Venti: A New Approach to Archival Storage, Proceedings of the Conference on File and Storage Technologies, p.89-101, January 28-30, 2002
• 15: Reductive Labs, LLC. Puppet. http://reductivelabs.com/trac/puppet/, Jan. 2008.
• 16: rPath. rBuilder. http://www.rpath.com/rbuilder/, Jan. 2008.
• 17: Constantine Sapuntzakis , David Brumley , Ramesh Chandra , Nickolai Zeldovich , Jim Chow , Monica S. Lam , Mendel Rosenblum, Virtual Appliances for Deploying and Maintaining Software, Proceedings of the 17th USENIX conference on System administration, October 26-31, 2003, San Diego, CA
• 18: Software in the Public Interest. Debian: The universal operating system. http://www.debian.org/, Jan. 2008.
• 19: Strace, version 4.5.8. http://sourceforge.net/projects/strace/.
• 20: S. Tang, Y. Chen, and Z. Zhang. Machine bank: Own your virtual personal computer. In Proceedings of the Twenty--first IEEE International Parallel and Distributed Processing Symposium (IPDPS '07), pages 1--10, Long Beach, California, USA, Mar. 2007.
• 21: Theodore Y. Ts'o , Stephen Tweedie, Planned Extensions to the Linux Ext2/Ext3 Filesystem, Proceedings of the FREENIX Track: 2002 USENIX Annual Technical Conference, p.235-243, June 10-15, 2002
• 22: VMware. Lab Manager. http://www.vmware.com/products/labmanager/, Jan. 2008.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.2 Installation Management

Additional Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.3 Software Management

General Terms:
Management

Keywords:
deployment, installation, management, virtualization