|
 ABSTRACT
Virtual Machine (VM) environments (e.g., VMware and Xen) are experiencing a resurgence of interest for diverse uses including server consolidation and shared hosting. An application's performance in a virtual machine environment can differ markedly from its performance in a non-virtualized environment because of interactions with the underlying virtual machine monitor and other virtual machines. However, few tools are currently available to help debug performance problems in virtual machine environments.In this paper, we present Xenoprof, a system-wide statistical profiling toolkit implemented for the Xen virtual machine environment. The toolkit enables coordinated profiling of multiple VMs in a system to obtain the distribution of hardware events such as clock cycles and cache and TLB misses. The toolkit will facilitate a better understanding of performance characteristics of Xen's mechanisms allowing the community to optimize the Xen implementation.We use our toolkit to analyze performance overheads incurred by networking applications running in Xen VMs. We focus on networking applications since virtualizing network I/O devices is relatively expensive. Our experimental results quantify Xen's performance overheads for network I/O device virtualization in uni- and multi-processor systems. With certain Xen configurations, networking workloads in the Xen environment can suffer significant performance degradation. Our results identify the main sources of this overhead which should be the focus of Xen optimization efforts. We also show how our profiling toolkit was used to uncover and resolve performance bugs that we encountered in our experiments which caused unexpected application behavior.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
Oprofile. http://oprofile.sourceforge.net.
|
| |
2
|
TTCP Benchmarking Tool. http://www.pcusa.com/Utilities/pcattcp.htm.
|
| |
3
|
The VTune™ Performance Analyzers. http://www.intel.com/software/products/vtune.
|
 |
4
|
Paul Barham , Boris Dragovic , Keir Fraser , Steven Hand , Tim Harris , Alex Ho , Rolf Neugebauer , Ian Pratt , Andrew Warfield, Xen and the art of virtualization, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
|
| |
5
|
S. Browne , J. Dongarra , N. Garner , K. London , P. Mucci, A scalable cross-platform infrastructure for application performance tuning using hardware counters, Proceedings of the 2000 ACM/IEEE conference on Supercomputing (CDROM), p.42-es, November 04-10, 2000, Dallas, Texas, United States
|
| |
6
|
L. Cherkasova and R. Gardner. Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In USENIX Annual Technical Conference, Apr 2005.
|
| |
7
|
S. Devine, E. Bugnion, and M. Rosenblum. Virtualization system including a virtual machine monitor for a computer with a segmented architecture. Technical Report US Patent 6397242, vmware, Oct 1998.
|
| |
8
|
S. Eranian. The perfmon2 interface specification. Technical Report HPL-2004-200(R.1), HP Labs, Feb 2005.
|
| |
9
|
K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. Warfield, and M. Williamson. Reconstructing I/O. Technical Report UCAM-CL-TR-596, Cambridge University, Aug 2004.
|
| |
10
|
K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. Warfield, and M. Williamson. Safe hardware access with the Xen virtual machine monitor. In 1st Workshop on Operating System and Architectural Support for the on demand IT InfraStructure (OASIS), Oct 2004.
|
| |
11
|
Matthias Hauswirth , Peter F. Sweeney , Amer Diwan , Michael Hind, Vertical profiling: understanding the behavior of object-priented applications, Proceedings of the 19th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, October 24-28, 2004, Vancouver, BC, Canada
|
| |
12
|
Hewlett-Packard. The Caliper performance analyzer. http://www.hp.com/go/caliper.
|
| |
13
|
Intel. Vanderpool technology. http://www.intel.com/technology/computing/vptech/.
|
| |
14
|
J. LeVasseur, V. Uhlig, J. Stoess, and S. Gotz. Unmodified device driver reuse and improved system dependability via virtual machines. In Operating Systems Design and Implementation (OSDI), Dec 2004.
|
| |
15
|
D. Magenheimer and T. Christian. vBlades: Optimized paravirtualization for the Itanium processor family. In USENIX Virtual Machine Research and Technology Symposium (VM), May 2004.
|
| |
16
|
B. Miller. Paradyn parallel performance tools. http://www.paradyn.org.
|
| |
17
|
D. Mosberger and T. Jin. httperf: A tool for measuring web server performance. In First Workshop on Internet Server Performance, pages 59---67, Madison, WI, June 1998.
|
| |
18
|
M. Pettersson. The Perfctr interface. http://user.it.uu.se/mikpe/linux/perfctr.
|
| |
19
|
|
| |
20
|
P. Sweeney et al. sing hardware performance monitors to understand the behavior of Java applications. In USENIX Virtual Machine Research and Technology Symposium (VM), May 2004.
|
| |
21
|
Vijay Janapa Reddi et al. Pin: A Binary Instrumentation Tool for Computer Architecture Research and Education. In Workshop on Computer Architecture Education (WCAE), June 2004.
|
| |
22
|
Rob von Behren , Jeremy Condit , Feng Zhou , George C. Necula , Eric Brewer, Capriccio: scalable threads for internet services, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
|
| |
23
|
|
| |
24
|
A. Whitaker, R. Cox, M. Shaw, and S. Gribble. Constructing services with interposable virtual hardware. In Networked Systems Design and Implementation (NSDI), Mar 2004.
|
| |
25
|
|
CITED BY 32
|
|
Wei Huang , Jiuxing Liu , Bulent Abali , Dhabaleswar K. Panda, A case for high performance computing with virtual machines, Proceedings of the 20th annual international conference on Supercomputing, June 28-July 01, 2006, Cairns, Queensland, Australia
|
|
|
|
|
|
Feng Zhou , Jeremy Condit , Zachary Anderson , Ilya Bagrak , Rob Ennals , Matthew Harren , George Necula , Eric Brewer, SafeDrive: safe and recoverable extensions using language-based techniques, Proceedings of the 7th symposium on Operating systems design and implementation, November 06-08, 2006, Seattle, Washington
|
|
|
|
|
|
H. Andres Lagar-Cavilla , Niraj Tolia , M. Satyanarayanan , Eyal de Lara, VMM-independent graphics acceleration, Proceedings of the 3rd international conference on Virtual execution environments, June 13-15, 2007, San Diego, California, USA
|
|
|
Vineet Chadha , Ramesh Illiikkal , Ravi Iyer , Jaideep Moses , Donald Newell , Renato J. Figueiredo, I/O processing in a virtualized platform: a simulation-driven approach, Proceedings of the 3rd international conference on Virtual execution environments, June 13-15, 2007, San Diego, California, USA
|
|
|
|
|
|
Padma Apparao , Ravi Iyer , Xiaomin Zhang , Don Newell , Tom Adelmeyer, Characterization & analysis of a server consolidation benchmark, Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, March 05-07, 2008, Seattle, WA, USA
|
|
|
|
|
|
|
|
|
|
|
|
Anand Tikotekar , Hong Ong , Sadaf Alam , Geoffroy Vallée , Thomas Naughton , Christian Engelmann , Stephen L. Scott, Performance comparison of two virtual machine scenarios using an HPC application: a case study using molecular dynamics simulations, Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing, p.33-40, March 31-31, 2009, Nuremburg, Germany
|
|
|
Kangho Kim , Cheiyol Kim , Sung-In Jung , Hyun-Sup Shin , Jin-Soo Kim, Inter-domain socket communications supporting high performance and full binary compatibility on Xen, Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, March 05-07, 2008, Seattle, WA, USA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Anand Tikotekar , Geoffroy Vallée , Thomas Naughton , Hong Ong , Christian Engelmann , Stephen L. Scott , Anthony M. Filippi, Effects of virtualization on a scientific application running a hyperspectral radiative transfer code on virtual machines, Proceedings of the 2nd workshop on System-level virtualization for high performance computing, p.16-23, March 31-31, 2008, Glasgow, Scotland
|
|
|
|
|
|
Kaushik Kumar Ram , Jose Renato Santos , Yoshio Turner , Alan L. Cox , Scott Rixner, Achieving 10 Gb/s using safe and transparent network interface virtualization, Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, March 11-13, 2009, Washington, DC, USA
|
|
|
|
|
|
|
|
|
Norbert Egi , Adam Greenhalgh , Mark Handley , Mickael Hoerdt , Felipe Huici , Laurent Mathy, Towards high performance virtual routers on commodity hardware, Proceedings of the 2008 ACM CoNEXT Conference, p.1-12, December 09-12, 2008, Madrid, Spain
|
|
|
|
|
|
|
|
|
|
|
|
Chuliang Weng , Zhigang Wang , Minglu Li , Xinda Lu, The hybrid scheduling framework for virtual machine systems, Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, March 11-13, 2009, Washington, DC, USA
|
|
|
Oreste Villa , Sriram Krishnamoorthy , Jarek Nieplocha , David M. Brown, Jr., Scalable transparent checkpoint-restart of global address space applications on virtual machines over infiniband, Proceedings of the 6th ACM conference on Computing frontiers, May 18-20, 2009, Ischia, Italy
|
|
|
Shadi Ibrahim , Hai Jin , Bin Cheng , Haijun Cao , Song Wu , Li Qi, CLOUDLET: towards mapreduce implementation on virtual machines, Proceedings of the 18th ACM international symposium on High performance distributed computing, June 11-13, 2009, Garching, Germany
|
|
|
|
|
|
Devdutt Patnaik , A. S. Krishnakumar , P. Krishnan , Navjot Singh , Shalini Yajnik, Performance implications of hosting enterprise telephony applications on virtualized multi-core platforms, Proceedings of the 3rd International Conference on Principles, Systems and Applications of IP Telecommunications, July 07-08, 2009, Atlanta, Georgia
|
|
|
|
|
Adobe Acrobat
QuickTime
Windows Media Player
Real Player
Pdf
D.4