Server-storage virtualization: integration and load balancing in data centers

ABSTRACT

We describe the design of an agile data center with integrated server and storage virtualization technologies. Such data centers form a key building block for new cloud computing architectures. We also show how to leverage this integrated agility for non-disruptive load balancing in data centers across multiple resource layers - servers, switches, and storage. We propose a novel load balancing algorithm called VectorDot for handling the hierarchical and multi-dimensional resource constraints in such systems. The algorithm, inspired by the successful Toyoda method for multi-dimensional knapsacks, is the first of its kind.

We evaluate our system on a range of synthetic and real data center testbeds comprising of VMware ESX servers, IBM SAN Volume Controller, Cisco and Brocade switches. Experiments under varied conditions demonstrate the end-to-end validity of our system and the ability of VectorDot to efficiently remove overloads on server, switch and storage nodes.

REFERENCES

• 1: VMware, http://www.vmware.com/.
• 2: Paul Barham , Boris Dragovic , Keir Fraser , Steven Hand , Tim Harris , Alex Ho , Rolf Neugebauer , Ian Pratt , Andrew Warfield, Xen and the art of virtualization, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 3: Michael Nelson , Beng-Hong Lim , Greg Hutchins, Fast transparent migration for virtual machines, Proceedings of the annual conference on USENIX Annual Technical Conference, p.25-25, April 10-15, 2005, Anaheim, CA
• 4: Christopher Clark , Keir Fraser , Steven Hand , Jacob Gorm Hansen , Eric Jul , Christian Limpach , Ian Pratt , Andrew Warfield, Live migration of virtual machines, Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, p.273-286, May 02-04, 2005
• 5: "IBM Storage Virtualization: Value to you," IBM Whitepaper, May 2006.
• 6: EMC Invista, http://www.emc.com/products/software/invista/invista.jsp.
• 7: IDC, "Virtualization across the Enterprise," Nov 2006.
• 8: Tom Clark, Designing storage area networks: a practical reference for implementing Fibre Channel SANs, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 9: R. Goldberg, "Survey of virtual machine research," IEEE Computer, vol. 7, no. 6, pp. 34--45, June 1974.
• 10: Hewlett Packard Systems Insight Manager, http://h18002.www1.hp.com/products/servers/management/hpsim/index.html.
• 11: IBM TotalStorage Productivity Center, http://www-306.ibm.com/software/tivoli/products/totalstorage-data/.
• 12: DMTF Common Information Model Standards, http://www.dmtf.org/standards/cim.
• 13: Aperi Storage Management Project, http://www.eclipse.org/aperi.
• 14: VMWare Virtual Center, http://www.vmware.com/products/vi/vc/.
• 15: T. Wood, P. Shenoy, A. Venkataramani, and M. Yousif, "Black-box and Gray-box Strategies for Virtual Machine Migration," in Proceedings of Symp. on Networked Systems Design and Implementation (NSDI), 2007.
• 16: VMWare Infrastructure SDK, http://www.vmware.com/support/developer/vc-sdk/.
• 17: J. Katcher, "PostMark: A New File System Benchmark," Network Appliance Technical Report TR3022, 1997.
• 18: Y. Toyoda, "A simplified algorithm for obtaining approximate solutions to zero-one programming problems," Management Science, vol. 21, no. 12, pp. 1417--1427, 1975.
• 19: A. Freville, "The multidimensional 0--1 knapsack problem: An overview," European Journal of Operational Research, vol. 155, no. 1, pp. 1--21, 2004.
• 20: Devin Carraway, "lookbusy - A Synthetic Load Generator," http://devin.com/lookbusy.
• 21: lometer, http://www.iometer.org.
• 22: Microsoft Virtual Server, http://www.microsoft.com/windowsserversystem/virtualserver.
• 23: "VMware Infrastructure: Resource management with VMware DRS," VMware Whitepaper, 2006.
• 24: L. Grit, D. Irwin, A. Yumerefendi, and J. Chase, "Virtual machine hosting for networked clusters: Building the foundations for "autonomic" orchestration," vol. 0, p. 7, 2006.
• 25: N. Bobroff, A. Kochut, and K. Beaty, "Dynamic Placement of Virtual Machines for Managing SLA Violations," in Proceedings of the 10th IEEE Symposium on Integrated Management (IM), 2007.
• 26: A. Brinkmann, M. Heidebuer, F. M. auf der Heide, U. Rckert, K. Salzwedel, and M. Vodisek, "V:drive - costs and benefits of an out-of-band storage virtualization system," in Proceedings of the 12th NASA Goddard, 21st IEEE Conference on Mass Storage Systems and Technologies (MSST), pp. 153--157.
• 27: Christopher R. Lumb , Arif Merchant , Guillermo A. Alvarez, Façade: Virtual Storage Devices with Performance Guarantees, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
• 28: Lan Huang , Gang Peng , Tzi-cker Chiueh, Multi-dimensional storage virtualization, Proceedings of the joint international conference on Measurement and modeling of computer systems, June 10-14, 2004, New York, NY, USA
• 29: Eric Anderson , Joseph Hall , Jason D. Hartline , Michael Hobbs , Anna R. Karlin , Jared Saia , Ram Swaminathan , John Wilkes, An Experimental Study of Data Migration Algorithms, Proceedings of the 5th International Workshop on Algorithm Engineering, p.145-158, August 28-31, 2001
• 30: Chenyang Lu , Guillermo A. Alvarez , John Wilkes, Aqueduct: Online Data Migration with Performance Guarantees, Proceedings of the Conference on File and Storage Technologies, p.219-230, January 28-30, 2002
• 31: Mahesh Kallahalla , Mustafa Uysal , Ram Swaminathan , David E. Lowell , Mike Wray , Tom Christian , Nigel Edwards , Chris I. Dalton , Frederic Gittler, SoftUDC: A Software-Based Data Center for Utility Computing, Computer, v.37 n.11, p.38-46, November 2004 [doi>10.1109/MC.2004.221]
• 32: Andrew Warfield , Russ Ross , Keir Fraser , Christian Limpach , Steven Hand, Parallax: managing storage for a million machines, Proceedings of the 10th conference on Hot Topics in Operating Systems, p.4-4, June 12-15, 2005, Santa Fe, NM
• 33: Cisco, "Data Center Virtualization and Orchestration: Business and Financial Justification," July 2007.
• 34: Silvano Martello , Paolo Toth, Knapsack problems: algorithms and computer implementations, John Wiley & Sons, Inc., New York, NY, 1990
• 35: "Knapsack problem: Wikipedia," http://en.wikipedia.org/wiki/Knapsack_problem.
• 36: R. A. Golding and T. M. Wong, "Walking toward moving goalpost: agile management for evolving systems," in First Workshop on Hot Topics in Autonomic Computing, 2006.
• 37: Mengzhi Wang , Kinman Au , Anastassia Ailamaki , Anthony Brockwell , Christos Faloutsos , Gregory R. Ganger, Storage device performance prediction with CART models, ACM SIGMETRICS Performance Evaluation Review, v.32 n.1, June 2004

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.7 Database Administration
          Subjects: Data warehouse and repository

Additional Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.5 Servers

General Terms:
Design, Experimentation, Measurement, Performance