Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters

ABSTRACT

In this paper, we investigate the benefits that organisations can reap by using "Cloud Computing" providers to augment the computing capacity of their local infrastructure. We evaluate the cost of six scheduling strategies used by an organisation that operates a cluster managed by virtual machine technology and seeks to utilise resources from a remote Infrastructure as a Service (IaaS) provider to reduce the response time of its user requests. Requests for virtual machines are submitted to the organisation's cluster, but additional virtual machines are instantiated in the remote provider and added to the local cluster when there are insufficient resources to serve the users' requests. Naïve scheduling strategies can have a great impact on the amount paid by the organisation for using the remote resources, potentially increasing the overall cost with the use of IaaS. Therefore, in this work we investigate six scheduling strategies that consider the use of resources from the "Cloud", to understand how these strategies achieve a balance between performance and usage cost, and how much they improve the requests' response times.

REFERENCES

• 1: Amazon Inc. Amazon Elastic Compute Cloud (Amazon EC2). http://aws.amazon.com/ec2.
• 2: M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. Above the clouds: A Berkeley view of Cloud computing. Technical report UCB/EECS-2009-28, Electrical Engineering and Computer Sciences, University of California at Berkeley, Berkeley, USA, February 2009.
• 3: Magdalena Balazinska , Hari Balakrishnan , Mike Stonebraker, Contract-based load management in federated distributed systems, Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation, p.15-15, March 29-31, 2004, San Francisco, California
• 4: Paul Barham , Boris Dragovic , Keir Fraser , Steven Hand , Tim Harris , Alex Ho , Rolf Neugebauer , Ian Pratt , Andrew Warfield, Xen and the art of virtualization, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 5: R. Buyya and M. Murshed. GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing. Concurrency and Computation: Practice and Experience (CPE), 14(13-15):1175--1220, November-December 2002.
• 6: Jeffrey S. Chase , David E. Irwin , Laura E. Grit , Justin D. Moore , Sara E. Sprenkle, Dynamic Virtual Clusters in a Grid Site Manager, Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing, p.90, June 22-24, 2003
• 7: Thomas H. Cormen , Clifford Stein , Ronald L. Rivest , Charles E. Leiserson, Introduction to Algorithms, McGraw-Hill Higher Education, 2001
• 8: Marcos Dias de Assunção , Rajkumar Buyya , Srikumar Venugopal, InterGrid: a case for internetworking islands of Grids, Concurrency and Computation: Practice & Experience, v.20 n.8, p.997-1024, June 2008 [doi>10.1002/cpe.v20:8]
• 9: Ewa Deelman , Gurmeet Singh , Miron Livny , Bruce Berriman , John Good, The cost of doing science on the cloud: the Montage example, Proceedings of the 2008 ACM/IEEE conference on Supercomputing, November 15-21, 2008, Austin, Texas
• 10: W. Emeneker, D. Jackson, J. Butikofer, and D. Stanzione. Dynamic virtual clustering with Xen and Moab. In Frontiers of High Performance Computing and Networking with ISPA 2006, volume 4331 of LNCS, pages 440--451, Berlin/Heidelberg, November 2006. Springer.
• 11: D. England and J. B. Weissman. Costs and benefits of load sharing in the computational Grid. In 10th International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP '04), volume 3277 of LNCS, pages 160--175, New York, USA, 2004. Springer Berlin Heidelberg.
• 12: Dror G. Feitelson , Larry Rudolph , Uwe Schwiegelshohn , Kenneth C. Sevcik , Parkson Wong, Theory and Practice in Parallel Job Scheduling, Proceedings of the Job Scheduling Strategies for Parallel Processing, p.1-34, April 05, 1997
• 13: J. Fontán, T. Vázquez, L. Gonzalez, R. S. Montero, and I. M. Llorente. OpenNEbula: The open source virtual machine manager for cluster computing. In Open Source Grid and Cluster Software Conference - Book of Abstracts, San Francisco, USA, May 2008.
• 14: I. Foster , T. Freeman , K. Keahy , D. Scheftner , B. Sotomayer , X. Zhang, Virtual Clusters for Grid Communities, Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, p.513-520, May 16-19, 2006 [doi>10.1109/CCGRID.2006.108]
• 15: C. Grimme, J. Lepping, and A. Papaspyrou. Prospects of collaboration between compute providers by means of job interchange. In Job Scheduling Strategies for Parallel Processing, volume 4942 of Lecture Notes in Computer Science, pages 132--151, Berlin /Heidelberg, April 2008. Springer.
• 16: Laura Grit , David Irwin , Aydan Yumerefendi , Jeff Chase, Virtual Machine Hosting for Networked Clusters: Building the Foundations for "Autonomic" Orchestration, Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing, p.7, November 17-17, 2006 [doi>10.1109/VTDC.2006.17]
• 17: Alexandru Iosup , Dick H. J. Epema , Todd Tannenbaum , Matthew Farrellee , Miron Livny, Inter-operating grids through delegated matchmaking, Proceedings of the 2007 ACM/IEEE conference on Supercomputing, November 10-16, 2007, Reno, Nevada [doi>10.1145/1362622.1362640]
• 18: David Irwin , Jeffrey Chase , Laura Grit , Aydan Yumerefendi , David Becker , Kenneth G. Yocum, Sharing networked resources with brokered leases, Proceedings of the annual conference on USENIX '06 Annual Technical Conference, p.18-18, May 30-June 03, 2006, Boston, MA
• 19: M. Islam, P. Bala ji, P. Sadayappan, and D. K. Panda. QoPS: A QoS based scheme for parallel job scheduling. In 9th International Workshop on Job Scheduling Strategies for Paral lel Processing (JSSPP'03), volume 2862 of LNCS, pages 252--268, Seattle, WA, USA, 2003. Springer.
• 20: K. Keahey , I. Foster , T. Freeman , X. Zhang, Virtual workspaces: Achieving quality of service and quality of life in the Grid, Scientific Programming, v.13 n.4, p.265-275, October 2005
• 21: David A. Lifka, The ANL/IBM SP Scheduling System, Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing, p.295-303, April 25, 1995
• 22: Uri Lublin , Dror G. Feitelson, The workload on parallel supercomputers: modeling the characteristics of rigid jobs, Journal of Parallel and Distributed Computing, v.63 n.11, p.1105-1122, November 2003 [doi>10.1016/S0743-7315(03)00108-4]
• 23: Ruben S. Montero , Eduardo Huedo , Ignacio M. Llorente, Dynamic Deployment of Custom Execution Environments in Grids, Proceedings of the 2008 The Second International Conference on Advanced Engineering Computing and Applications in Sciences, p.33-38, September 29-October 04, 2008 [doi>10.1109/ADVCOMP.2008.8]
• 24: Ahuva W. Mu'alem , Dror G. Feitelson, Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling, IEEE Transactions on Parallel and Distributed Systems, v.12 n.6, p.529-543, June 2001 [doi>10.1109/71.932708]
• 25: D. Nurmi, R. Wolski, C. Crzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov. Eucalyptus: a technical report on an elastic utility computing architecture linking your programs to useful systems. Technical Report 2008-10, Department of Computer Science, University of California, Santa Barbara, California, USA, 2008.
• 26: Mayur R. Palankar , Adriana Iamnitchi , Matei Ripeanu , Simson Garfinkel, Amazon S3 for science grids: a viable solution?, Proceedings of the 2008 international workshop on Data-aware distributed computing, p.55-64, June 24-24, 2008, Boston, MA, USA [doi>10.1145/1383519.1383526]
• 27: Lavanya Ramakrishnan , David Irwin , Laura Grit , Aydan Yumerefendi , Adriana Iamnitchi , Jeff Chase, Toward a doctrine of containment: grid hosting with adaptive resource control, Proceedings of the 2006 ACM/IEEE conference on Supercomputing, November 11-17, 2006, Tampa, Florida [doi>10.1145/1188455.1188561]
• 28: A. Rubio-Montero, E. Huedo, R. Montero, and I. Llorente. Management of virtual machines on globus Grids using GridWay. In IEEE International Parallel and Distributed Processing Symposium (IPDPS 2007), pages 1--7, Long Beach, USA, March 2007. IEEE Computer Society.
• 29: P. Ruth, P. McGachey, and D. Xu. VioCluster: Virtualization for dynamic computational domain. In IEEE International on Cluster Computing (Cluster 2005), pages 1--10, Burlington, USA, September 2005. IEEE.
• 30: A. Shoykhet, J. Lange, and P. Dinda. Virtuoso: A system for virtual machine marketplaces. Technical Report NWU-CS-04-39, Electrical Engineering and Computer Science Department, Northwestern University, Evanston/Chicago, IL, July 2004.
• 31: Gurmeet Singh , Carl Kesselman , Ewa Deelman, Adaptive pricing for resource reservations in Shared environments, Proceedings of the 8th IEEE/ACM International Conference on Grid Computing, p.74-80, September 19-21, 2007 [doi>10.1109/GRID.2007.4354118]
• 32: Borja Sotomayor , Kate Keahey , Ian Foster, Combining batch execution and leasing using virtual machines, Proceedings of the 17th international symposium on High performance distributed computing, June 23-27, 2008, Boston, MA, USA [doi>10.1145/1383422.1383434]
• 33: Srividya Srinivasan , Rajkumar Kettimuthu , Vijay Subramani , P. Sadayappan, Selective Reservation Strategies for Backfill Job Scheduling, Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing, p.55-71, July 24, 2002
• 34: Sonesh Surana , Brighten Godfrey , Karthik Lakshminarayanan , Richard Karp , Ion Stoica, Load balancing in dynamic structured peer-to-peer systems, Performance Evaluation, v.63 n.3, p.217-240, March 2006 [doi>10.1016/j.peva.2005.01.003]
• 35: M. Tatezono, N. Maruyama, and S. Matsuoka. Making wide-area, multi-site MPI feasible using Xen VM. In Workshop on Frontiers of High Performance Computing and Networking (held with ISPA 2006), volume 4331 of LNCS, pages 387--396, Berlin/Heidelberg, 2006. Springer.
• 36: Yung-Terng Wang , R. J. T. Morris, Load Sharing in Distributed Systems, IEEE Transactions on Computers, v.34 n.3, p.204-217, March 1985 [doi>10.1109/TC.1985.1676564]
• 37: Aaron Weiss, Computing in the clouds, netWorker, v.11 n.4, p.16-25, December 2007 [doi>10.1145/1327512.1327513]
• 38: Rich Wolski , James S. Plank , John Brevik , Todd Bryan, Analyzing Market-Based Resource Allocation Strategies for the Computational Grid, International Journal of High Performance Computing Applications, v.15 n.3, p.258-281, August 2001 [doi>10.1177/109434200101500305]

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.7 Organization and Design
          Subjects: Distributed systems

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

General Terms:
Design, Management, Performance

Keywords:
cloud computing, job backfilling, load sharing, scheduling