Database replication policies for dynamic content applications

ABSTRACT

The database tier of dynamic content servers at large Internet sites is typically hosted on centralized and expensive hardware. Recently, research prototypes have proposed using database replication on commodity clusters as a more economical scaling solution. In this paper, we propose using database replication to support multiple applications on a shared cluster. Our system dynamically allocates replicas to applications in order to maintain application-level performance in response to either peak loads or failure conditions. This approach allows unifying load and fault management functionality. The main challenge in the design of our system is the lime taken to add database replicas. We present replica allocation policies that take this time delay into account and also design an efficient replica addition method that has minimal impact on other applications.We evaluate our dynamic replication system on a commodity cluster with two standard benchmarks: the TPC-W e-commerce benchmark and the RUBIS auction benchmark. Our evaluation shows that dynamic replication requires fewer resources than static partitioning or full overlap replication policies and provides over 90% latency compliance to each application under a range of load and failure scenarios.

REFERENCES

• 1: Oracle Real Application Clusters (Oracle RAC) 10g. http://www.oracle.com/technology/products/database/clustering/.
• 2: The Apache Software Foundation. http://www.apache.org/.
• 3: Amza, C., Cecchet, E., Chanda, A., Cox, A., Elnikety, S., Gil, R., Marguerite, J., Rajamani, K., and Zwaenepoel, W. Specification and implementation of dynamic web site benchmarks. In 5th IEEE Workshop on Workload Characterization (Nov. 2002).
• 4: Amza, C., Cox, A., and Zwaenepoel, W. Conflict-aware scheduling for dynamic content applications. In Proceedings of the Fifth USENIX Symposium on Internet Technologies and Systems (Mar. 2003), pp. 71--84.
• 5: Amza, C., Cox, A., and Zwaenepoel, W. Distributed versioning: Consistent replication for scaling back-end databases of dynamic content web sites. In 4th ACM/IFIP/Usenix International Middleware Conference (June 2003).
• 6: C. Amza , A. L. Cox , W. Zwaenepoel, A Comparative Evaluation of Transparent Scaling Techniques for Dynamic Content Servers, Proceedings of the 21st International Conference on Data Engineering (ICDE'05), p.230-241, April 05-08, 2005 [doi>10.1109/ICDE.2005.6]
• 7: Mohamed N. Bennani , Daniel A. Menasce, Resource Allocation for Autonomic Data Centers using Analytic Performance Models, Proceedings of the Second International Conference on Automatic Computing, p.229-240, June 13-16, 2005 [doi>10.1109/ICAC.2005.50]
• 8: Philip A. Bernstein , Vassco Hadzilacos , Nathan Goodman, Concurrency control and recovery in database systems, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1987
• 9: Cecchet, E., Marguerite, J., and Zwaenepoel, W. C-JDBC: Flexible database clustering middleware. In Proceedings of the USENIX 2004 Annual Technical Conference (Jun 2004).
• 10: James Norris , Keith Coleman , Armando Fox , George Candea, OnCall: Defeating Spikes with a Free-Market Application Cluster, Proceedings of the First International Conference on Autonomic Computing (ICAC'04), p.198-205, May 17-18, 2004
• 11: George Copeland , William Alexander , Ellen Boughter , Tom Keller, Data placement in Bubba, Proceedings of the 1988 ACM SIGMOD international conference on Management of data, p.99-108, June 01-03, 1988, Chicago, Illinois, United States
• 12: Yixin Diao , Joseph L. Hellerstein , Sujay Parekh, Optimizing Quality of Service Using Fuzzy Control, Proceedings of the 13th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management: Management Technologies for E-Commerce and E-Business Applications, p.42-53, October 21-23, 2002
• 13: Said Elnaffar , Pat Martin , Randy Horman, Automatically classifying database workloads, Proceedings of the eleventh international conference on Information and knowledge management, November 04-09, 2002, McLean, Virginia, USA [doi>10.1145/584792.584898]
• 14: Pawan Goyal , Xingang Guo , Harrick M. Vin, A hierarchial CPU scheduler for multimedia operating systems, Proceedings of the second USENIX symposium on Operating systems design and implementation, p.107-121, October 29-November 01, 1996, Seattle, Washington, United States
• 15: Anant Jhingran, Anatomy of a real E-commerce system, Proceedings of the 2000 ACM SIGMOD international conference on Management of data, p.571-572, May 15-18, 2000, Dallas, Texas, United States
• 16: Bettina Kemme , Alberto Bartoli , Özalp Babaoglu, Online Reconfiguration in Replicated Databases Based on Group Communication, Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS), p.117-130, July 01-04, 2001
• 17: Lassettre, E., Coleman, D. W., Diao, Y., Froehlich, S., Hellerstein, J. L., Hsiung, L., Mummert, T., Raghavachari, M., Parker, G., Russell, L., Surendra, M., Tseng, V., Wadia, N., and Ye, P. Dynamic surge protection: An approach to handling unexpected workload surges with resource actions that have lead times. In Proceedings of the IFIP/IEEE International Workshop on Distributed Systems: Operations and Management (DSOM) (2003), M. Brunner and A. Keller, Eds., vol. 2867 of Lecture Notes in Computer Science, Springer, pp. 82--92.
• 18: Li, B., and Nahrstedt, K. A control-based middleware framework for quality of service adaptations. IEEE Journal on Selected Areas in Communications (1999).
• 19: Martin, P., Powley, W., Li, H., and Romanufa, K. Managing database server performance to meet qos requirements in electronic commerce systems. International Journal on Digital Libraries 3 (2002), 316--324.
• 20: Microsoft Research. AutoAdmin: Self-Tuning and Self-Administering Databases. http://www.research.microsoft.com/research/dmx/AutoAdmin, 2003.
• 21: Jesús M. Milan-Franco , Ricardo Jiménez-Peris , Marta Patiño-Martínez , Bettina Kemme, Adaptive middleware for data replication, Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware, October 18-22, 2004, Toronto, Canada
• 22: MySQL. http://www.mysql.com.
• 23: PHP Hypertext Preprocessor. http://www.php.net.
• 24: Christian Plattner , Gustavo Alonso, Ganymed: scalable replication for transactional web applications, Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware, October 18-22, 2004, Toronto, Canada
• 25: Ranjan, S., Rolia, J., Fu, H., and Knightly, E. QoS-Driven Server Migration for Internet Data Centers. In 10th International Workshop on Quality of Service (May 2002).
• 26: Röhm, U., Böhm, K., Schek, H.-J., and Schuldt, H. FAS - a freshness-sensitive coordination middleware for a cluster of olap components. In Proceedings of the 28th International Conference on Very Large Databases (Aug. 2002), pp. 134--143.
• 27: Shen, K., Yang, T., Chu, L., Holliday, J. L., Kuschner, D., and Zhu, H. Neptune: Scalable replica management and programming support for cluster-based network services. In Proceedings of the Third USENIX Symposium on Internet Technologies and Systems (Mar. 2001), pp. 207--216.
• 28: David C. Steere , Ashvin Goel , Joshua Gruenberg , Dylan McNamee , Calton Pu , Jonathan Walpole, A feedback-driven proportion allocator for real-rate scheduling, Proceedings of the third symposium on Operating systems design and implementation, p.145-158, February 1999, New Orleans, Louisiana, United States
• 29: Tesauro. G., Das, R., Walsh, W. E., and Kephart, J. O. Utility-function-driven resource allocation in autonomic systems. In Proceedings of the 2nd International Conference on Autonomic Computing (ICAC) (2005), pp. 70--77.
• 30: Transaction Processing Council. http://www.tpc.org/.
• 31: Reported configurations from industry for running the TPC-W e-commerce benchmark. http://www.tpc.org/.
• 32: Bhuvan Urgaonkar , Abhishek Chandra, Dynamic Provisioning of Multi-tier Internet Applications, Proceedings of the Second International Conference on Automatic Computing, p.217-228, June 13-16, 2005 [doi>10.1109/ICAC.2005.27]
• 33: Waldspurger, C. A., and Weihl., W. E. Lottery Scheduling: Flexible Proportional-Share Resource Management. In Proceeding of the 1st USENIX Symposium on Operating Systems Design and Implementation (November. 1994).
• 34: Walsh, W. E., Tesauro, G., Kephart, J. O., and Das, R. Utility functions in autonomic systems. In In Proceedings of the 1st International Conference on Autonomic Computing (ICAC) (2004).
• 35: Welsh, M., and Culler, D. Adaptive overload control for busy internet servers. In Proceedings of the Fifth USENIX Symposium on Internet Technologies and Systems (March 2003).
• 36: Tao Zheng , Jinmei Yang , Murray Woodside , Marin Litoiu , Gabriel Iszlai, Tracking time-varying parameters in software systems with extended Kalman filters, Proceedings of the 2005 conference of the Centre for Advanced Studies on Collaborative research, p.334-345, October 17-20, 2005, Toranto, Ontario, Canada

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
  D.4 OPERATING SYSTEMS
      D.4.5 Reliability

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.8 Problem Solving, Control Methods, and Search

General Terms:
Management, Measurement, Performance, Reliability

Keywords:
adaptation, cluster, database systems, fault-tolerance