Multi-tenant databases for software as a service: schema-mapping techniques

ABSTRACT

In the implementation of hosted business services, multiple tenants are often consolidated into the same database to reduce total cost of ownership. Common practice is to map multiple single-tenant logical schemas in the application to one multi-tenant physical schema in the database. Such mappings are challenging to create because enterprise applications allow tenants to extend the base schema, e.g., for vertical industries or geographic regions. Assuming the workload stays within bounds, the fundamental limitation on scalability for this approach is the number of tables the database can handle. To get good consolidation, certain tables must be shared among tenants and certain tables must be mapped into fixed generic structures such as Universal and Pivot Tables, which can degrade performance.

This paper describes a new schema-mapping technique for multi-tenancy called Chunk Folding, where the logical tables are vertically partitioned into chunks that are folded together into different physical multi-tenant tables and joined as needed. The database's "meta-data budget" is divided between application-specific conventional tables and a large fixed set of generic structures called Chunk Tables. Good performance is obtained by mapping the most heavily-utilized parts of the logical schemas into the conventional tables and the remaining parts into Chunk Tables that match their structure as closely as possible. We present the re sults of several experiments designed to measure the efficacy of Chunk Folding and describe the multi-tenant database testbed in which these experiments were performed.

REFERENCES

• 1: Daniel J. Abadi , Adam Marcus , Samuel R. Madden , Kate Hollenbach, Scalable semantic web data management using vertical partitioning, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
• 2: Rakesh Agrawal , Amit Somani , Yirong Xu, Storage and Querying of E-Commerce Data, Proceedings of the 27th International Conference on Very Large Data Bases, p.149-158, September 11-14, 2001
• 3: Jennifer L. Beckmann , Alan Halverson , Rajasekar Krishnamurthy , Jeffrey F. Naughton, Extending RDBMSs To Support Sparse Datasets Using An Interpreted Attribute Storage Format, Proceedings of the 22nd International Conference on Data Engineering, p.58, April 03-07, 2006 [doi>10.1109/ICDE.2006.67]
• 4: P. A. Boncz. Monet: A Next-Generation DBMS Kernel For Query-Intensive Applications. Ph.D. Thesis, Universiteit van Amsterdam, Amsterdam, The Netherlands, May 2002.
• 5: B. Burtin and S. Dietzen (Zimbra Inc., Sunnyvale, CA, USA). Personal communication, 2007.
• 6: conject.com. http://www.conject.com/.
• 7: George P. Copeland , Setrag N. Khoshafian, A decomposition storage model, Proceedings of the 1985 ACM SIGMOD international conference on Management of data, p.268-279, May 1985, Austin, Texas, United States
• 8: Conor Cunningham , César A. Galindo-Legaria , Goetz Graefe, PIVOT and UNPIVOT: optimization and execution strategies in an RDBMS, Proceedings of the Thirtieth international conference on Very large data bases, p.998-1009, August 31-September 03, 2004, Toronto, Canada
• 9: Ramez Elmasri , Shamkant B. Navathe, Fundamentals of Database Systems (5th Edition), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2006
• 10: Leonidas Fegaras , David Maier, Optimizing object queries using an effective calculus, ACM Transactions on Database Systems (TODS), v.25 n.4, p.457-516, Dec. 2000 [doi>10.1145/377674.377676]
• 11: D. Florescu and D. Kossmann. A Performance Evaluation of Alternative Mapping Schemes for Storing XML Data in a Relational Database. Technical report, Inria, France, 1999.
• 12: G. Graefe. Sorting and Indexing with Partitioned B-Trees. In Proc. of the 1st Int?l Conference on Innovative Data Systems Research (CIDR), Asilomar, CA, USA, Jan. 2003.
• 13: Torsten Grust , Maurice Van Keulen , Jens Teubner, Accelerating XPath evaluation in any RDBMS, ACM Transactions on Database Systems (TODS), v.29 n.1, p.91-131, March 2004 [doi>10.1145/974750.974754]
• 14: James Hamilton, On designing and deploying internet-scale services, Proceedings of the 21st conference on Large Installation System Administration Conference, p.1-12, November 11-16, 2007, Dallas
• 15: ibm.com. http://www.ibm.com/.
• 16: D. Jacobs. Data management in application servers. In Readings in Database Systems, 4th edition. The MIT Press, 2005.
• 17: Alfons Kemper , Donald Kossmann , Florian Matthes, SAP R/3 (tutorial): a database application system, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.499, June 01-04, 1998, Seattle, Washington, United States
• 18: David Maier , Jeffrey D. Ullman, Maximal objects and the semantics of universal relation databases, ACM Transactions on Database Systems (TODS), v.8 n.1, p.1-14, March 1983 [doi>10.1145/319830.319831]
• 19: Anatomy of MySQL on the GRID. http://blog.mediatemple.net/weblog/2007/01/19/anatomy-of-mysql-on-the-grid/.
• 20: mysql.com. http://www.mysql.com/.
• 21: NetSuite NetFlex. http://www.netsuite.com/portal/products/netflex/main.shtml.
• 22: Salesforce AppExchange. http://www.salesforce.com/appexchange/about.
• 23: Mike Stonebraker , Daniel J. Abadi , Adam Batkin , Xuedong Chen , Mitch Cherniack , Miguel Ferreira , Edmond Lau , Amerson Lin , Sam Madden , Elizabeth O'Neil , Pat O'Neil , Alex Rasin , Nga Tran , Stan Zdonik, C-store: a column-oriented DBMS, Proceedings of the 31st international conference on Very large data bases, August 30-September 02, 2005, Trondheim, Norway
• 24: E. TenWolde. Worldwide Software on Demand 2007-2011 Forecast: A Preliminary Look at Delivery Model Performance, IDC No. 206240, 2007. IDC Report.
• 25: TPC-C on-line transaction processing benchmark. http://www.tpc.org/tpcc/.
• 26: WebEx. http://www.webex.com/.
• 27: Zimbra. http://www.zimbra.com/.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.1 Logical Design

General Terms:
Design, Performance

Keywords:
chunk folding, multi-tenancy, software as a service