Testing microsoft SQL server analysis services

ABSTRACT

In this paper, we describe the current techniques used in testing SQL Server Analysis Services, the challenges we face, and techniques we are currently looking into to improve the testing of SQL Server Analysis Services both in functionality as well as performance.

REFERENCES

• 1: Florian Haftmann , Donald Kossmann , Eric Lo, A framework for efficient regression tests on database applications, The VLDB Journal — The International Journal on Very Large Data Bases, v.16 n.1, p.145-164, January 2007 [doi>10.1007/s00778-006-0028-8]
• 2: Ramzi A. Haraty , Nash'at Mansour , Bassel Daou, Regression testing of database applications, Proceedings of the 2001 ACM symposium on Applied computing, p.285-289, March 2001, Las Vegas, Nevada, United States [doi>10.1145/372202.372342]
• 3: Harinath, S., Quinn, S. R. Professional SQL Server 2005 with MDX, Wrox Publications, 2006.
• 4: Cem Kaner , Hung Q. Nguyen , Jack L. Falk, Testing Computer Software, John Wiley & Sons, Inc., New York, NY, 1993
• 5: Gregory M. Kapfhammer , Mary Lou Soffa, A family of test adequacy criteria for database-driven applications, ACM SIGSOFT Software Engineering Notes, v.28 n.5, September 2003
• 6: Edward Melomed , Irina Gorbach , Alexander Berger , Py Bateman, Microsoft SQL Server 2005 Analysis Services (SQL Server Series), Sams, Indianapolis, IN, 2006
• 7: George Spofford , Sivakumar Harinath , Christopher Webb , Francesco Civardi, MDX Solutions: with Microsoft SQL Server Analysis Services 2005 and Hyperion Essbase, John Wiley & Sons, Inc., New York, NY, 2005
• 8: María José Suárez-Cabal , Javier Tuya, Using an SQL coverage measurement for testing database applications, ACM SIGSOFT Software Engineering Notes, v.29 n.6, November 2004
• 9: SQL Server 2005 Books Online, http://msdn2.microsoft.com/en-us/library/ms130214.aspx.
• 10: Zhao Hui Tang , Jamie MacLennan, Data Mining with SQL Server 2005, John Wiley & Sons, 2005
• 11: The OLAP Report, http://www.olapreport.com.
• 12: Transaction Processing Performance Council, http://www.tpc.org
• 13: XMLA 1.1 specification, http://www.xmla.org.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Correctness proofs

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Validation; Formal methods
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing); Monitors; Tracing; Debugging aids

General Terms:
Algorithms, Design, Experimentation, Languages, Measurement, Performance, Reliability, Verification

Keywords:
MDX, SQL server analysis services, calculations, formula engine, storage engine