Designing data marts for data warehouses

ABSTRACT

Data warehouses are databases devoted to analytical processing. They are used to support decision-making activities in most modern business settings, when complex data sets have to be studied and analyzed. The technology for analytical processing assumes that data are presented in the form of simple data marts, consisting of a well-identified collection of facts and data analysis dimensions (star schema). Despite the wide diffusion of data warehouse technology and concepts, we still miss methods that help and guide the designer in identifying and extracting such data marts out of an enterprisewide information system, covering the upstream, requirement-driven stages of the design process. Many existing methods and tools support the activities related to the efficient implementation of data marts on top of specialized technology (such as the ROLAP or MOLAP data servers). This paper presents a method to support the identification and design of data marts. The method is based on three basic steps. A first top-down step makes it possible to elicit and consolidate user requirements and expectations. This is accomplished by exploiting a goal-oriented process based on the Goal/Question/Metric paradigm developed at the University of Maryland. Ideal data marts are derived from user requirements. The second bottom-up step extracts candidate data marts

REFERENCES

• 1: Rakesh Agrawal , Ashish Gupta , Sunita Sarawagi, Modeling Multidimensional Databases, Proceedings of the Thirteenth International Conference on Data Engineering, p.232-243, April 07-11, 1997
• 2: Annie I. Antón , Colin Potts, The use of goals to surface requirements for evolving systems, Proceedings of the 20th international conference on Software engineering, p.157-166, April 19-25, 1998, Kyoto, Japan
• 3: BASILI, V., CALDIERA, G., AND ROMBACH, D. 1994. Goal/question/metric paradigm. In Encyclopedia of Software Engineering (vol. 1 A-N), J. J. Marciniak, Ed. Wiley-Interscience, New York, NY, 528-532.
• 4: BATINI,C.AND LENZERINI, M. 1984. A methodology for data schema integration in the entity-relationship model. IEEE Trans. Softw. Eng. 10, 6 (Nov.), 650-664.
• 5: Barry W. Boehm, A Spiral Model of Software Development and Enhancement, Computer, v.21 n.5, p.61-72, May 1988 [doi>10.1109/2.59]
• 6: Luca Cabibbo , Riccardo Torlone, A Logical Approach to Multidimensional Databases, Proceedings of the 6th International Conference on Extending Database Technology: Advances in Database Technology, p.183-197, March 23-27, 1998
• 7: Diego Calvanese , Giuseppe De Giacomo , Maurizio Lenzerini , Daniele Nardi , Riccardo Rosati, Information Integration: Conceptual Modeling and Reasoning Support, Proceedings of the 3rd IFCIS International Conference on Cooperative Information Systems, p.280-291, August 20-22, 1998
• 8: Diego Calvanese , Giuseppe de Giacomo , Maurizio Lenzerini , Daniele Nardi , Riccardo Rosati, Source Integration in Data Warehousing, Proceedings of the 9th International Workshop on Database and Expert Systems Applications, p.192, August 26-28, 1998
• 9: Surajit Chaudhuri , Umeshwar Dayal, An overview of data warehousing and OLAP technology, ACM SIGMOD Record, v.26 n.1, p.65-74, March 1997 [doi>10.1145/248603.248616]
• 10: R. Darimont , E. Delor , P. Massonet , A. van Lamsweerde, GRAIL/KAOS: an environment for goal-driven requirements engineering, Proceedings of the 19th international conference on Software engineering, p.612-613, May 17-23, 1997, Boston, Massachusetts, United States [doi>10.1145/253228.253499]
• 11: C. I. Ezeife, A uniform approach for selecting views and indexes in a data warehouse, Proceedings of the 1997 International Symposium on Database Engineering & Applications, p.151, August 24-27, 1997
• 12: FRANCALANCI,C.AND FUGGETTA, A. 1997. Integrating conflicting requirements in process modeling: A survey and research directions. Inf. Softw. Technol. 39, 3, 205-216.
• 13: FRANCONI,E.AND SATTLER, U. 1999. A data warehouse conceptual data model for multidimensional aggregation. In Proceedings of the Workshop on Design and Management of Data Warehouses (DMDW '99, Heidelberg, Germany, June).
• 14: Alfonso Fuggetta , Luigi Lavazza , Sandro Morasca , Stefano Cinti , Giandomenico Oldano , Elena Orazi, Applying GQM in an industrial software factory, ACM Transactions on Software Engineering and Methodology (TOSEM), v.7 n.4, p.411-448, Oct. 1998 [doi>10.1145/292182.292197]
• 15: Hector Garcia-Molina , Wilburt Labio , Jun Yang, Expiring Data in a Warehouse, Proceedings of the 24rd International Conference on Very Large Data Bases, p.500-511, August 24-27, 1998
• 16: Matteo Golfarelli , Dario Maio , Stefano Rizzi, Conceptual Design of Data Warehouses from E/R Schema, Proceedings of the Thirty-First Annual Hawaii International Conference on System Sciences-Volume 7, p.334, January 06-09, 1998 [doi>10.1109/HICSS.1998.649228]
• 17: Himanshu Gupta , Inderpal Singh Mumick, Selection of Views to Materialize Under a Maintenance Cost Constraint, Proceeding of the 7th International Conference on Database Theory, p.453-470, January 10-12, 1999
• 18: Marc Gyssens , Laks V. S. Lakshmanan, A Foundation for Multi-dimensional Databases, Proceedings of the 23rd International Conference on Very Large Data Bases, p.106-115, August 25-29, 1997
• 19: Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman, Implementing data cubes efficiently, ACM SIGMOD Record, v.25 n.2, p.205-216, June 1996
• 20: W. H. Inmon, Building the data warehouse (2nd ed.), John Wiley & Sons, Inc., New York, NY, 1996
• 21: Matthias Jarke , Y. Vassiliou , P. Vassiliadis , M. Lenzerini, Fundamentals of Data Warehouses, Springer-Verlag New York, Inc., Secaucus, NJ, 1999
• 22: Ralph Kimball, The data warehouse toolkit: practical techniques for building dimensional data warehouses, John Wiley & Sons, Inc., New York, NY, 1996
• 23: Wilburt J. Labio , Yue Zhuge , Janet L. Wiener , Himanshu Gupta , Héctor García-Molina , Jennifer Widom, The WHIPS prototype for data warehouse creation and maintenance, ACM SIGMOD Record, v.26 n.2, p.557-559, June 1997
• 24: Wolfgang Lehner, Modelling Large Scale OLAP Scenarios, Proceedings of the 6th International Conference on Extending Database Technology: Advances in Database Technology, p.153-167, March 23-27, 1998
• 25: John Mylopoulos , Lawrence Chung , Brian Nixon, Representing and using nonfunctional requirements: a process-oriented approach, IEEE Transactions on Software Engineering, v.18 n.6, p.488-497, June 1992
• 26: Dimitri Theodoratos , Timos K. Sellis, Data Warehouse Schema and Instance Design, Proceedings of the 17th International Conference on Conceptual Modeling, p.363-376, November 16-19, 1998
• 27: Dimitri Theodoratos , Timos Sellis, Designing data warehouses, Data & Knowledge Engineering, v.31 n.3, p.279-301, Nov. 1999 [doi>10.1016/S0169-023X(99)00029-4]
• 28: Panos Vassiliadis , Mokrane Bouzeghoub , Christoph Quix, Towards Quality-Oriented Data Warehouse Usage and Evolution, Proceedings of the 11th International Conference on Advanced Information Systems Engineering, p.164-179, June 14-18, 1999
• 29: Jennifer Widom, Research problems in data warehousing, Proceedings of the fourth international conference on Information and knowledge management, p.25-30, November 29-December 02, 1995, Baltimore, Maryland, United States [doi>10.1145/221270.221319]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.1 Requirements/Specifications
          Subjects: Methodologies (e.g., object-oriented, structured)
      D.2.2 Design Tools and Techniques

General Terms:
Design, Management

Keywords:
conceptual modeling, data mart, data warehouse, design method, software quality management