Automated support for process-aware definition and execution of measurement plans

ABSTRACT

Some of the problems with process measurement are generally due to the fact that the definition of measurement plans does not rely on a reference model of the development process that can drive and explain the measuring activities. One of the most popular methodologies addressing the definition of process measurement plans is the GQM (Goal/Question/Metrics). This paper discusses how to support the creation of GQM plans by means of an explicit model of the process being measured. Such a model guides the GQM process, and makes it possible to define precisely -if not formally- the metrics involved. A tool supporting the proposed method is also illustrated.

REFERENCES

• 1: ARGO/UML, http://argouml.tigris.org/
• 2: Basili V., and Rombach H.D., The TAME project: towards improvement-oriented software environments, IEEE Transactions on Software Engineering, June, 1988.
• 3: Basili V., Caldiera G., and Rombach H.D., Goal/Question/Metric Paradigm, in Encyclopedia of Software Engineering, vol.1, J.C. Marciniak Ed.: John Wiley & Sons, 1994, pp. 528--532.
• 4: Basili V. and Weiss D., A methodology for collecting valid software engineering data, IEEE Trans. Software Eng., June 1984.
• 5: V. Basili, GQM approach has evolved to include models, IEEE Software, vol. 11, no. 1, pp. 8, 1994.
• 6: Brito e Abreu, F. Using OCL to Formalize Object Oriented Metrics Definitions, INESC Report ES007/2001, June 2001.
• 7: Alfred Broeckers , Christiane Differding , Guenter Threin , Robert Bosch, The Role of Software Process Modeling in Planning Industrial Measurement Programs, Proceedings of the 3rd International Symposium on Software Metrics: From Measurement to Empirical Results, p.31, March 25-26, 1996
• 8: IEEE Software Staff, What Makes for Effective Measurement?, IEEE Software, v.10 n.6, p.94-95, November 1993
• 9: Tineke de Bunje , Alison Saunders, Combining Process Models and Metrics in Practice, Proceedings of the 4th European Workshop on Software Process Technology, p.49-53, April 03-05, 1995
• 10: De Panfilis, S., Kitchenham B. and Morfuni N., Experiences introducing a measurement program, Information and Software Technology 39(11) (1997) 745--754.
• 11: Elisabetta Di Nitto , Luigi Lavazza , Marco Schiavoni , Emma Tracanella , Michele Trombetta, Deriving executable process descriptions from UML, Proceedings of the 24th International Conference on Software Engineering, May 19-25, 2002, Orlando, Florida [doi>10.1145/581339.581361]
• 12: Norman E. Fenton , Shari Lawrence Pfleeger, Software Metrics: A Rigorous and Practical Approach, PWS Publishing Co., Boston, MA, 1998
• 13: Alfonso Fuggetta , Luigi Lavazza , Sandro Morasca , Stefano Cinti , Giandomenico Oldano , Elena Orazi, Applying GQM in an industrial software factory, ACM Transactions on Software Engineering and Methodology (TOSEM), v.7 n.4, p.411-448, Oct. 1998 [doi>10.1145/292182.292197]
• 14: Robert B. Grady, Practical software metrics for project management and process improvement, Prentice-Hall, Inc., Upper Saddle River, NJ, 1992
• 15: Gresse, C. and L. C. Briand (1998). "Requirements for the knowledge-based support of software engineering measurement plans." Knowledge-Based Systems 11(2): 125--143.
• 16: Hefner K. K., An experienced-based optimization of the Goal/Question/Paradigm, in Proceedings of California Software Symposium, Irvine, 1995.
• 17: Bill Hetzel, Making Software Measurement Work: Building an Effective Measurement Program, John Wiley & Sons, Inc., New York, NY, 1993
• 18: Barbara Kitchenham , Shari Lawrence Pfleeger , Norman Fenton, Towards a Framework for Software Measurement Validation, IEEE Transactions on Software Engineering, v.21 n.12, p.929-944, December 1995 [doi>10.1109/32.489070]
• 19: Barbara A. Kitchenham, Software Metrics: Measurement for Software Process Improvement, Blackwell Publishers, Inc., Cambridge, MA, 1996
• 20: Lott C. M. and Rombach H. D.. Measurement-based guidance of software projects using explicit project plans, Information and Software Technology, June/July 1993.
• 21: M. Morisio, Measurement processes are software, too, Journal of Systems and Software, v.49 n.1, p.17-31, Dec. 15, 1999 [doi>10.1016/S0164-1212(99)00063-1]
• 22: Thomas Olsson , Per Runeson, V-GQM: A Feed-Back Approach to Validation of a GQM Study, Proceedings of the 7th International Symposium on Software Metrics, p.236, April 04-06, 2001
• 23: OMG Unified Modeling Language Specification v. 1.5, March 2003, formal/03-03-01, http://www.omg.org.
• 24: Pfahl D., Lebsanft K., Vollei F., Integration of System Dynamics Modeling with Descriptive Process Modeling and Goal-Oriented Measurement, in Proceedings of ProSim 1998.
• 25: Shari Lawrence Pfleeger , Hans Dieter Rombach, Measurement Based Process Improvement, IEEE Software, v.11 n.4, p.8-11, July 1994 [doi>10.1109/52.300077]
• 26: Shari Lawrence Pfleeger, Maturity, models, and goals: how to build a metrics plan, Journal of Systems and Software, v.31 n.2, p.143-155, Nov. 1995 [doi>10.1016/0164-1212(94)00094-4]
• 27: van Solingen, R., and Berghout E., The Goal/Question/Metric Method, McGraw Hill, 1999.
• 28: Giuseppe Visaggio, Process Improvement Through Data Reuse, IEEE Software, v.11 n.4, p.76-85, July 1994 [doi>10.1109/52.300093]
• 29: Voigtlaender C., and Kempkens R., GQMaspect II System Documentation, IESE report 062.99/E, October 1999.
• 30: D. Weiss, GQM plus heuristics better than brainstorming, IEEE Software, vol. 11, no. 1, pp. 8--9, 1994.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: Computer-aided software engineering (CASE)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Process metrics
      D.2.9 Management
          Subjects: Software process models (e.g., CMM, ISO, PSP)

General Terms:
Management, Measurement

Keywords:
goal/question/metrics (GQM), process modeling, software metrics, software metrics definition, software process measurement