Software process decision support: making process tradeoffs using a hybrid metrics, modeling and utility framework

ABSTRACT

In this paper, we present a "forward-looking" decision support framework that integrates timely metrics data with simulation models of the software development process in order to support the software project management control function. This forward-looking approach provides predictions of project performance and the impact of various management decisions. Tradeoffs among performance measures are accomplished using Outcome Based Control Limits (OBCLs) and are augmented using multi-criteria utility functions and financial measures of performance to evaluate various process alternatives. The decision support framework enables the program manager to take corrective action as necessary on a project with the simulation model providing insight on potential performance impacts of the proposed corrective actions. A real world example is presented.

REFERENCES

• 1: Harrison, W., "A Universal Metrics Repository", Proceedings of the Pacific Northwest Software Quality Conference, Portland, Oregon, October 18-19, 2000.
• 2: Watts S. Humphrey, Managing the software process, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
• 3: M. Kellner, "Software Process Modeling : Value and Experience," Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, SEI Technical Review 1989.
• 4: M. Kellner, "Software Process Modeling Experience," presented at The 11th International Conference on Software Engineering, Pittsburgh, Pennsylvania, USA, 1989.
• 5: Marc I. Kellner, Experience with enactable software process models, Proceedings of the 5th international software process workshop on Experience with software process models, p.85-88, October 10-13, 1989, Kennebunkport, Maine, United States
• 6: Paulk, M. C., Curtis, W., Chrissis, M. B., Weber, C. V., "Capability Maturity Model for Software, Version 1.1", Technical Report SEI-93-TR-24, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, February 1993.
• 7: David Mitchell Raffo , Marc I. Kellner , Thomas E. Morton , Robert H. Sturges, Modeling software processes quantitatively and assessing the impact of potential process changes on process performance, 1996
• 8: D. M. Raffo and M. I. Kellner, "Field Study Results Using the Process Tradeoff Analysis Method", Proceedings of the 1996 Software Engineering Process Group Conference, Held in Atlantic City, New Jersey, May 20-23, 1996.
• 9: D. M. Raffo, J. V. Vandeville, and R. Martin, "Software Process Simulation to Achieve Higher CMM Levels", Journal of Systems and Software, Vol. 46, No. 2/3 (15 April 1999).
• 10: D. M. Raffo, W. Harrison, J. V. Vandeville, "Coordinating Models and Metrics to Manage Software Projects, International Journal of Software Process Improvement and Practice, 5:2/3, June/September, 2000, pages 147-157.
• 11: Donna C. S. Summers, Quality, Prentice-Hall, Inc., Upper Saddle River, NJ, 1996

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.9 Management

General Terms:
Economics, Management, Measurement

Keywords:
multi-criteria decision making, project management, simulation, software measurement repositories, software process modeling