Effort estimation modeling techniques: a case study for web applications

ABSTRACT

A reliable effort estimation is crucial for a successful web application development planning. Several approaches exist to address this issue. Among them, the algorithmic approach is one of the most widely used and investigated methods. It is based on suitable effort prediction models which relate the development effort with project characteristics. The size represents one of the most interesting characteristics of software products and several measures can be defined in order to estimate the size of web systems. Moreover, several techniques have been proposed in the literature to build the effort prediction models. Thus, of special interest should be to establish the most effective size measures to be employed in effort prediction models and the most suitable techniques for the model construction. To this aim some empirical studies have been undertaken so far. Since it is widely recognized that several investigations should be performed to verify/confirm empirical results, in the paper we will report on an empirical analysis we have carried out by exploiting data coming from 15 web projects developed by a software company. In particular, for the analysis we have considered two sets of size measures: Length Measures (e.g. number of pages, number of medias, number of client and server side scripts) and Functional Measures (e.g. external input, external output, external query). Moreover, we have employed different techniques, such as Linear Regression, Regression Tree, and Analogy-Based Estimation, in order to determine the one that provides the best prediction.

REFERENCES

• 1: S.M. Abrahão, O. Pastor, Measuring the functional size of web applications, in International Journal of Web Engineering and Technology, 1(1), pp. 5--16, 2003.
• 2: Silvia Abrahao , Geert Poels , Oscar Pastor, Evaluating a Functional Size Measurement Method for Web Applications: An Empirical Analysis, Proceedings of the Software Metrics, 10th International Symposium on (METRICS'04), p.358-369, September 11-17, 2004 [doi>10.1109/METRICS.2004.22]
• 3: A.J. Albrecht, "Measuring Application Development Productivity," in Proceedings of the Joint SHARE/GUIDE/IBM Application Development Symposium, Monterey, CA, pp. 83--92, 1979.
• 4: Luciano Baresi , Sandro Morasca , Paolo Paolini, Estimating the Design Effort of Web Applications, Proceedings of the 9th International Symposium on Software Metrics, p.62, September 03-05, 2003
• 5: Lionel C. Briand , Khaled El Emam , Dagmar Surmann , Isabella Wieczorek , Katrina D. Maxwell, An assessment and comparison of common software cost estimation modeling techniques, Proceedings of the 21st international conference on Software engineering, p.313-322, May 16-22, 1999, Los Angeles, California, United States [doi>10.1145/302405.302647]
• 6: L. Briand, T. Langley and I. Wiekzorek, A Replicated Assessment and Comparison of Common Software Cost Modeling Techniques, International Software Engineering Research Network Technical Report ISERN-99-15.
• 7: L. Briand, I. Wieczorek. Software Resource Estimation. Encyclopedia of Software Engineering. Volume 2. P-Z (2nd ed.), Marciniak, John J. (ed.) New York: John Wiley & Sons, pp. 1160--1196, 2002.
• 8: Jim Conallen, Building Web applications with UML, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 9: S. D. Conte , H. E. Dunsmore , Y. E. Shen, Software engineering metrics and models, Benjamin-Cummings Publishing Co., Inc., Redwood City, CA, 1986
• 10: G. Costagliola, F. Ferrucci, C. Gravino, G. Tortora, G. Vitello, A COSMIC-FFP Based Method to Estimate Web Application Development Effort, in LNCS 3140, N. Koch, P. Fraternali, and M. Wirsing (Eds.): ICWE 2004, Monaco, Germany, pp.161--165, 2004.
• 11: G. Kadoba, M. Cartwright, L. Chen, M. Shepperd, Experiences Using Case-Based Reasoning to Predict Software Project Effort, in Proceedings of EASE 2000 Conference, Keele, UK, 2000.
• 12: Barbara Kitchenham, A Procedure for Analyzing Unbalanced Datasets, IEEE Transactions on Software Engineering, v.24 n.4, p.278-301, April 1998 [doi>10.1109/32.677185]
• 13: B. A. Kitchenham, L. M. Pickard, S. G. MacDonell, M. J. Shepperd, What accuracy statistics really measure, IEE Proceedings - Software, 148(3), pp.81--85, 2001.
• 14: Measurement in Software Engineering, Web site http://www2.umassd.edu/SWPI/ProcessBibliography/bib-measurement.html. Last visited on May 07, 2006.
• 15: E. Mendes, S. Counsell, N. Mosley, Comparison of Web Size Measures for Predicting Web Design and Authoring Effort, IEE Proceedings-Software 149(3), pp. 86--92, 2002.
• 16: Emilia Mendes , Nile Mosley , Steve Counsell, Web Metrics— Estimating Design and Authoring Effort, IEEE MultiMedia, v.8 n.1, p.50-57, January 2001 [doi>10.1109/93.923953]
• 17: Emilia Mendes , Ian Watson , Chris Triggs , Nile Mosley , Steve Counsell, A Comparative Study of Cost Estimation Models for Web Hypermedia Applications, Empirical Software Engineering, v.8 n.2, p.163-196, June 2003 [doi>10.1023/A:1023062629183]
• 18: E. Mendes, S. Counsell, N. Mosley: Towards a Taxonomy of Hypermedia and Web Application Size Metrics. In Proceedings of International Conference of Web Engineering (ICWE 2005), pp. 110--123, 2005.
• 19: Emilia Mendes , Ian Watson , Chris Triggs , Nile Mosley , Steve Counsell, A Comparison of Development Effort Estimation Techniques for Web Hypermedia Applications, Proceedings of the 8th International Symposium on Software Metrics, p.131, June 04-07, 2002
• 20: Emilia Mendes , Barbara Kitchenham, Further Comparison of Cross-Company and Within-Company Effort Estimation Models for Web Applications, Proceedings of the Software Metrics, 10th International Symposium on (METRICS'04), p.348-357, September 11-17, 2004 [doi>10.1109/METRICS.2004.24]
• 21: Emilia Mendes , Nile Mosley, Further Investigation into the Use of CBR and Stepwise Regression to Predict Development Effort for Web Hypermedia Applications, Proceedings of the 2002 International Symposium on Empirical Software Engineering, p.79, October 03-04, 2002
• 22: D. Montgomery, E. Peck, G. Vining, Introduction to Linear Regression Analysis, John Wiley & Sons, Inc., 3 Ed., 2001.
• 23: Ingunn Myrtveit , Erik Stensrud, A Controlled Experiment to Assess the Benefits of Estimating with Analogy and Regression Models, IEEE Transactions on Software Engineering, v.25 n.4, p.510-525, July 1999 [doi>10.1109/32.799947]
• 24: Donald J. Reifer, Web Development: Estimating Quick-to-Market Software, IEEE Software, v.17 n.6, p.57-64, November 2000 [doi>10.1109/52.895169]
• 25: Melanie Ruhe , Ross Jeffery , Isabella Wieczorek, Cost estimation for web applications, Proceedings of the 25th International Conference on Software Engineering, May 03-10, 2003, Portland, Oregon
• 26: Martin Shepperd , Chris Schofield, Estimating Software Project Effort Using Analogies, IEEE Transactions on Software Engineering, v.23 n.11, p.736-743, November 1997 [doi>10.1109/32.637387]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Product metrics

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Process metrics

General Terms:
Documentation, Economics, Experimentation, Management, Measurement, Theory, Verification

Keywords:
effort prediction models, empirical validation, size metrics, web applications