A survey on software cost estimation in the chinese software industry

ABSTRACT

Although a lot of attention has been paid to software cost estimation since 1960, making accurate effort and schedule estimation is still a challenge. To collect evidence and identify potential areas of improvement in software cost estimation, it is important to investigate the estimation accuracy, the estimation method used, and the factors influencing the adoption of estimation methods in current industry. This paper analyzed 112 projects from the Chinese software project benchmarking dataset and conducted questionnaire survey on 116 organizations to investigate the above information. The paper presents the current situations related to software project estimation in China and provides evidence-based suggestions on how to improve software project estimation. Our survey results suggest, e.g., that large projects were more prone to cost and schedule overruns, that most computing managers and professionals were neither satisfied nor dissatisfied with the project estimation, that very few organizations (15%) used model-based methods, and that the high adoption cost and insignificant benefit after adoption were the main causes for low use of model-based methods.

REFERENCES

• 1: Barry W. Boehm, Software Engineering Economics, Prentice Hall PTR, Upper Saddle River, NJ, 1981
• 2: Briand and Wieczorek, L. C. 2002. Resource estimation in software engineering. In: J. J. Marcinak, Editor, Encyclopedia of Software Engineering, John Wiley & Sons, New York.
• 3: Kjetil Molokken-Ostvold , Magne Jorgensen , Sinan S. Tanilkan , Hans Gallis , Anette C. Lien , Siw E. Hove, A Survey on Software Estimation in the Norwegian Industry, Proceedings of the Software Metrics, 10th International Symposium, p.208-219, September 11-17, 2004 [doi>10.1109/METRICS.2004.5]
• 4: Wydenbach, G. and Paynter, J. 1995. Software Project Estimation: a Survey of Practices in New Zealand. New Zealand Journal of Computing. 6, 1B, 317--327.
• 5: Martin Shepperd, Software project economics: a roadmap, 2007 Future of Software Engineering, p.304-315, May 23-25, 2007 [doi>10.1109/FOSE.2007.23]
• 6: Jenkins, A. M., Naumann, J. D. and Wetherbe, J. C. 1984. Empirical Investigation of Systems Development Practices and Results. Information & Management, 7: p. 73--82.
• 7: Phan, D. 1990. Information Systems Project Management: an Integrated Resource Planning Perspective Model, in Department of Management and Information Systems. Arizona: Tucson.
• 8: Heemstra, F. J. 1992. Software cost estimation. Information and Software Technology. 34, 10, 627--639.
• 9: Albert L. Lederer , Jayesh Prasad, Causes of inaccurate software development cost estimates, Journal of Systems and Software, v.31 n.2, p.125-134, Nov. 1995 [doi>10.1016/0164-1212(94)00092-2]
• 10: François Bergeron , Jean-Yves St-Arnaud, Estimation of information systems development efforts: a pilot study, Information and Management, v.22 n.4, p.239-254, April 1992 [doi>10.1016/0378-7206(92)90026-C]
• 11: Sauer, C. and Cuthbertson, C. 2003. The State of IT Project Management in the UK 2002--2003. Templeton College, University of Oxford.
• 12: Jørgensen, M. and Moløkken, K. How large are software cost overruns? A review of the 1994 Chaos Report. Information and Software Technology. 48, 4 (Apr. 2006).
• 13: Moores, T. T. and Edwards, J. S. 1992. Could Large UK Corporations and Computing Companies Use Software Cost Estimating Tools? - A Survey. European Journal of Information Systems. 1, 5, 311--319.
• 14: McAulay, K. 1987. Information Systems Development and the Changing Role of MIS in the Organisation. First New Zealand MIS Management Conference, Wellington.
• 15: Lionel C. Briand , Khaled El Emam , Frank Bomarius, COBRA: a hybrid method for software cost estimation, benchmarking, and risk assessment, Proceedings of the 20th international conference on Software engineering, p.390-399, April 19-25, 1998, Kyoto, Japan
• 16: Melanie Ruhe , Ross Jeffery , Isabella Wieczorek, Cost estimation for web applications, Proceedings of the 25th International Conference on Software Engineering, May 03-10, 2003, Portland, Oregon
• 17: Jørgensen, M. 2004. A review of studies on expert estimation of software development effort. Journal of Systems and Software. 70, 1-2, 37--60.
• 18: Albert L. Lederer , Jayesh Prasad, Nine management guidelines for better cost estimating, Communications of the ACM, v.35 n.2, p.51-59, Feb. 1992 [doi>10.1145/129630.129632]
• 19: Barry Boehm , Chris Abts , Sunita Chulani, Software development cost estimation approaches – A survey, Annals of Software Engineering, v.10 n.1-4, p.177-205, 2000 [doi>10.1023/A:1018991717352]
• 20: Richard D. Stutzke, Estimating Software-Intensive Systems: Projects, Products, and Processes (Sei Series in Software Engineering), Addison-Wesley Professional, 2005
• 21: Barry W. Boehm , Clark , Horowitz , Brown , Reifer , Chulani , Ray Madachy , Bert Steece, Software Cost Estimation with Cocomo II with Cdrom, Prentice Hall PTR, Upper Saddle River, NJ, 2000
• 22: Park, R. E., Goethert, W. B. and Webb, J. T. 1994. Software cost and schedule estimating: A process improvement initiative. Special Report CMU/SEI-94-SR-3, Software Engineering Institute, Carnegie Mellon University. URL = http://www.sei.cmu.edu/publications/documents/94.reports/94.sr.003.html.
• 23: Steve McConnell, Rapid Development: Taming Wild Software Schedules, Microsoft Press, Redmond, WA, 1996
• 24: Letters: The Cone of Uncertainty, IEEE Software, v.23 n.5, p.8-10, September 2006 [doi>10.1109/MS.2006.133]
• 25: S. D. Conte , H. E. Dunsmore , Y. E. Shen, Software engineering metrics and models, Benjamin-Cummings Publishing Co., Inc., Redwood City, CA, 1986
• 26: Kasunic, M. 2005. Designing an Effective Survey. Technical Handbook. Pittsburg: Software Engineering Institute. Carnegie Mellon University. (September, 2005).
• 27: Bryman, A. and Cramer, D. 2005. Quantitative Data Analysis with SPSS, Routledge.
• 28: Venkatesh, V. and et. al, User Acceptance of Information Technology: Toward a Unified View. MIS Quarterly. Vol. 27 No. 3, 425--478
• 29: Jacky Keung , Ross Jeffery , Barbara Kitchenham, The Challenge of Introducing a New Software Cost Estimation Technology into a Small Software Organisation, Proceedings of the 2004 Australian Software Engineering Conference (ASWEC'04), p.52, April 13-16, 2004
• 30: Yang, D., et al, 2006. "COCOMO-U: An Extension of COCOMO II for Cost Estimation with Uncertainty", In: Wang, Q., Pfahl, D., Raffo, D. M., Wernick, P. (eds.) Software Process Change. LNCS, 3966, 132--141. Springer, Heidelberg (2006)
• 31: Yang, D., Boehm, B., Yang, Y., Wang, Q. and Li, M. 2007. Coping with the cone of uncertainty: an empirical study of the SAIV process model. In Proceedings of International Conference on Software Process. (May, 2007) 37--48

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.9 Management
          Subjects: Time estimation

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Performance measures
      D.2.9 Management
          Subjects: Cost estimation

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.1 Project and People Management
          Subjects: Management techniques (e.g., PERT/CPM)

General Terms:
Economics, Management, Measurement, Performance

Keywords:
estimation method, estimation model, software cost estimation