Discovering faults in idiom-based exception handling

ABSTRACT

In this paper, we analyse the exception handling mechanism of a state-of-the-art industrial embedded software system. Like many systems implemented in classic programming languages, our subject system uses the popular return-code idiom for dealing with exceptions. Our goal is to evaluate the fault-proneness of this idiom, and we therefore present a characterisation of the idiom, a fault model accompanied by an analysis tool, and empirical data. Our findings show that the idiom is indeed fault prone, but that a simple solution can lead to significant improvements.

REFERENCES

• 1: E. N. Adams. Optimizing preventive service of software products. IBM Journal of Research and Development, 28(1):2--14, 1984.
• 2: Thomas Ball , Sriram K. Rajamani, The SLAM project: debugging system software via static analysis, Proceedings of the 29th ACM SIGPLAN-SIGACT symposium on Principles of programming languages, p.1-3, January 16-18, 2002, Portland, Oregon
• 3: Barry W. Boehm, Software Engineering Economics, Prentice Hall PTR, Upper Saddle River, NJ, 1981
• 4: Magiel Bruntink , Arie van Deursen , Tom Tourwe, Isolating Idiomatic Crosscutting Concerns, Proceedings of the 21st IEEE International Conference on Software Maintenance (ICSM'05), p.37-46, September 25-30, 2005 [doi>10.1109/ICSM.2005.57]
• 5: Magiel Bruntink , Arie van Deursen , Tom Tourwe , Remco van Engelen, An Evaluation of Clone Detection Techniques for Identifying Crosscutting Concerns, Proceedings of the 20th IEEE International Conference on Software Maintenance, p.200-209, September 11-14, 2004
• 6: M. Bush, Improving software quality: the use of formal inspections at the JPL, Proceedings of the 12th international conference on Software engineering, p.196-199, March 26-30, 1990, Nice, France
• 7: William R. Bush , Jonathan D. Pincus , David J. Sielaff, A static analyzer for finding dynamic programming errors, Software—Practice & Experience, v.30 n.7, p.775-802, June 2000 [doi>10.1002/(SICI)1097-024X(200006)30:7<775::AID-SPE309>3.0.CO;2-H]
• 8: Hao Chen , David Wagner, MOPS: an infrastructure for examining security properties of software, Proceedings of the 9th ACM conference on Computer and communications security, November 18-22, 2002, Washington, DC, USA [doi>10.1145/586110.586142]
• 9: F. Christian. Exception handling and tolerance of software faults, chapter 4, pages 81--107. John Wiley & Sons, 1995.
• 10: Manuvir Das , Sorin Lerner , Mark Seigle, ESP: path-sensitive program verification in polynomial time, Proceedings of the ACM SIGPLAN 2002 Conference on Programming language design and implementation, June 17-19, 2002, Berlin, Germany
• 11: M. Dyer. The cleanroom approach to quality software development. In Proceedings of the 18th International Computer Measurement Group Conference, pages 1201--1212. Computer Measurement Group, 1992.
• 12: D. R. Engler, B. Chelf, A. Chou, and S. Hallem. Checking system rules using system-specific, programmer-written compiler extensions. In 4th Symposium on Operating System Design and Implementation, pages 1--16. USENIX Association, 2000.
• 13: Norman Fenton , Shari Lawrence Pfleeger, Software metrics (2nd ed.): a rigorous and practical approach, PWS Publishing Co., Boston, MA, 1997
• 14: Cormac Flanagan , K. Rustan M. Leino , Mark Lillibridge , Greg Nelson , James B. Saxe , Raymie Stata, Extended static checking for Java, Proceedings of the ACM SIGPLAN 2002 Conference on Programming language design and implementation, June 17-19, 2002, Berlin, Germany
• 15: Chen Fu , Ana Milanova , Barbara Gershon Ryder , David G. Wonnacott, Robustness Testing of Java Server Applications, IEEE Transactions on Software Engineering, v.31 n.4, p.292-311, April 2005 [doi>10.1109/TSE.2005.51]
• 16: N. H. Gehani, Exceptional C or C with exceptions, Software—Practice & Experience, v.22 n.10, p.827-848, Oct. 1992 [doi>10.1002/spe.4380221003]
• 17: S. Johnson. Lint, a C Program Checker. Technical Report 65, Bell Laboratories, Dec. 1977.
• 18: Jun Lang , David B. Stewart, A study of the applicability of existing exception-handling techniques to component-based real-time software technology, ACM Transactions on Programming Languages and Systems (TOPLAS), v.20 n.2, p.274-301, March 1998 [doi>10.1145/276393.276395]
• 19: P. A. Lee. Exception handling in C programs. Software Practice and Experience, 13(5):389--405, 1983.
• 20: J.-L. Lions. Ariane 5 flight 501 failure. Technical report, ESA/CNES, 1996.
• 21: Martin Lippert , Cristina Videira Lopes, A study on exception detection and handling using aspect-oriented programming, Proceedings of the 22nd international conference on Software engineering, p.418-427, June 04-11, 2000, Limerick, Ireland [doi>10.1145/337180.337229]
• 22: Bev Littlewood, Dependability assessment of software-based systems: state of the art, Proceedings of the 27th international conference on Software engineering, p.6-7, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062461]
• 23: Madanlal Musuvathi , David Y. W. Park , Andy Chou , Dawson R. Engler , David L. Dill, CMC: a pragmatic approach to model checking real code, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060297]
• 24: S. Paul , A. Prakash, A Framework for Source Code Search Using Program Patterns, IEEE Transactions on Software Engineering, v.20 n.6, p.463-475, June 1994 [doi>10.1109/32.295894]
• 25: E. S. Roberts. Implementing exceptions in C. Technical Report 40, Digital Systems Research Center, 1989.
• 26: Martin P. Robillard , Gail C. Murphy, Regaining Control of Exception Handling, University of British Columbia, Vancouver, BC, Canada, 1999
• 27: Martin P. Robillard , Gail C. Murphy, Static analysis to support the evolution of exception structure in object-oriented systems, ACM Transactions on Software Engineering and Methodology (TOSEM), v.12 n.2, p.191-221, April 2003 [doi>10.1145/941566.941569]
• 28: Saurabh Sinha , Mary Jean Harrold, Criteria for Testing Exception-Handling Constructs in Java Programs, Proceedings of the IEEE International Conference on Software Maintenance, p.265, August 30-September 03, 1999
• 29: Tom Tourwé , Tom Mens, Identifying Refactoring Opportunities Using Logic Meta Programming, Proceedings of the Seventh European Conference on Software Maintenance and Reengineering, p.91, March 26-28, 2003
• 30: W. N. Toy. Fault-tolerant design of local ess processors. In Proceedings of IEEE, pages 1126--1145. IEEE Computer Society, 1982.
• 31: E. Van Emden , L. Moonen, Java Quality Assurance by Detecting Code Smells, Proceedings of the Ninth Working Conference on Reverse Engineering (WCRE'02), p.97, October 29-November 01, 2002
• 32: H. Winroth. Exception handling in ANSI C. Technical Report ISRN KTH NA/P-93/15-SE, Department of Numerical Analysis and Computing Science, Royal Institute of Technology, Stockholm, Sweden, 1993.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Reliability

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Error handling and recovery

General Terms:
Design, Reliability, Verification

Keywords:
exception handling, fault model, program analysis