Path projection for user-centered static analysis tools

ABSTRACT

The research and industrial communities have made great strides in developing sophisticated defect detection tools based on static analysis. To date most of the work in this area has focused on developing novel static analysis algorithms, but has neglected study of other aspects of static analysis tools, particularly user interfaces. In this work, we present a novel user interface toolkit called Path Projection that helps users visualize, navigate, and understand program paths, a common component of many tools' error reports. We performed a controlled user study to measure the benefit of Path Projection in triaging error reports from Locksmith, a data race detection tool for C. We found that Path Projection improved participants' time to complete this task without affecting accuracy, while participants felt Path Projection was useful and strongly preferred it to a more standard viewer.

REFERENCES

• 1: Paul Anderson , Thomas Reps , Tim Teitelbaum , Mark Zarins, Tool Support for Fine-Grained Software Inspection, IEEE Software, v.20 n.4, p.42-50, July 2003 [doi>10.1109/MS.2003.1207453]
• 2: John Anvik , Lyndon Hiew , Gail C. Murphy, Who should fix this bug?, Proceedings of the 28th international conference on Software engineering, May 20-28, 2006, Shanghai, China [doi>10.1145/1134285.1134336]
• 3: Thomas Ball , Sriram K. Rajamani, The SLAM project: debugging system software via static analysis, Proceedings of the 29th ACM SIGPLAN-SIGACT symposium on Principles of programming languages, p.1-3, January 16-18, 2002, Portland, Oregon
• 4: Mike Beaven , Ryan Stansifer, Explaining type errors in polymorphic languages, ACM Letters on Programming Languages and Systems (LOPLAS), v.2 n.1-4, p.17-30, March–Dec. 1993 [doi>10.1145/176454.176460]
• 5: D. Beyer, A. J. Chlipala, T. A. Henzinger, R. Jhala, and R. Majumdar. The Blast query language for software verification. In R. Giacobazzi, editor, Static Analysis, 11th International Symposium, volume 3148 of Lecture Notes in Computer Science, pages 2--18, Verona, Italy, Aug. 2004. Springer-Verlag.
• 6: Coverity, Inc. Coverity Prevent SQS, 2007. http://www.coverity.com/html/prod_prevent.html.
• 7: Roger F. Crew, ASTLOG: a language for examining abstract syntax trees, Proceedings of the Conference on Domain-Specific Languages on Conference on Domain-Specific Languages (DSL), 1997, p.18-18, October 15-17, 1997, Santa Barbara, California
• 8: D. Cubranic and G. C. Murphy. Automatic bug triage using text categorization. In SEKE'04, pages 92--97, 2004.
• 9: M. D'Ambros, M. Lanza, and M. Pinzger. "A Bug's Life" Visualizing a Bug Database. VISSOFT '07, pages 113--120, 24--25 June 2007.
• 10: Dominic Duggan , Frederick Bent, Explaining type inference, Science of Computer Programming, v.27 n.1, p.37-83, July 1996 [doi>10.1016/0167-6423(95)00007-0]
• 11: Cormac Flanagan , Matthew Flatt , Shriram Krishnamurthi , Stephanie Weirich , Matthias Felleisen, Catching bugs in the web of program invariants, Proceedings of the ACM SIGPLAN 1996 conference on Programming language design and implementation, p.23-32, May 21-24, 1996, Philadelphia, Pennsylvania, United States
• 12: Fortify Software Inc. Fortify Source Code Analysis, 2007. http://www.fortifysoftware.com/products/sca/.
• 13: G. W. Furnas, Generalized fisheye views, Proceedings of the SIGCHI conference on Human factors in computing systems, p.16-23, April 13-17, 1986, Boston, Massachusetts, United States
• 14: GrammaTech, Inc. CodeSonar, 2007. http://www.grammatech.com/products/codesonar/overview.html.
• 15: David Greenfieldboyce , Jeffrey S. Foster, Visualizing type qualifier inference with Eclipse, Proceedings of the 2004 OOPSLA workshop on eclipse technology eXchange, p.57-61, October 24-24, 2004, Vancouver, British Columbia, Canada [doi>10.1145/1066129.1066141]
• 16: Christian Haack , J. B. Wells, Type error slicing in implicitly typed higher-order languages, Science of Computer Programming, v.50 n.1-3, p.189-224, March 2004 [doi>10.1016/j.scico.2004.01.004]
• 17: Seth Hallem , Benjamin Chelf , Yichen Xie , Dawson Engler, A system and language for building system-specific, static analyses, Proceedings of the ACM SIGPLAN 2002 Conference on Programming language design and implementation, June 17-19, 2002, Berlin, Germany
• 18: Y. P. Khoo, J. S. Foster, M. Hicks, and V. Sazawal. Path Projection for User-Centered Static Analysis Tools. Technical Report CS-TR-4919, Department of Computer Science, University of Maryland, College Park, Aug. 2008.
• 19: Klocwork Inc. Klocwork Enterprise Development Suite, 2007. http://www.klocwork.com.
• 20: Ted Kremenek , Ken Ashcraft , Junfeng Yang , Dawson Engler, Correlation exploitation in error ranking, Proceedings of the 12th ACM SIGSOFT twelfth international symposium on Foundations of software engineering, October 31-November 06, 2004, Newport Beach, CA, USA
• 21: James R. Larus , Thomas Ball , Manuvir Das , Robert DeLine , Manuel Fahndrich , Jon Pincus , Sriram K. Rajamani , Ramanathan Venkatapathy, Righting Software, IEEE Software, v.21 n.3, p.92-100, May 2004 [doi>10.1109/MS.2004.1293079]
• 22: Matthias Neubauer , Peter Thiemann, Discriminative sum types locate the source of type errors, Proceedings of the eighth ACM SIGPLAN international conference on Functional programming, p.15-26, August 25-29, 2003, Uppsala, Sweden
• 23: J. Pincus. User Interaction Issues in Defect Detection Tools. Presentation at UW/MSR Research Summer Institute, 2001. http://research.microsoft.com/ users/jpincus/uwmsrsi01.ppt.
• 24: Polyvios Pratikakis , Jeffrey S. Foster , Michael Hicks, LOCKSMITH: context-sensitive correlation analysis for race detection, Proceedings of the 2006 ACM SIGPLAN conference on Programming language design and implementation, June 11-14, 2006, Ottawa, Ontario, Canada
• 25: B. Pugh et al. FindBugs, 2007. http://findbugs.sourceforge.net.
• 26: Per Runeson , Magnus Alexandersson , Oskar Nyholm, Detection of Duplicate Defect Reports Using Natural Language Processing, Proceedings of the 29th international conference on Software Engineering, p.499-510, May 20-26, 2007 [doi>10.1109/ICSE.2007.32]
• 27: Stefan Savage , Michael Burrows , Greg Nelson , Patrick Sobalvarro , Thomas Anderson, Eraser: a dynamic data race detector for multi-threaded programs, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.27-37, October 05-08, 1997, Saint Malo, France
• 28: W. Scherlis et al. The Fluid Project, 2007. http://www.fluid.cs.cmu.edu:8080/Fluid.
• 29: Margaret-Anne Darragh Storey , David Fracchia , Hausi Muller, A cognitive framework for describing and evaluating software exploration tools, Simon Fraser University, Burnaby, BC, Canada, 1998
• 30: M. Weiser. Program slicing. IEEE Transactions on Software Engineering, 10(4):352--357, July 1984.
• 31: J. Yang, J. Wells, P. Trinder, and G. Michaelson. Improved type error reporting, 2000.