Using information scent to model the dynamic foraging behavior of programmers in maintenance tasks

ABSTRACT

In recent years, the software engineering community has begun to study program navigation and tools to support it. Some of these navigation tools are very useful, but they lack a theoretical basis that could reduce the need for ad hoc tool building approaches by explaining what is fundamentally necessary in such tools. In this paper, we present PFIS (Programmer Flow by Information Scent), a model and algorithm of programmer navigation during software maintenance. We also describe an experimental study of expert programmers debugging real bugs described in real bug reports for a real Java application. We found that PFIS' performance was close to aggregated human decisions as to where to navigate, and was significantly better than individual programmers' decisions.

REFERENCES

• 1: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 2: Ruven Brooks, Towards a theory of the cognitive processes in computer programming, International Journal of Human-Computer Studies, v.51 n.2, p.197-211, Aug. 1999 [doi>10.1006/ijhc.1977.0306]
• 3: Ed H. Chi , Peter Pirolli , Kim Chen , James Pitkow, Using information scent to model user information needs and actions and the Web, Proceedings of the SIGCHI conference on Human factors in computing systems, p.490-497, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365325]
• 4: Ed H. Chi , Adam Rosien , Gesara Supattanasiri , Amanda Williams , Christiaan Royer , Celia Chow , Erica Robles , Brinda Dalal , Julie Chen , Steve Cousins, The bloodhound project: automating discovery of web usability issues using the InfoScentπ simulator, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642699]
• 5: Davor Cubranic , Gail C. Murphy , Janice Singer , Kellogg S. Booth, Hipikat: A Project Memory for Software Development, IEEE Transactions on Software Engineering, v.31 n.6, p.446-465, June 2005 [doi>10.1109/TSE.2005.71]
• 6: Cutting, D. Lucene, http://lucene.apache.org/java/docs/
• 7: Robert DeLine , Mary Czerwinski , George Robertson, Easing Program Comprehension by Sharing Navigation Data, Proceedings of the 2005 IEEE Symposium on Visual Languages and Human-Centric Computing, p.241-248, September 20-24, 2005 [doi>10.1109/VLHCC.2005.32]
• 8: Robert DeLine , Amir Khella , Mary Czerwinski , George Robertson, Towards understanding programs through wear-based filtering, Proceedings of the 2005 ACM symposium on Software visualization, May 14-15, 2005, St. Louis, Missouri [doi>10.1145/1056018.1056044]
• 9: Eclipse Documentation: JDT Plug-in Developer Guide, http://help.eclipse.org/help32/index.jsp?topic=/org.eclipse.jdt.doc.isv/reference/api/org/eclipse/jdt/core/dom/package-summary.html
• 10: William C. Hill , James D. Hollan , Dave Wroblewski , Tim McCandless, Edit wear and read wear, Proceedings of the SIGCHI conference on Human factors in computing systems, p.3-9, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142751]
• 11: JUNG: Java Universal Network/Graph Framework, http://jung.sourceforge.net/
• 12: Mik Kersten , Gail C. Murphy, Mylar: a degree-of-interest model for IDEs, Proceedings of the 4th international conference on Aspect-oriented software development, p.159-168, March 14-18, 2005, Chicago, Illinois [doi>10.1145/1052898.1052912]
• 13: Andrew J. Ko , Htet Aung , Brad A. Myers, Eliciting design requirements for maintenance-oriented IDEs: a detailed study of corrective and perfective maintenance tasks, Proceedings of the 27th international conference on Software engineering, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062492]
• 14: Ko, A., Myers, B., A framework and methodology for studying the causes of software errors in programming systems, J. Visual Langs. Computing 16, 1--2, (2005).
• 15: Andrew J. Ko , Brad A. Myers , Duen Horng Chau, A Linguistic Analysis of How People Describe Software Problems, Proceedings of the Visual Languages and Human-Centric Computing, p.127-134, September 04-08, 2006 [doi>10.1109/VLHCC.2006.3]
• 16: Andrew J. Ko , Brad A. Myers , Michael J. Coblenz , Htet Htet Aung, An Exploratory Study of How Developers Seek, Relate, and Collect Relevant Information during Software Maintenance Tasks, IEEE Transactions on Software Engineering, v.32 n.12, p.971-987, December 2006 [doi>10.1109/TSE.2006.116]
• 17: Joseph Lawrance , Rachel Bellamy , Margaret Burnett, Scents in Programs: Does Information Foraging Theory Apply to Program Maintenance?, Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing, p.15-22, September 23-27, 2007 [doi>10.1109/VLHCC.2007.48]
• 18: Nielsen, J. Information foraging: Why Google makes people leave your site faster http://www.useit.com/alertbox/20030630.html. (June 30, 2003.)
• 19: Christopher Olston , Ed H. Chi, ScentTrails: Integrating browsing and searching on the Web, ACM Transactions on Computer-Human Interaction (TOCHI), v.10 n.3, p.177-197, September 2003 [doi>10.1145/937549.937550]
• 20: Peter Pirolli, Computational models of information scent-following in a very large browsable text collection, Proceedings of the SIGCHI conference on Human factors in computing systems, p.3-10, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258558]
• 21: Pirolli, P. and Card, S. Information foraging, Psychology Review 106, 4, (1999), 643--675.
• 22: Pirolli, P., and Fu, W. SNIF-ACT: A model of information foraging on the World Wide Web. Lecture Notes in Computer Science 2702, Springer (2003), 45--54.
• 23: Pirolli, P., Fu, W., Chi, E. and Farahat, A., Information scent and web navigation: Theory, models and automated usability evaluation. In Proc. HCI International, Erlbaum (2005).
• 24: Martin P. Robillard , Wesley Coelho , Gail C. Murphy, How Effective Developers Investigate Source Code: An Exploratory Study, IEEE Transactions on Software Engineering, v.30 n.12, p.889-903, December 2004 [doi>10.1109/TSE.2004.101]
• 25: Schneider, K., Gutwin, C., Penner, R., and Paquette, D. Mining a software developer's local interaction history, In Proc. Intl. Wkshp Mining Software Repositories, (2004).
• 26: T. Schümmer, Lost and Found in Software Space, Proceedings of the 34th Annual Hawaii International Conference on System Sciences ( HICSS-34)-Volume 9, p.9066, January 03-06, 2001
• 27: Jelber Sayyad Shirabad , Timothy C. Lethbridge , Stan Matwin, Mining the Maintenance History of a Legacy Software System, Proceedings of the International Conference on Software Maintenance, p.95, September 22-26, 2003
• 28: Janice Singer , Robert Elves , Margaret-Anne Storey, NavTracks: Supporting Navigation in Software Maintenance, Proceedings of the 21st IEEE International Conference on Software Maintenance, p.325-334, September 25-30, 2005 [doi>10.1109/ICSM.2005.66]
• 29: Spool, J., Profetti, C., and Britain, D., Designing for the scent of information, User Interface Eng. (2004).
• 30: A. Marie Vans , Anneliese von Mayhauser , Gabriel Somlo, Program understanding behavior during corrective maintenance of large-scale software, International Journal of Human-Computer Studies, v.51 n.1, p.31-70, July 1999 [doi>10.1006/ijhc.1999.0268]
• 31: Annie T. T. Ying , Gail C. Murphy , Raymond Ng , Mark C. Chu-Carroll, Predicting Source Code Changes by Mining Change History, IEEE Transactions on Software Engineering, v.30 n.9, p.574-586, September 2004 [doi>10.1109/TSE.2004.52]
• 32: Thomas Zimmermann , Peter Weisgerber , Stephan Diehl , Andreas Zeller, Mining Version Histories to Guide Software Changes, Proceedings of the 26th International Conference on Software Engineering, p.563-572, May 23-28, 2004

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

General Terms:
Human Factors

Keywords:
debugging, information foraging, software maintenance