Towards understanding programs through wear-based filtering

ABSTRACT

Large software projects often require a programmer to make changes to unfamiliar source code. This paper presents the results of a formative observational study of seven professional programmers who use a conventional development environment to update an unfamiliar implementation of a commonly known video game. We describe several usability problems they experience, including keeping oriented in the program's source text, maintaining the number and layout of open text documents and relying heavily on textual search for navigation. To reduce the cost of transferring knowledge about the program among developers, we propose the idea of wear-based filtering, a combination of computational wear and social filtering. The development environment collects interaction information, as with computational wear, and uses that information to direct the attention of subsequent users, as with social filtering. We present sketches of new visualizations that use wear-based filtering and demonstrate the feasibility of our approach with data drawn from our study.

REFERENCES

• 1: C. F. Bertholf and J. Scholtz, "Program Comprehension of Literate Programs by Novice Programmers., "Empirical Studies of Programmers: Fifth Workshop., Norwood, NJ, 1993.
• 2: R. Brooks, "Towards a Theory of the Comprehension of Computer Programs, "International Journal of Man-Machine Studies 18, vol. 18, pp. 543--554, 1983.
• 3: "Camtasia Studio, "TechSmith.
• 4: Cohen, J., editor, "Special Issue on Information Filtering," in Communications of the ACM, vol. 35, 1992.
• 5: M. E. Crosby, J. Scholtz, and S. Wiedenbeck, "The Roles Beacons Play in Comprehension for Novice and Expert Programmers," in Proceedings of PPIG, 2002.
• 6: Mary Czerwinski , Susan Dumais , George Robertson , Susan Dziadosz , Scott Tiernan , Maarten van Dantzich, Visualizing implicit queries for information management and retrieval, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.560-567, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303158]
• 7: Stephen G. Eick , Joseph L. Steffen , Eric E. Sumner, Jr., Seesoft-A Tool for Visualizing Line Oriented Software Statistics, IEEE Transactions on Software Engineering, v.18 n.11, p.957-968, November 1992 [doi>10.1109/32.177365]
• 8: E. M. Gellenbeck and C. R. Cook, "An Investigation of Procedure and Variable Names as Beacons during Program Comprehension, "Empirical Studies of Programmers, fourth Workshop, ed. J. Koenemann-Belliveau, T. G. Moher and S. P. Robertson, Ablex, Norwood NJ, 1991.
• 9: David Goldberg , David Nichols , Brian M. Oki , Douglas Terry, Using collaborative filtering to weave an information tapestry, Communications of the ACM, v.35 n.12, p.61-70, Dec. 1992 [doi>10.1145/138859.138867]
• 10: T. R. G. Green and M. Petre, "When Visual Programs are Harder to Read than Textual Programs," in Human-Computer Interaction: Tasks and Organisation, Proceedings {ECCE}-6 (6th European Conference Cognitive Ergonomics), 1992.
• 11: William C. Hill , James D. Hollan , Dave Wroblewski , Tim McCandless, Edit wear and read wear, Proceedings of the SIGCHI conference on Human factors in computing systems, p.3-9, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142751]
• 12: Joseph A. Konstan , Bradley N. Miller , David Maltz , Jonathan L. Herlocker , Lee R. Gordon , John Riedl, GroupLens: applying collaborative filtering to Usenet news, Communications of the ACM, v.40 n.3, p.77-87, March 1997 [doi>10.1145/245108.245126]
• 13: B. Lee and B. Bederson, "Favorite Folders: A Configurable, Scalable File Browser," UMD 2003.
• 14: Stanley Letovsky, Cognitive processes in program comprehension, Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, p.58-79, June 1986, Washington, D.C., United States
• 15: David C. Littman , Jeannine Pinto , Stanley Letovsky , Elliot Soloway, Mental models and software maintenance, Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, p.80-98, June 1986, Washington, D.C., United States
• 16: Anneliese von Mayrhauser , A. Marie Vans, Program Comprehension During Software Maintenance and Evolution, Computer, v.28 n.8, p.44-55, August 1995 [doi>10.1109/2.402076]
• 17: A. von Mayrhauser , A. M. Vans, Identification of Dynamic Comprehension Processes During Large Scale Maintenance, IEEE Transactions on Software Engineering, v.22 n.6, p.424-437, June 1996 [doi>10.1109/32.508315]
• 18: A. V. Mayrhauser and A. M. Vans, Program Comprehension During Software Maintenance and Evolution: IEEE Computer Society Press, 2001.
• 19: Paul W. Oman , Curtis R. Cook, Typographic style is more than cosmetic, Communications of the ACM, v.33 n.5, p.506-520, May 1990 [doi>10.1145/78607.78611]
• 20: Nancy Pennington, Comprehension strategies in programming, Empirical studies of programmers: second workshop, Ablex Publishing Corp., Norwood, NJ, 1987
• 21: N. Pennington, "Stimulus Structures and Mental Representations In Expert Comprehension of Computer Programs," Cognitive Psychology, vol. 19, pp. 295--341, 1987.
• 22: Marian Petre, Why looking isn't always seeing: readership skills and graphical programming, Communications of the ACM, v.38 n.6, p.33-44, June 1995 [doi>10.1145/203241.203251]
• 23: Robert S. Rist, Plans in programming: definition, demonstration, and development, Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, p.28-47, June 1986, Washington, D.C., United States
• 24: David A. Scanlan, Structured Flowcharts Outperform Pseudocode: An Experimental Comparison, IEEE Software, v.6 n.5, p.28-36, September 1989 [doi>10.1109/52.35587]
• 25: Schneider, K. A., Gutwin, C., Penner, R. and Paquette, D. "Mining a Software Developer's Local Interaction History," 1st International Workshop on Mining Software Repositories, 2004.
• 26: Upendra Shardanand , Pattie Maes, Social information filtering: algorithms for automating “word of mouth”, Proceedings of the SIGCHI conference on Human factors in computing systems, p.210-217, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223931]
• 27: B. Shneiderman, "Measuring computer program quality and comprehension," International Journal of Man-Machine Studies, vol. 9, pp. 465--478, 1977.
• 28: Ben Shneiderman , Richard Mayer , Don McKay , Peter Heller, Experimental investigations of the utility of detailed flowcharts in programming, Communications of the ACM, v.20 n.6, p.373-381, June 1977 [doi>10.1145/359605.359610]
• 29: Ben Shneiderman , Richard Mayer , Don McKay , Peter Heller, Experimental investigations of the utility of detailed flowcharts in programming, Communications of the ACM, v.20 n.6, p.373-381, June 1977 [doi>10.1145/359605.359610]
• 30: E. Soloway , K. Ehrlich, Empirical studies of programming knowledge, Readings in artificial intelligence and software engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1986
• 31: Margaret-Anne D. Storey , Kenny Wong , Hausi A. Müller, Rigi: a visualization environment for reverse engineering, Proceedings of the 19th international conference on Software engineering, p.606-607, May 17-23, 1997, Boston, Massachusetts, United States [doi>10.1145/253228.253496]
• 32: S. Wiedenbeck, Beacons in computer program comprehension, International Journal of Man-Machine Studies, v.25 n.6, p.697-709, Dec. 1986 [doi>10.1016/S0020-7373(86)80083-9]
• 33: Susan Wiedenbeck, Novice/expert differences in programming skills, International Journal of Man-Machine Studies, v.23 n.4, p.383-390, Oct. 1985 [doi>10.1016/S0020-7373(85)80041-9]
• 34: Susan Wiedenbeck , Jean Scholtz, Beacons: a knowledge structure in program comprehension, Proceedings of the third international conference on human-computer interaction on Designing and using human-computer interfaces and knowledge based systems (2nd ed.), p.82-87, September 1989, Boston, Massachusetts, United States

INDEX TERMS

Keywords:
collaborative filtering, computational wear, implicit query, program comprehension, software visualization