Factors affecting the success of non-majors in learning to program

ABSTRACT

The introductory programming course is difficult for many university students, especially students who have little prior exposure to programming. Many factors affecting student success have been identified, but there is still a dearth of knowledge about how key factors combine to affect course outcomes. In this study we develop and empirically test a model integrating three factors of importance in learning to program: previous programming experience, perceived self-efficacy, and knowledge organization. The participants were non-majors. The findings showed that perceived self-efficacy increased significantly during a semester course. Previous experience affected perceived self-efficacy but not knowledge organization. Both perceived self-efficacy and knowledge organization had an effect on the course grade, as well as on success in a specific programming task, debugging. The results on self-efficacy also suggested that the participants were overconfident about their programming capabilities. The contribution of this paper is the identification of the joint effects of an important set of factors for programming success by non-majors.

REFERENCES

• 1: Adelson, B. Problem solving and the development of abstract categories in progrmming languages. Memory and Cognition, 9, 4 (1981), 422--433.
• 2: Adelson, B. When novices surpass experts: The difficulty of a task may increase with expertise. Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 3 (1984), 483--495.
• 3: Bandura, A. Self-efficacy. In V.S. Ramachaudran (Ed.), Encyclopedia of Human Behavior, Vol. 4, Academic Press, NY, 1994, 71--81.
• 4: Bandura, A. Self-efficacy: The Exercise of Control. W.H Freeman, NY, 1997.
• 5: Bandura, A. Social Foundations of Thought and Action. Prentice Hall, Englewood Cliffs, NJ, 1986.
• 6: Alan F. Blackwell, End-user developers at home, Communications of the ACM, v.47 n.9, September 2004 [doi>10.1145/1015864.1015892]
• 7: Barry Boehm , Victor R. Basili, Software Defect Reduction Top 10 List, Computer, v.34 n.1, p.135-137, January 2001 [doi>10.1109/2.962984]
• 8: Barry W. Boehm , Clark , Horowitz , Brown , Reifer , Chulani , Ray Madachy , Bert Steece, Software Cost Estimation with Cocomo II with Cdrom, Prentice Hall PTR, Upper Saddle River, NJ, 2000
• 9: Bunderson, E.D. and Christensen, M.E. An analysis of retention problems for female students in university computer science programs. Journal of Research on Computing in Education, 28, 1 (1995), 1--15.
• 10: Pat Byrne , Gerry Lyons, The effect of student attributes on success in programming, Proceedings of the 6th annual conference on Innovation and technology in computer science education, p.49-52, June 2001, Canterbury, United Kingdom
• 11: Chase, W.G. and Simon, H.A. The mind's eye in chess. In W.G. Chase (Ed.), Visual Information Processing. Academic Press, NY, 1973, 215--281.
• 12: Cohen, J. Statistical Power Analysis for the Social Sciences. Academic Press, NY, 1977.
• 13: Compeau, D.R. and Higgins, C.A. Application of social cognitive theory to training for computer skills. Information Systems Research, 6, 2 (1995), 118--143.
• 14: De Groot, A.D. Thought and Choice in Chess. Mouton, The Hague, 1965.
• 15: Di Persio, T., Isbister, D. and Shneiderman, B. An experiment using memorization/reconstruction as a measure of programmer ability. International Journal of Human-Computer Studies, 13 (1980), 339--353.
• 16: Egan, D.E. and Schwartz, B.J. Chunking in recall of symbolic drawings. Memory and Cognition, 7, 2 (1979), 149--158.
• 17: Gist, M.E and Mitchell, T.R Self-efficacy: a theoretical analysis of its determinants and malleability. Academy of Management Review, 17 (1992), 183--211.
• 18: Gist, M. E., Schwoerer, C. and Rosen, B. Effects of alternative training methods on self-efficacy and performance in computer software training. Journal of Applied Psychology, 74 (1989), 884--891.
• 19: Gugerty, L. and Olson, G.M. Comprehension differences in debugging by skilled and novice programmers. In E. Soloway and S. Iyengar (Eds.), Empirical Studies of Programmers. Ablex, Norwood, NJ, 1986, 80--98.
• 20: Mark Guzdial , Elliot Soloway, Teaching the Nintendo generation to program, Communications of the ACM, v.45 n.4, April 2002 [doi>10.1145/505248.505261]
• 21: Dianne Hagan , Selby Markham, Does it help to have some programming experience before beginning a computing degree program?, Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, p.25-28, July 11-13, 2000, Helsinki, Finland
• 22: Horn, C., Bruning, R., Schraw, G., Curry, E. and Katkanant, C. Paths to success in the college classroom. Contemporary Educational Psychology, 18 (1993), 464--478.
• 23: Kerlinger, F.N. and Pehazur, E.J. Multiple Regression in Behavioral Research. Holt, Reinhart and Winston, NY, 1973.
• 24: Kline, R.B. Principles and Practice of Structural Equation Modeling, 2nd Ed. Guilford Press, NY, 2004.
• 25: Martocchio, J. J. and Webster, J. Effects of feedback and cognitive playfulness on performance in microcomputer. software training. Personnel Psychology, 45 (1992), 553--578.
• 26: McKeithen, K.B., Reitman, J.S., Rueter, H.H.,and Hirtle, S.C. Knowledge organization and skill differences in computer programmers. Cognitive Psychology, 13 (1981), 307--325.
• 27: Dawn McKinney , Leo F. Denton, Houston, we have a problem: there's a leak in the CS1 affective oxygen tank, Proceedings of the 35th SIGCSE technical symposium on Computer science education, March 03-07, 2004, Norfolk, Virginia, USA
• 28: Mitchell, T.R., Hopper, H., Daniels, D., George-Falvy, J. and James, L.R. Predicting self-efficacy and performance during skill acquisition. Journal of Applied Psychology, 79, 4 (1994), 506--517.
• 29: Bonnie A. Nardi, A small matter of programming: perspectives on end user computing, MIT Press, Cambridge, MA, 1993
• 30: Pajares, F. Self-efficacy beliefs in academic settings. Review of Educational Research, 66, 4 (1996), 543--578.
• 31: Raymond R. Panko, What we know about spreadsheet errors, Journal of End User Computing, v.10 n.2, p.15-21, Spring 1998
• 32: Simon Peyton Jones , Alan Blackwell , Margaret Burnett, A user-centred approach to functions in excel, Proceedings of the eighth ACM SIGPLAN international conference on Functional programming, p.165-176, August 25-29, 2003, Uppsala, Sweden
• 33: Potosky, D. A field study of computer efficacy beliefs as an outcome of training: the role of computer playfulness, computer knowledge, and performance during training. Computers in Human Behavior, 18 (2002), 241--255.
• 34: Vennila Ramalingam , Deborah LaBelle , Susan Wiedenbeck, Self-efficacy and mental models in learning to program, Proceedings of the 9th annual SIGCSE conference on Innovation and technology in computer science education, June 28-30, 2004, Leeds, United Kingdom
• 35: Ramalingam V. and Wiedenbeck S. Development and validation of scores on a computer programming self-efficacy scale and group analyses of novice programmer self-efficacy. Journal of Educational Computing Research, 19, 4 (1998), 365--379.
• 36: Mary Beth Rosson , Julie Ballin , Heather Nash, Everyday Programming: Challenges and Opportunities for Informal Web Development, Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing (VLHCC'04), p.123-130, September 26-29, 2004 [doi>10.1109/VLHCC.2004.26]
• 37: Gregg Rothermel , Margaret Burnett , Lixin Li , Christopher Dupuis , Andrei Sheretov, A methodology for testing spreadsheets, ACM Transactions on Software Engineering and Methodology (TOSEM), v.10 n.1, p.110-147, Jan. 2001 [doi>10.1145/366378.366385]
• 38: Nathan Rountree , Janet Rountree , Anthony Robins, Predictors of success and failure in a CS1 course, ACM SIGCSE Bulletin, v.34 n.4, December 2002 [doi>10.1145/820127.820182]
• 39: Marian Gunsher Sackrowitz , Ann Parker Parelius, An unlevel playing field: women in the introductory computer science courses, Proceedings of the twenty-seventh SIGCSE technical symposium on Computer science education, p.37-41, February 15-17, 1996, Philadelphia, Pennsylvania, United States
• 40: Schumacker, R.E. and Lomax, R.G. A Beginner's Guide to Structural Equation Modeling. Lawrence Erlbaum, Hillsdale, NJ, 1996.
• 41: Schunk, D.H. Modeling and attributional effects on children's achievement: a self-efficacy analysis. Journal of Educational Psychology, 73, 1 (1981), 93--105.
• 42: Schunk, D.H. and Hanson, A.R. Peer models: influence on children's self-efficacy and achievement behaviors. Journal of Educational Psychology, 77 (1985), 313--322.
• 43: Schunk, D.H., Hanson, A.R. and Cox, P.D. Peer model attributes and children's achievement behaviors. Journal of Educational Psychology, 79 (1987), 54--61.
• 44: Shell, D.F., Murphy, C.C. and Bruning, R. Self-efficacy, and outcome expectancy mechanisms in reading and writing achievement. Journal of Educational Psychology, 81, 1 (1989), 91--100.
• 45: Shneiderman, B. Exploratory experiments in programmer behavior. International Journal of Computer and Information Sciences, 5, 2 (1976), 123--142.
• 46: Soloway, E. and Ehrlich, K. Empirical studies of programming knowledge. IEEE Transactions on Software Engineering, SE-10, 5 (1984), 595--609.
• 47: Taylor, H. and Mounfield, L. Exploration of the relationship between prior computing experience and gender on success in college computer science. Journal of Educational Computing Research, 11, 4 (1994), 291--306.
• 48: Lynda Thomas , Mark Ratcliffe , John Woodbury , Emma Jarman, Learning styles and performance in the introductory programming sequence, Proceedings of the 33rd SIGCSE technical symposium on Computer science education, February 27-March 03, 2002, Cincinnati, Kentucky
• 49: Torkzadeh, G. and Koufteros, X. Factorial validity of a computer self-efficacy scale and the impact of computer training. Educational and Psychological Measurement, 54, 3 (1994), 813--821.
• 50: Susan Wiedenbeck , Alec Engebretson, Comprehension Strategies of End-User Programmers in an Event-Driven Application, Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing (VLHCC'04), p.207-214, September 26-29, 2004 [doi>10.1109/VLHCC.2004.12]
• 51: E. M. Wilcox , J. W. Atwood , M. M. Burnett , J. J. Cadiz , C. R. Cook, Does continuous visual feedback aid debugging in direct-manipulation programming systems?, Proceedings of the SIGCHI conference on Human factors in computing systems, p.258-265, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258721]
• 52: Brenda Cantwell Wilson , Sharon Shrock, Contributing to success in an introductory computer science course: a study of twelve factors, Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education, p.184-188, February 2001, Charlotte, North Carolina, United States
• 53: Zimmerman, B. J. Self-efficacy and educational development. In A. Bandura (Ed.), Self- Efficacy in Changing Societies, Cambridge, Cambridge University Press, 1995, 203--231.
• 54: Zimmerman, B.J. and Bandura, A. Impact of self-regulatory influences on writing course attainment. American Educational Research Journal, 31, 4 (1994), 845--862.
• 55: Zimmerman, B.J., Bandura, A., and Martinez-Pons, M. Self-motivation for academic attainment: the role of self-efficacy beliefs and personal goal setting. American Educational Research Journal, 29, 3 (1992), 663--676.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Computer science education

General Terms:
Experimentation

Keywords:
debugging, end-user programmers, knowledge organization, learning to program, non-majors, self-efficacy