Effectiveness of end-user debugging software features: are there gender issues?

ABSTRACT

Although gender differences in a technological world are receiving significant research attention, much of the research and practice has aimed at how society and education can impact the successes and retention of female computer science professionals-but the possibility of gender issues within software has received almost no attention. If gender issues exist with some types of software features, it is possible that accommodating them by changing these features can increase effectiveness, but only if we know what these issues are. In this paper, we empirically investigate gender differences for end users in the context of debugging spreadsheets. Our results uncover significant gender differences in self-efficacy and feature acceptance, with females exhibiting lower self-efficacy and lower feature acceptance. The results also show that these differences can significantly reduce females' effectiveness.

REFERENCES

• 1: Allwood, C. Error detection processes in statistical problem solving. Cognitive Science 8, 4 (1984), 413--437.
• 2: Bandura, A. Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review 8, 2 (1977), 191--215.
• 3: Bandura, A. Social Foundations of Thought and Action. Prentice Hall, Englewood Cliffs NJ, 1986.
• 4: Laura Beckwith , Margaret Burnett, Gender: An Important Factor in End-User Programming Environments?, Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing (VLHCC'04), p.107-114, September 26-29, 2004 [doi>10.1109/VLHCC.2004.28]
• 5: Beyer, S., DeKeuster, M., Rynes, K., Kostman, A., and DeGregorio, N. Barriers to women's success in Management Information Systems courses. In Proc. American Psychological Society (2004).
• 6: Alan F. Blackwell, First Steps in Programming: A Rationale for Attention Investment Models, Proceedings of the IEEE 2002 Symposia on Human Centric Computing Languages and Environments (HCC'02), p.2, September 03-06, 2002
• 7: Margaret Burnett , John Atwood , Rebecca Walpole Djang , James Reichwein , Herkimer Gottfried , Sherry Yang, Forms/3: A first-order visual language to explore the boundaries of the spreadsheet paradigm, Journal of Functional Programming, v.11 n.2, p.155-206, March 2001
• 8: Margaret Burnett , Curtis Cook , Gregg Rothermel, End-user software engineering, Communications of the ACM, v.47 n.9, September 2004 [doi>10.1145/1015864.1015889]
• 9: Busch, T. Gender differences in self-efficacy and attitudes toward computers. Journal of Educational Computing Research 12, 2 (1995), 147--158.
• 10: Byrnes, J. P., Miller, D. C. and Schafer W. D. Gender differences in risk taking: A meta-analysis. Psychological Bulletin 125, (1999), 367--383.
• 11: Tracy Camp, The incredible shrinking pipeline, Communications of the ACM, v.40 n.10, p.103-110, Oct. 1997 [doi>10.1145/262793.262813]
• 12: Deborah R. Compeau , Christopher A. Higgins, Computer self-efficacy: development of a measure and initial test, MIS Quarterly, v.19 n.2, p.189-211, June 1995 [doi>10.2307/249688]
• 13: Deborah Compeau , Christopher A. Higgins , Sid Huff, Social cognitive theory and individual reactions to computing technology: a longitudinal study, MIS Quarterly, v.23 n.2, p.145-158, June 1999 [doi>10.2307/249749]
• 14: Mary Czerwinski , Desney S. Tan , George G. Robertson, Women take a wider view, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503412]
• 15: Davis, F. D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly 13, 3 (1989), 319--340.
• 16: Finucane, M., Slovic, P., Merz., C-K., Flynn, J. and Satterfield, T. Gender, race and perceived risk: the white male effect. Health, Risk and Society 2, 2 (2000), 159--172.
• 17: Allan Fisher , Jane Margolis , Faye Miller, Undergraduate women in computer science: experience, motivation and culture, Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education, p.106-110, February 27-March 01, 1997, San Jose, California, United States
• 18: Kathleen Hartzel, How self-efficacy and gender issues affect software adoption and use, Communications of the ACM, v.46 n.9, September 2003 [doi>10.1145/903893.903933]
• 19: Chuck Huff, Gender, software design, and occupational equity, ACM SIGCSE Bulletin, v.34 n.2, June 2002 [doi>10.1145/543812.543842]
• 20: Jiankoplos, N. A. and Bernasek, A. Are women more risk averse? Economic Inquiry 36, 4 (1998), 620--630.
• 21: Margolis, J., Fisher, A., Miller, F., Caring about connections: Gender and computing, IEEE Technology and Society Magazine 18, 4 (1999), 13--20.
• 22: Nass, C., Moon, Y., and Green, C. Are machines gender-neutral? Gender-stereotypic responses to computers with voices. Journal of Applied Social Psychology 27, (1997), 864--876.
• 23: Raymond R. Panko, What we know about spreadsheet errors, Journal of End User Computing, v.10 n.2, p.15-21, Spring 1998
• 24: T. J. Robertson , Shrinu Prabhakararao , Margaret Burnett , Curtis Cook , Joseph R. Ruthruff , Laura Beckwith , Amit Phalgune, Impact of interruption style on end-user debugging, Proceedings of the SIGCHI conference on Human factors in computing systems, p.287-294, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985729]
• 25: Gregg Rothermel , Margaret Burnett , Lixin Li , Christopher Dupuis , Andrei Sheretov, A methodology for testing spreadsheets, ACM Transactions on Software Engineering and Methodology (TOSEM), v.10 n.1, p.110-147, Jan. 2001 [doi>10.1145/366378.366385]
• 26: Joseph R. Ruthruff , Margaret Burnett , Gregg Rothermel, An empirical study of fault localization for end-user programmers, Proceedings of the 27th international conference on Software engineering, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062523]
• 27: Joseph R. Ruthruff , Amit Phalgune , Laura Beckwith , Margaret Burnett , Curtis Cook, Rewarding "Good" Behavior: End-User Debugging and Rewards, Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing (VLHCC'04), p.115-122, September 26-29, 2004 [doi>10.1109/VLHCC.2004.44]
• 28: Desney S. Tan , Mary Czerwinski , George Robertson, Women go with the (optical) flow, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642649]
• 29: Torkzadeh, G. and Koufteros, X. Factorial validity of a computer self-efficacy scale and the impact of computer training. Educational and Psychological Measurement 54, 3 (1994), 813--821.
• 30: Torkzadeh, G. and Van Dyke, T. Effects of training on internet self-efficacy and computer user attitudes. Computers in Human Behavior 18, (2002), 479--494.
• 31: Viswanath Venkatesh , Michael G. Morris, Why don't men ever stop to ask for directions? Gender, social influence, and their role in technology acceptance and usage behavior, MIS Quarterly, v.24 n.1, p.115-139, March 2000 [doi>10.2307/3250981]
• 32: Whitworth, J. E., Price, B. A. and Randall, C. H. Factors that affect college of business student opinion of teaching and learning. Journal of Education for Business 77, 5 (2002), 282--289.
• 33: Aaron Wilson , Margaret Burnett , Laura Beckwith , Orion Granatir , Ledah Casburn , Curtis Cook , Mike Durham , Gregg Rothermel, Harnessing curiosity to increase correctness in end-user programming, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642665]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.1 Office Automation
          Subjects: Spreadsheets
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
debugging, end-user programming, end-user software engineering, gender, surprise-explain-reward