Justifying the business value of information systems education: a report on multi-cultural field experiments

ABSTRACT

There is little empirical evidence to support the value of information systems education and training. While IS training is conducted because of its direct impact on the accretion of skills, the lack of empirical evidence for the value of information systems education limits resource allocation for it. As organizations employ information technology which is more difficult to justify using standard cost/benefit methods, user information satisfaction (UIS) is becoming a useful metric to measure the business value of IT. In two multi-cultural field experiments it was found that information systems education caused statistically significant affects in UIS. In general, after viewing a video on the IS development process, end users became more satisfied with the information product and less satisfied with some aspects of IS support and staff, especially, the usual education and training provided.

REFERENCES

• 1: Alter, S. L. Decision Support Systems. Current Practices and Continuing Challenges, Reading, Mass: Addison Wesley, 1980.
• 2: Altman, Steven, Valenzi, Enzo, and Hodgetts, Richard M., Organizational Behavior: Theory and Practice, New York: Academic Press, Inc. 1985.
• 3: Bailey, James E. and Pearson, Sammy W. "Development of a Tool for Measuring and Analyzing Computer User Satisfaction," Management Science, 29:5, May 1983, pp. 519-529.
• 4: Jack J. Baroudi , Wanda J. Orlikowski, A short-form measure of user information satisfaction: a psychometric evaluation and notes on use, Journal of Management Information Systems, v.4 n.4, p.44-59, April 1988
• 5: Benson, D.H. "A Field Study of End User Computing: Findings and Issues," MIS Ouarterly, 7:4, December 1983, pp. 35-45.
• 6: Robert P. Bostrom , Lorne Olfman , Maung K. Sein, End-user computing: a research framework for investigating the training/learning process, Human factors in management information systems, Ablex Publishing Corp., Norwood, NJ, 1988
• 7: Brady, R. H. "Computers in Top-Level Decision Making", Harvard Business Review 45:4, July- August 1967, pp. 67-76.
• 8: Bronsema, G. and Keen, P., "Education Intervention and Implementation of MIS", Sloan Management Review, 24:4, Summer 1983, pp. 3S-42.
• 9: D. W. Conrath , O. P. Mignen, What is being done to measure user satisfaction with EDF/MIS, Information and Management, v.19 n.1, p.7-19, Aug. 1990 [doi>10.1016/0378-7206(90)90010-F]
• 10: T. P. Cronan , D. E. Douglas, End-user training and computing effectiveness in public agencies: An empirical study, Journal of Management Information Systems, v.6 n.4, p.21-39, Spring 1990
• 11: Gordon B. Davis , Margrethe H. Olson, Management information systems: conceptual foundations, structure, and development (2nd ed.), McGraw-Hill, Inc., New York, NY, 1984
• 12: William J. Doll , Gholamreza Torkzadeh, The measurement of end-user computing satisfaction, MIS Quarterly, v.12 n.2, p.259-274, June 1988 [doi>10.2307/248851]
• 13: Freund, Rudolf J. and Littell, Ramon, SAS For Linear Models: A Guide to the ANOVA and GLM Procedures, Cary, Nerth Carolina: SAS Institute Inc. 1981.
• 14: Fuerst, W. L. and Cheney, P. H., "Factors Affecting the Perceived Utilization of Computer-Based Decision Support Systems in the Oil Industry," Decision Sciences 13:4, October 1982, pp. 554-569.
• 15: Hall, D.T. and Schneider, B., "Correlates of Organizational Identification as a Function of Career Pattern and Organizational Type," Administrative Science Ouarterly, 17 (1972), pp. 340-350.
• 16: Hamilton, S. and Chervany, N.L. "Evaluating Information Systems Effectiveness," MIS Ouarterly, 5:4, December 1981, pp. 79-86.
• 17: Blake Ives , Margrethe H. Olson , Jack J. Baroudi, The measurement of user information satisfaction, Communications of the ACM, v.26 n.10, p.785-793, Oct. 1983 [doi>10.1145/358413.358430]
• 18: Karten, N., "Managing End-User Computing: An Insider's Perspective", Presentation at The International Federation of Information Processing Working Group 8.2 Working Conference on Desktop Information Technology, June 2, 1989, Cornell University, Ithaca, New York.
• 19: Leiberman, Seymour, "The Effects of Changes in Roles on the Attitudes or Role Occupants," Human Relations, April 1966, pp. 385-402.
• 20: Li, E.Y. "Perceived Importance of Information System Success Factors: A meta Analysis of Group Differences.
• 21: Lucas, H. C., Jr., Why Information Systems Fail. New York, N.Y.: Columbia University Press, 1975.
• 22: Mackfil, Bonnie, "Another Stab at Justifying Costs," Computerworld, XXII:35, p. 39.
• 23: Maish, A. M., "A User's Behavior Towards His MIS," MIS Ouarterly 3:1, March 1979, pp. 39-52.
• 24: Thomas P. Moran, Guest Editor's Introduction: An Applied Psychology of the User, ACM Computing Surveys (CSUR), v.13 n.1, p.1-11, March 1981 [doi>10.1145/356835.356836]
• 25: R Ryan Nelson , Paul H Cheney, Educating the CBIS user: a case analysis, ACM SIGMIS Database, v.18 n.2, p.11-16, Dec. 1987 [doi>10.1145/24673.24675]
• 26: R. Ryan Nelson , Paul H. Cheney, Training end users: an exploratory study, MIS Quarterly, v.11 n.4, p.547-559, Dec. 1987 [doi>10.2307/248985]
• 27: Porter, L.W. and Steers, R.M., "Organizational Work and Personal Factors in Employee Turnover and Absenteeism," Psychology Bulletin, 80 (1973), pp. 151-176.
• 28: Rappaport, R., Rappaport, R.N., and Willmott, eds. Human Relations, (Special Issue on Family and Work) 24 (1971).
• 29: Spatz C. and Johnston, J.O. Basic Statistics: Tales of Distributions, Brooks/Cole Publishing Company, Pacific Grove, CA, 1989.
• 30: Girish H. Subramanian , John T. Nosek, Perceived strategic value of information systems: measurement, determinants, and effects, Proceedings of the thirteenth international conference on Information systems, p.266-267, December 1992, Dallas, Texas, United States
• 31: Gayle J. Yaverbaum, Critical factors in the user environment: an experimental study of users, organizations and tasks, MIS Quarterly, v.12 n.1, p.75-88, March 1988 [doi>10.2307/248807]
• 32: Yaverbaum, G. and Culpan, O. "Exploring the Dynamics of the End-User Environment: The Impact of Education and Task Differences on Change," Technical Report TR88-0, Temple University, Division of Computer and Information Sciences, March 1988.
• 33: Gayle J. Yaverbaum , John Nosek, Effects of information system education and training on user satisfaction: an empirical evaluation, Information and Management, v.22 n.4, p.217-225, April 1992 [doi>10.1016/0378-7206(92)90024-A]

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION

General Terms:
Documentation, Management

Keywords:
field experiment, information systems education and training, user information satisfaction