Conceptual frameworks in practice: evaluating end-user training strategy in an organization

ABSTRACT

Rapid development in new information technology requires constant need for training end user. Organisations spend heavily on training, but do not take an integrative approach in formulating training strategies. This is mainly due to lack of guidance from the literature. A few frameworks that have been proposed have not been evaluated. In this paper, we use one such framework and use it to evaluate the training strategy in an organisation. This summative evaluation is followed by the formative evaluation of the framework itself. Based on our findings, we conclude that the framework is useful to evaluate organisational training efforts. However, we also point out deficiencies in the framework itself and suggest areas of improvement.

REFERENCES

• 1: ASTD http://www.astd.org, {accessed 28.11.02}
• 2: BakerHughes.com {a} http://www.bakerhughes.com/bakerhughes/views/, {accessed 21.11.2002}
• 3: BakerHughes.com {b} http://www.bakerhughes.com/bakerhughes/companies/index.htm, {accessed 26.10. 02}
• 4: BakerHughes.com {c} http://www.bakerhughes.com/investor/about/core_values.htm, {accessed 26.10.2002}
• 5: BH Annual Report 2002 http://www.bakerhughes.com/investor/information/arlist.htm {accessed 26.10.2002}
• 6: Robert P. Bostrom , Lorne Olfman , Maung K. Sein, The importance of learning style in end-user training, MIS Quarterly, v.14 n.1, p.101-119, March 1990 [doi>10.2307/249313]
• 7: John M. Carroll , Mary Beth Rosson, Managing evaluation goals for training, Communications of the ACM, v.38 n.7, p.40-48, July 1995 [doi>10.1145/213859.214796]
• 8: Deborah Compeau , Lorne Olfman , Maung Sei , Jane Webster, End-user training and learning, Communications of the ACM, v.38 n.7, p.24-26, July 1995 [doi>10.1145/213859.214791]
• 9: Geus de, A. Planning as learning. Harvard Business Review, (Mar/ Apr 1988)
• 10: Lorne Olfman , Robert P. Bostrom , Maung K. Sein, A best-practice based model for information technology learning strategy formulation, Proceedings of the 2003 SIGMIS conference on Computer personnel research: Freedom in Philadelphia--leveraging differences and diversity in the IT workforce, April 10-12, 2003, Philadelphia, Pennsylvania [doi>10.1145/761849.761863]
• 11: Overman, E. S. and Boyd, K. J. Best practice research and post-bureaucratic reform. Journal of Public Administration Research & Theory, 4, (1994). 67--83.
• 12: Patton, M. Q. Qualitative Research & Evaluation Methods. Sage Publications, 3rd edition, 2002.
• 13: Santhanam, R. Improving training outcomes using pre-training scripts: a theory of planned behavior approach. Information and Organization, 12, (2002), 135--152.
• 14: Senge P., Kleiner A., Roberts C., Ross R., Roth G. & Smith B. The Dance of Change. The Challenges of Sustaining Momentum in Learning Organizations. Nicholas Brealey Publishing, 1999.
• 15: Silverman, D. Interpreting Qualitative Data. Methods for Analysing Talk, Text & Interaction. Sage Publications 2nd edition, 2001.
• 16: Simonsen, M. Theoretical Frameworks in Practice: Evaluating End-User IT Training Strategies at Baker Hughes INTEQ. Unpublished Cand. Politi thesis. University of Bergen, Bergen, Norway, 2003.
• 17: Smith, C. and Sutton, F. Best practice: what it is and what it is not. International Journal of Nursing Practice, 5, (1999). 100--105.
• 18: Tessmer M.. Formative multimedia evaluation Training Research Journal, 1, (1995), 127--149.
• 19: Yin, R.K. Case Study Research. Design and Methods Applied social research methods series, vol. 5. Sage publications, 2nd edition, 1994.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.1 Project and People Management
          Subjects: Training

General Terms:
Human Factors, Management, Measurement, Performance

Keywords:
end-user training, learning, personnel