The perceptual evaluation of information systems using the construct of user satisfaction: case study of a large french group

ABSTRACT

This research work concerns the perceptual evaluation of the performance of information systems (IS) and more particularly, the construct of user satisfaction. Faced with the difficulty of obtaining objective measures for the success of IS, user satisfaction appeared as a substitutive measure of IS performance (DeLone & McLean, 1992). Some researchers have indeed shown that the evaluation of an IS could not happen without an analysis of the feelings and perceptions of individuals who make use of it. Consequently, the concept of satisfaction has been considered as a guarantee of the performance of an IS. Also it has become necessary to ponder the drivers of user satisfaction. The analysis of models and measurement tools for satisfaction as well as the adoption of a contingency perspective has allowed the description of principal dimensions that have a direct or less direct impact on user perceptions

The case study of a large French group, carried out through an interpretativist approach conducted by way of 41 semi-structured interviews, allowed the conceptualization of the problematique of perceptual evaluation of IS in a particular field study. This study led us to confirm the impact of certain factors (such as perceived usefulness, participation, the quality of relations with the IS Function and its resources and also the fit of IS with user needs). On the contrary, other dimensions regarded as fundamental do not receive any consideration or see their influence nuanced in the case studied (the properties of IS, the ease of use, the quality of information). Lastly, this study has allowed for the identification of the influence of certain contingency and contextual variables on user satisfaction and, above all, for the description of the importance of interactions between the IS Function and the users

REFERENCES

• 1: Paul Alpar , Moshe Kim, A microeconomic approach to the measurement of information technology value, Journal of Management Information Systems, v.7 n.2, p.55-69, Oct. 1990
• 2: Steven Alter, A general, yet useful theory of information systems, Communications of the AIS, v.1 n.3es, March 1999
• 3: Avison, D.E. and Myers, M.D. (2002). "La Recherche Qualitative en Systèmes D¿information," Faire de la Recherche en Systèmes d¿Information, Editions Vuibert, Fnege.
• 4: Bailey, J.E. and Pearson, S.W. (1983). "Development of a Tool for Measuring and Analysing Computer User Satisfaction", Management Science, Vol. 29, No.5.
• 5: J. Ballantine , M. Bonner , M. Levy , A. Martin , I. Munro , P. L. Powell, The 3-D model of information systems success: the search for the dependent variable continues, Information Resources Management Journal, v.9 n.4, p.5-14, Fall 1996
• 6: Barki, H. and Hartwick, J. (1991). "User Participation and User Involvement in Information System Development," Proceedings of the 24th Annual Hawaii International Conference on System Sciences, Kauai, HI, Vol.4, pp. 487--492.
• 7: Henri Barki , Jon Hartwick, Measuring user participation, user involvement, and user attitude, MIS Quarterly, v.18 n.1, p.59-82, March 1994 [doi>10.2307/249610]
• 8: Jack J. Baroudi , Wanda J. Orlikowski, A short-form measure of user information satisfaction: a psychometric evaluation and notes on use, Journal of Management Information Systems, v.4 n.4, p.44-59, April 1988
• 9: Baroudi, J.J. and Orlikowski, W.J. (1991). "Studying Information Technologies in Organizations: Research Approaches and Assumptions," Information Systems Research, Vol.2, No.1, pp. 1--28.
• 10: Anandhi S. Bharadwaj, A resource-based perspective on information technology capability and firm performance: an empirical investigation, MIS Quarterly, v.24 n.1, p.169-196, March 2000 [doi>10.2307/3250983]
• 11: Bonner, M. (1995). "DeLone and McLean's Model for Judging Information Systems Success - A Retrospective Application in Manufacturing," Proceedings of the European Conference on IT Investment Evaluation, Henley Management College, UK, pp. 218--226.
• 12: Bostrom, R.P. and Heinen, J.S. (1977). "MIS Problems and Failures: A Socio-Technical Perspective. Part I : The Causes," MIS Quarterly, Vol.1, No.3, pp. 17--32.
• 13: Robert M. Brown , Amy W. Gatian , James O. Hicks, Jr., Strategic information systems and financial performance, Journal of Management Information Systems, v.11 n.4, p.215-248, March 1995
• 14: Erik Brynjolfsson , Lorin Hitt, Paradox lost? Firm-level evidence on the returns to information systems spending, Management Science, v.42 n.4, p.541-558, April 1996 [doi>10.1287/mnsc.42.4.541]
• 15: D. W. Conrath , O. P. Mignen, What is being done to measure user satisfaction with EDF/MIS, Information and Management, v.19 n.1, p.7-19, Aug. 1990 [doi>10.1016/0378-7206(90)90010-F]
• 16: Cron, W., Sobol, M. (1983). "The Relationship between Computerization and Performance: A Strategy for Maximizing Economic Benefits of Computerization," Information & Management, Vol.6, pp. 171--181.
• 17: Crozier, M. and Friedberg, E. (1977). L'Acteur et le Système : Les Contraintes de l'Action Collective, Paris: Edition du Seuil.
• 18: Cyert, R. and March, H.J. (1963). A Behavioral Theory of the Firm, Englewood Cliffs, NJ: Prentice Hall.
• 19: Davis, F.D. (1989). "Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology," MIS Quarterly, Vol.13, No.3, pp. 319--340.
• 20: Delone, H.W. and McLean, R.E. (1992). "Information Systems Success: The Quest for the Dependent Variable," Information Systems Research, Vol.3, No.1, pp. 60--95.
• 21: Delone, H.W. and McLean, R.E. (2003). "The DeLone and McLean Model of Information Systems Success: A Ten-Year Update," Journal of Management Information Systems, Vol.19, No.4, pp. 9--30.
• 22: Devereux, G. (1980). De l'angoisse à la mèthode dans les Sciences du Comportement, Flammarion.
• 23: William J. Doll , Gholamreza Torkzadeh, The measurement of end-user computing satisfaction, MIS Quarterly, v.12 n.2, p.259-274, June 1988 [doi>10.2307/248851]
• 24: Eisenhardt, K.M. (1989). "Building Theories from Case Study Research," Academy of Management Review, Vol.14, No.4, pp. 532--550.
• 25: Galletta, D. F. and Lederer, A. L. (1989). "Some Cautions on the Measurement of User Information Satisfaction," Decisions Science Journal, Vol. 20, No.3, pp. 419--439.
• 26: Galletta, D.F. and Heckman, R.L. (1990). "A Role Theory Perspective on End-User Development", Information Systems Research, Vol.1, No.2, pp. 168--187.
• 27: Gallagher, C.A. (1974). "Perceptions of the Value of Management Information Systems", Academy of Management Journal, Vol.17, No.1, pp. 46--55.
• 28: Galliers R., (1992) Information Systems Research: Issues, Methods and Practical Guidelines, Blackwell Scientific Editions.
• 29: Maarten Gelderman, The relation between user satisfaction, usage of information systems and performance, Information and Management, v.34 n.1, p.11-18, Aug. 5, 1998 [doi>10.1016/S0378-7206(98)00044-5]
• 30: Ginzberg, M.J. (1981). "Key Recurrent Issues in the MIS Implementation Process," MIS Quarterly, Vol.5, No.5, pp. 47--59.
• 31: Girin, J. (1981). "Quel Paradigme pour la Recherche en Gestion?", Economies et Sociètès, Vol.15, No.10-12, Sèrie Sciences de gestion, No. 2, pp. 1971--1889.
• 32: Girod-Seville, M. and Perret, V. (1999). "Fondements Epistèmologiques de la Recherche," dans THIETART R.A., Mèthodes de Recherche en Management, Dunod.
• 33: Dale L. Goodhue, Understanding user evaluations of information systems, Management Science, v.41 n.12, p.1827-1844, Dec. 1995 [doi>10.1287/mnsc.41.12.1827]
• 34: Dale L. Goodhue , Ronald L. Thompson, Task-technology fit and individual performance, MIS Quarterly, v.19 n.2, p.213-236, June 1995 [doi>10.2307/249689]
• 35: Hamilton, S. and Chervany, N.L. (1981). "Evaluating Information System Effectiveness - Part I: Comparing Evaluation Approaches ; Part II: Comparing Evaluator Viewpoints," MIS Quarterly, Vol.5, No.4, pp. 79--86.
• 36: Michael D. Ishman, Measuring information success at the individual level in cross-cultural environments, Information Resources Management Journal, v.9 n.4, p.16-28, Fall 1996
• 37: Blake Ives , Margrethe H. Olson , Jack J. Baroudi, The measurement of user information satisfaction, Communications of the ACM, v.26 n.10, p.785-793, Oct. 1983 [doi>10.1145/358413.358430]
• 38: Ives, B. and Olson, M.H. (1992). "User Involvement and MIS Success," Management Science, Vol.30, No.5, pp. 586--603.
• 39: Ephraim R. McLean , Leon A. Kappelman, The convergence of organizational and end-user computing, Journal of Management Information Systems, v.9 n.3, p.145-155, Winter 1992–93
• 40: Kappelman, L.A. and McLean, E.R. (1994). "User Engagement in the Development, Implementation, and Use of Information Technologies," Proceedings of the Twenty-Seventh Annual Hawaii International Conference on System Science, Maui, Hawaii, USA, pp. 512--521.
• 41: Kefi, H. (2002). "èvaluation des technologies et systèmes d' information : cas d'un entrepôt de donnèes implantè dans une institution financière", Thèse de Doctorat en Sciences de Gestion, Direction Professeur Kalika, Universitè Paris IX Dauphine.
• 42: Khalifa, M. and Liu, V. (2003). "Determinants of Satisfaction at Different Adoption Stages of Internet-Based Services," Journal of The Association for Information Systems, Vol.4, No.5, pp. 206--232.
• 43: King, R.W. and Epstein, B.J. (1983). "Assessing Information Systems Value," Decision Sciences, Vol.14, No.1, pp. 34--45.
• 44: King, R.W. and Rodriguez, J.I. (1978). "Evaluating Management Information Systems," MIS Quarterly, Vol.2, No.3, pp. 43--51.
• 45: Heinz K. Klein , Michael D. Myers, A set of principles for conducting and evaluating interpretive field studies in information systems, MIS Quarterly, v.23 n.1, p.67-93, March 1999 [doi>10.2307/249410]
• 46: Kwon, T.A. (1990). "A Diffusion of Innovation Approach to MIS Infusion : Conceptualization, Methodology and Management Strategy," Proceedings of the Eleventh International Conference on Information Systems, Copenhagen, Denmark, pp.139--146.
• 47: Larcker, D.F. and Lessig, V.P. (1980). "Perceived Usefulness of information: A psychometric examination," Decision Sciences, Vol.11, No.11, pp. 121--134.
• 48: Lawrence, P.R and Lorsch, J.W. (1973). Adapter les Structures, Editions d'Organisation.
• 49: Le Moigne, J.L. (1990). "Épistèmologies constructivistes et sciences de l'organisation," dans MARTINET, A.C., Épistèmologies et sciences de gestion, Paris, Économica.
• 50: Lucas, H.C. (1973). "A Descriptive Model of Information Systems in the Context of the Organization," Data Base, Vol.5, No.2, pp. 27--39.
• 51: Lucas, H.C. (1978). "Empirical Evidence for a Descriptive Model of Implementation," MIS Quarterly, Vol.2, No.2, pp. 27--42.
• 52: Mo Adam Mahmood , Janice M. Burn , Leopoldo A. Gemoets , Carmen Jacquez, Variables affecting information technology end-user satisfaction: a meta-analysis of the empirical literature, International Journal of Human-Computer Studies, v.52 n.4, p.751-771, April 2000 [doi>10.1006/ijhc.1999.0353]
• 53: Marciniak, R. (1996). "Management des Projets Informatiques: Complexitè et Gestion des conflits," Systèmes d'information et Management, Vol.1, No.1, pp. 27--50.
• 54: Markus, M.L. and Robey, D. (1984). "Rituals in Information System Design", MIS Quarterly, Vol.8, No.8, pp. 5--15.
• 55: M. Lynne Markus , Daniel Robey, Information technology and organizational change: causal structure in theory and research, Management Science, v.34 n.5, p.583-599, May 1988 [doi>10.1287/mnsc.34.5.583]
• 56: James D. McKeen , Tor Guimaraes , James C. Wetherbe, The relationship between user participation and user satisfaction: an investigation of four contingency factors, MIS Quarterly, v.18 n.4, p.427-451, Dec. 1994 [doi>10.2307/249523]
• 57: James D. McKeen , Tor Guimaraes, Successful strategies for user participation in systems development, Journal of Management Information Systems, v.14 n.2, p.133-150, September 1997
• 58: N. P. Melone, A theoretical assessment of the user-satisfaction construct in information systems research, Management Science, v.36 n.1, p.76-91, Jan. 1990 [doi>10.1287/mnsc.36.1.76]
• 59: Miles, A.M. and Huberman, B.M. (1991). Analyse des Donnèes Qualitatives, Recueil de Nouvelles Mèthodes, De Boeck Universitè, Bruxelles.
• 60: Barry L. Myers , Leon A. Kappelman , Victor R. Prybutok, A comprehensive model for assessing the quality and productivity of the information systems function: toward a theory for information systems assessment, Information systems success measurement, IGI Publishing, Hershey, PA, 1998
• 61: Neumann, S. and Segev, E. (1980). "Evaluate your Information System," Systems Management, Vol.31, No.3, pp. 34--41.
• 62: Powers, R. F. and Dickson, G.W. (1973). "MIS Project Management: Myths, Opinion and Reality", California Management Review, Vol.15, No. 3, pp. 147--156.
• 63: Orlikowski, W. (1992). "The Duality of Technology: Rethinking the Concept of Technology in Organizations," Organization Science, Vol.3, No.3, pp. 398--427.
• 64: Arun Rai , Ravi Patnayakuni , Nainika Patnayakuni, Technology investment and business performance, Communications of the ACM, v.40 n.7, p.89-97, July 1997 [doi>10.1145/256175.256191]
• 65: Reix, R. (2002). Systèmes d'Information et Management des Organisations, Editions Vuibert Gestion, 4ème Edition.
• 66: Rowe, F. (2002). Faire de la Recherche en Systèmes d'Information, Vuibert, Fnege.
• 67: V. Sambamurthy , Robert W. Zmud, Arrangements for information technology governance: a theory of multiple contingencies, MIS Quarterly, v.23 n.2, p.261-290, June 1999 [doi>10.2307/249754]
• 68: Carol Stoak Saunders , Jack William Jones, Measuring performance of the information systems function, Journal of Management Information Systems, v.8 n.4, p.63-82, Spring 1992
• 69: Seddon, P.B. (1997). "A Respecification and Extension of the DeLone and McLean Model of IS Success," Information Systems Research, Vol.8, No.3, pp. 240--253.
• 70: Detmar Straub , Moez Limayem , Elena Karahanna-Evaristo, Measuring system usage: implications for IS theory testing, Management Science, v.41 n.8, p.1328-1342, Aug. 1995 [doi>10.1287/mnsc.41.8.1328]
• 71: Solow R.M., (1987), "We'd better watch out", New York Times, 12th July, Book Review, No.36.
• 72: Swanson, E.B. (1974). "Management Information Systems: Appreciation and Involvement," Management Science, Vol.21, No.2, pp. 178--188.
• 73: Thietart, R.A. (1999). Mèthodes de Recherche en Management, Dunod.
• 74: Treacy, M.E. (1985). "An Empirical Examination of a Causal Model of User Information Satisfaction," Center of Information Systems Research, Sloan School of Management, Massachussets Institute of Technology.
• 75: Turner, J. (1982). "Firm Size, Performance and Computer Use," Proceedings of the 3rd International Conference on Information Systems, Ann Arbor, Michigan, pp. 109--120.
• 76: Viswanath Venkatesh , Fred D. Davis, A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies, Management Science, v.46 n.2, p.186-204, February 2000 [doi>10.1287/mnsc.46.2.186.11926]
• 77: Wacheux, F. (1996). Mèthodes Qualitatives et Recherches en Gestion, Editions Economica.
• 78: Geoff Walsham, Interpreting Information Systems in Organizations, John Wiley & Sons, Inc., New York, NY, 1993
• 79: Walsham, G. (1995). "Interpretative Case Study in IS Research: Nature and Method," European Journal of Information System, Vol.4, pp. 74--81.
• 80: Weick, K.E. (1990). "Technology as Equivoque: Sensemaking in new technologies" in Goodman P.S. et al. (Eds)," Technology and Organizations.
• 81: Weick, K.E. (1995). Sensemaking in Organizations, Thousand Oaks, CA: Sage Publications.
• 82: Yin, R.K. (1994). "Case Study Research: Design and Methods," Applied Social Research Methods Series, Vol.5, No.2, pp. 181--191.
• 83: Zmud, R.W. and Apple, L.E. (1992). "Measuring Technology Incorporation/Infusion," Journal of Productivity Innovation Management, Vol.9, pp. 148--155.
• 84: Zviran, M. and Erlich, Z. (2003). "Measuring IS User Satisfaction: Review and Implications," Communications of the AIS, Vol.12, No.5, pp. 81--104.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

Additional Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS

Keywords:
case study, contextual perspective, evaluation of the performance of information systems, individual perceptions, qualitative interpretativist methodology, user satisfaction