Development of an instrument measuring user satisfaction of the human-computer interface

ABSTRACT

This study is a part of a research effort to develop the Questionnaire for User Interface Satisfaction (QUIS). Participants, 150 PC user group members, rated familiar software products. Two pairs of software categories were compared: 1) software that was liked and disliked, and 2) a standard command line system (CLS) and a menu driven application (MDA). The reliability of the questionnaire was high, Cronbach's alpha=.94. The overall reaction ratings yielded significantly higher ratings for liked software and MDA over disliked software and a CLS, respectively. Frequent and sophisticated PC users rated MDA more satisfying, powerful and flexible than CLS. Future applications of the QUIS on computers are discussed.

REFERENCES

• 1: Bailey, J. E., & Pearson, S. W. Development of a tool for measuring and analyzing computer user satisfaction. Management Science, 29, 5, (May 1983), 530-545.
• 2: Coleman, W. D., Williges, R. C., & Wixon, D.R. Collecting detailed user evaluations of software interfaces. Proceedings of the Human Factors Society - 29th Annual Meeting - 1985, 240-244.
• 3: Chin, J. P., Norman, K. L., & S hneiderman, 13. Subjective user evaluation of CF PASCAL programming tools. Technical Report (CAR- TR-304), Human-Computer Interaction Laboratory, University of Maryland, College Park, MD 20742, 1987.
• 4: Gallagher, C.A. Perceptions of the value of a management information system. Academy cf Mangement Journal, 17, 1, (1974), 46-55.
• 5: Blake Ives , Margrethe H. Olson , Jack J. Baroudi, The measurement of user information satisfaction, Communications of the ACM, v.26 n.10, p.785-793, Oct. 1983 [doi>10.1145/358413.358430]
• 6: Larcker, D. F. & Lessig, V.P. Perceived usefulness of information: A psychometric examination. Decision Science, 11, 1, (1980), 121-134.
• 7: Nunnally, J. C. Psychometric Theory, McGraw- Hill Book Company, New York, 11978.
• 8: Robert W. Root , Steve Draper, Questionnaires as a software evaluation tool, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.83-87, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801586]
• 9: Avi Rushinek , Sara F. Rushinek, What makes users happy?, Communications of the ACM, v.29 n.7, p.594-598, July 1986 [doi>10.1145/6138.6140]
• 10: Ben Shneiderman, Designing the user interface: strategies for effective human-computer interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1986

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.1 Project and People Management
          Subjects: Training
      K.6.2 Installation Management
          Subjects: Performance and usage measurement

General Terms:
Human Factors, Management, Measurement, Performance