From mental effort to perceived usability: transforming experiences into summary assessments

ABSTRACT

In many cases, practitioners and researchers of Human-Computer Interaction and Usability Engineering rely on users' subjective product quality assessments. Such an assessment of, for example, perceived usability is believed to summarize previous experiences made with the according software. The present study shows that such summary assessments of perceived usability do not reflect a whole experiential episode, but rather its most recent incidents. Additional measurement strategies, such as repeated measurements of perceived usability throughout the experiential episode, are explored.

REFERENCES

• 1: Albert G. Arnold, Mental effort and evaluation of user-interfaces: a questionnaire approach, Proceedings of HCI International (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Ergonomics and User Interfaces-Volume I, p.1003-1007, August 22-26, 1999
• 2: Ariely, D and Carmon, Z. Summary assessment of experiences: The whole is different from the sum of its parts. In G. Loewenstein, D. Read, and R.F. Baumeister (Eds.), Time and decision. Economic and psychological perspectives on intertemporal choice. New York, Russell Sage, 2003.
• 3: Hassenzahl, M. The effect of perceived hedonic quality on product appealingness. International Journal of Human-Computer Interaction, 13 (2002), 479--497.
• 4: Kahneman, D. Evaluation by moments. Past and future. In Kahneman, D., Tversky, A. (Eds.), Choices, values and frames. New York, Cambridge University Press, 2000.
• 5: Ross, W. T. and Simonson, I. Evaluations of pairs of experiences: A preference for happy endings. Journal of Behavioral Decision Making, 4 (1991), 273--282.
• 6: Sandweg, N., Pedell, S., Platz, A., Schneider, K.-P., Honold, P., Hermann, D., and Kaiser, E. Re-design of CONNEXX hearing instruments fitting software. In H. Luczak, A. E. Cakir, and G. Cakir (Eds.), Proceedings of the 6th international conference on Work With Display Units. Berlin, ERGONOMIC Institut für Arbeits- und Sozialforschung (2002), 275--276.
• 7: Zijlstra, R. Efficiency in work behaviour. A design approach for modern tools. Delft, Delft University Press, 1993.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Keywords:
evaluation, perceived usability, questionnaires, user experience