Non-universal usability?: a survey of how usability is understood by Chinese and Danish users

ABSTRACT

Most research assumes that usability is understood similarly by users in different cultures, implying that the notion of usability, its aspects, and their interrelations are constant across cultures. The present study shows that this is not the case for a sample of 412 users from China and Denmark, who differ in how they understand and prioritize different aspects of usability. Chinese users appear to be more concerned with visual appearance, satisfaction, and fun than Danish users; Danish users prioritize effectiveness, efficiency, and lack of frustration higher than Chinese users. The results suggest that culture influences perceptions of usability. We discuss implications for usability research and for usability practice.

REFERENCES

• 1: Aykin, N., Quaet-Faslem, P. H.,&Milewski, A. E., Cultural Ergonomics, in Salvendy, G. (ed.) Handbook of Human Factors and Ergonomics, Wiley, 2006, 177--190.
• 2: Barber, W.&Badre, A. Culturability: The Merging of Culture and Usability, Proc. of the Fourth Conference on Human Factors and the Web (1998).
• 3: Agnieszka Bojko , Gavin S. Lew , Robert M. Schumacher, Overcoming the challenges of multinational testing, interactions, v.12 n.6, p.28-30, November + December 2005 [doi>10.1145/1096554.1096558]
• 4: Brislin, R. W. Back-Translation for Cross-Cultural Research, Journal of Cross-Cultural Psychology, 1, 3 (1970), 185--216.
• 5: Callahan, E., Interface Design and Culture, in Cronin, B. (ed.) Annual Review of Information Science and Technology, Vol. 39, Information Today, 2005, 257--310.
• 6: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, L. Erlbaum Associates Inc., Hillsdale, NJ, 1983
• 7: Patrick Y. K. Chau , Melissa Cole , Anne P. Massey , Mitzi Montoya-Weiss , Robert M. O'Keefe, Cultural differences in the online behavior of consumers, Communications of the ACM, v.45 n.10, p.138-143, October 2002 [doi>10.1145/570907.570911]
• 8: John P. Chin , Virginia A. Diehl , Kent L. Norman, Development of an instrument measuring user satisfaction of the human-computer interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.213-218, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57203]
• 9: Choi, B., Lee, I.,&Kim, J. Culturability in Mobile Data Services: A Qualitative Study of the Relationship Between Cultural Characteristics and User-Experience Attributes, International Journal of Human-Computer Interaction, 20, 3 (2006), 171--206.
• 10: Clemmensen, T., Hertzum, M., Hornbæk, K., Shi, Q.,&Yammiyavar, P. Cultural Cognition in the Thinking-Aloud Method for Usability Evaluation, Proc. ICIS 2008, AIS (2008)
• 11: Cohen, J. Statistical Power Analysis for the Behavioral Sciences, Academic Press, New York, 1969.
• 12: Cronbach, L. J. Coefficient Alpha and the Internal Structure of Tests, Psychometrika, 16 (1951), 297--333.
• 13: Day, D. Ed. Shared Values and Shared Interfaces {Special Issue}, Interacting with Computers, 9, 3 (1998).
• 14: Elisa M. del Galdo , Jakob Nielsen, International users interface, John Wiley & Sons, Inc., New York, NY, 1996
• 15: Margaret Elliot , Rob Kling, Organizational usability of digital libraries: case study of legal research in civil and criminal courts, Journal of the American Society for Information Science, v.48 n.11, p.1023-1035, Nov. 1997 [doi>10.1002/(SICI)1097-4571(199711)48:11<1023::AID-ASI5>3.0.CO;2-Y]
• 16: Vanessa Evers , Donald Day, The Role of Culture in Interface Acceptance, Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.260-267, July 14-18, 1997
• 17: Gorsuch, R. L. Factor Analysis, Lawrence Erlbaum, Hillsdale, NJ, 1983.
• 18: Marc Hassenzahl , Andreas Beu , Michael Burmester, Engineering Joy, IEEE Software, v.18 n.1, p.70-76, January 2001 [doi>10.1109/52.903170]
• 19: Mare Hassenzahl , Axel Platz , Michael Burmester , Katrin Lehner, Hedonic and ergonomic quality aspects determine a software's appeal, Proceedings of the SIGCHI conference on Human factors in computing systems, p.201-208, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332432]
• 20: Hertzum, M., Clemmensen, T., Hornbæk, K., Kumar, J., Shi, Q.,&Yammiyavar, P. Usability Constructs: A Cross-Cultural Study of How Users and Developers Experience Their Use of Information Systems, Proc. HCI International, LNCS 4559, Springer Verlag (2007), 317--326.
• 21: Hofstede, G. Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations, Sage, Thousand Oaks, CA, 2001.
• 22: Honold, P. Learning How to Use a Cellular Phone: Comparison Between German and Chinese Users, Technical Communication, 46, 2 (1999), 196--205.
• 23: Honold, P. Culture and Context: An Empirical Study for the Development of a Framework for the Elicitation of Cultural Influence in Product Usage, International Journal of Human-Computer Interaction, 12, 3&4 (2000), 327--345.
• 24: Kasper Hornbæk, Current practice in measuring usability: Challenges to usability studies and research, International Journal of Human-Computer Studies, v.64 n.2, p.79-102, February 2006 [doi>10.1016/j.ijhcs.2005.06.002]
• 25: Kasper Hornbæk , Effie Lai-Chong Law, Meta-analysis of correlations among usability measures, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240722]
• 26: ISO 9241-11 Ergonomic Requirements for Office Work With Visual Display Terminals (VDTs)-Part 11: Guidance on Usability, International Standard Organization (1998).
• 27: ISO/IEC 9126 Software Engineering - Product Quality - Part 1: Quality Model, International Standard Organization (2001).
• 28: Kaiser, H. F. An Index of Factor Simplicity, Psychometrika, 39 (1974), 31--36.
• 29: Kurosu, M.&Kashimura, K. Determinants of Apparent Usability, Proc. IEEE International Conference on Systems, Man and Cybernetics, IEEE Press (1995), 1509--1513.
• 30: Aaron Marcus, Global and intercultural user-interface design, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, L. Erlbaum Associates Inc., Hillsdale, NJ, 2002
• 31: Mick McGee, Master usability scaling: magnitude estimation and master scaling applied to usability measurement, Proceedings of the SIGCHI conference on Human factors in computing systems, p.335-342, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985735]
• 32: McGee, M., Rich, A.,&Dumas, J. Understanding the Usability Construct: User-Perceived Usability, Proc. HFES'2004, HFES (2004), 907--911.
• 33: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 34: Nisbett, R. E. The Geography of Thought: How Asians and Westerners Think Differently - and Why, Nicholas Brealey, London, 2003.
• 35: Donald A. Norman , Stephen W. Draper, User Centered System Design; New Perspectives on Human-Computer Interaction, L. Erlbaum Associates Inc., Hillsdale, NJ, 1986
• 36: Robert M. O'Keefe , Melissa Cole , Patrick Y. K. Chau , Ann Massey , Mitzi Montoya-Weiss , Mark Perry, From the user interface to the consumer interface: results from a global experiment, International Journal of Human-Computer Studies, v.53 n.4, p.611-628, Oct. 2000 [doi>10.1006/ijhc.2000.0404]
• 37: Pei-Luen Patrick Rau , Qin Gao , Sheau-Farn Max Liang, Good computing systems for everyone-how on earth? Cultural aspects, Behaviour & Information Technology, v.27 n.4, p.287-292, July 2008 [doi>10.1080/01449290701761250]
• 38: Rogers, Y., New Theoretical Approaches for Human-Computer Interaction, in Cronin, B. (ed.) Annual Review of Information Science and Technology, Vol. 38, Information Today, 2004, 87--144.
• 39: Jeff Sauro , Erika Kindlund, A method to standardize usability metrics into a single score, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055028]
• 40: Jeroen Schepers , Martin Wetzels, A meta-analysis of the technology acceptance model: Investigating subjective norm and moderation effects, Information and Management, v.44 n.1, p.90-103, January, 2007 [doi>10.1016/j.im.2006.10.007]
• 41: Schwarz, N., Groves, R.,&Schuman, H., Survey Methods, in Gilbert, D., Fiske, S.,&Lindzey, G. (eds.) Handbook of Social Psychology, McGraw-Hill, 1998, 143--179.
• 42: Smith, A.&Yetim, F. Global Human-Computer Systems: Cultural Determinants of Usability {Special Issue}, Interacting with Computers, 16, 1 (2004).
• 43: Sun, H. Exploring Cultural Usability, Proc. IPCC2002, IEEE Press (2008), 219--330.
• 44: Noam Tractinsky, Aesthetics and apparent usability: empirically assessing cultural and methodological issues, Proceedings of the SIGCHI conference on Human factors in computing systems, p.115-122, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258626]
• 45: van Welie, M., van der Veer, G. C.,&Eliëëns, A. Breaking Down Usability, Proc. Interact'99, IOS Press (1999), 613--620.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

General Terms:
Human Factors

Keywords:
culture, questionnaire, usability