The effect of violating visual conventions of a website on user performance and disorientation: how bad can it be?

ABSTRACT

This experiment investigates what happens to user performance and disorientation when visual conventions of a genre are violated. It also looks at what happens to the user performance and disorientation over time. Twenty-eight participants were randomly allocated to two independent groups: one was tested with a conventional website and the other with a convention-violating website. The study comprised of two parts and on each part participants were tested on a different website. Results showed that in the first part participants who used the violating site performed worse and were more disoriented than participants who used the conventional version. But the performance of the participants of the convention-violating group improved over time so that by the end of the first part performance on both groups were equivalent. In the second part performance and disorientation on both groups were equivalent suggesting that users might rapidly adapt to visual convention violations.

REFERENCES

• 1: Ahuja, J. S. and Webster, J. Perceived disorientation: an examination of a new measure to assess web design effectiveness. Interacting with Computers, 14. 15--29.
• 2: Bartoshuk, L. M., Duffy, V. B., Fast, K., Green, B. G., Prutkin, J. and Snyder, D. J. Labeled scales (e.g., category, Likert, VAS) and invalid across-group comparisons: what we have learned from genetic variation in taste. Food Quality and Preference, 14 (2). 125--138.
• 3: Bernard, M. Developing schemas for the location of common web objects. Usability News, 3 (1).
• 4: Busch, M. and Turner, J. Using Likert scales in L2 research. TESOL Quarterly, 27 (4). 733--736.
• 5: Jeff Conklin, Hypertext: An Introduction and Survey, Computer, v.20 n.9, p.17-41, September 1987 [doi>10.1109/MC.1987.1663693]
• 6: Constantine, L. L. and Lockwood, L. A. D. Instructive interaction: Making innovative interfaces self-teaching. User Experience Magazine, 1 (3).
• 7: Delin, J., Bateman, J. and Allen, P. A Model of genre in document layout. Information Design Journal, 11 (1). 54 -- 66.
• 8: DeVigal, A. Putting the eyetrack study to good use, Poynter Institute, 2003.
• 9: Andrew Dillon , Barbara A. Gushrowski, Genres and the Web: is the personal home page the first uniquely digital genre?, Journal of the American Society for Information Science, v.51 n.2, p.202-205, Jan. 15, 2000 [doi>10.1002/(SICI)1097-4571(2000)51:2<202::AID-ASI11>3.0.CO;2-R]
• 10: Dillon, A. and Vaughan, M. It's the journey and the destination: Shape and the emergent property of genre in evaluating digital documents. New Review of Multimedia and Hypermedia, 3. 91--106.
• 11: Brian D. Ehret, Learning where to look: location learning in graphical user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503414]
• 12: Lars Bo Eriksen , Carina Ihlström, Evolution of the Web News Genre ¾ The Slow Move Beyond the Print Metaphor, Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 3, p.3014, January 04-07, 2000
• 13: Gu, Y., Wen, Q. and Wu, D. How Often Is Often? Reference Ambiguities of the Likert-Scale in Language Learning Strategy Research. Occasional Papers in English Language Teaching, 5. 19--35.
• 14: Jacek Gwizdka , Ian Spence, Implicit measures of lostness and success in web navigation, Interacting with Computers, v.19 n.3, p.357-369, May, 2007 [doi>10.1016/j.intcom.2007.01.001]
• 15: Herder, E., Revisitation patterns and disorientation. in German Workshop on Adaptivity and User Modeling in Interactive Systems: ABIS 2003, (Karlsruhe, 2003), 291--294.
• 16: Kalbach, J. and Bosenick, T. Web page layout: A comparison between left- and right-justified site navigation menus Journal of Digital Information, Texas Digital Library, 2006.
• 17: Markum, J. and Hall, R. H. E-commerce web objects: Importance and expected placement Laboratory for Information Technology Evaluation Technical Report, University of Missoury, 2003.
• 18: McCarthy, J. D., Sasse, A. M. and Riegelsberger, J., Could I have the Menu Please? An Eye Tracking Study of Design Conventions. in HCI2003, (Bath, UK, 2003).
• 19: Miller, C. R. Genre as a social action. Quarterly journal of speech, 70 (2). 151--167.
• 20: Jakob Nielsen, The art of navigating through hypertext, Communications of the ACM, v.33 n.3, p.296-310, March 1990 [doi>10.1145/77481.77483]
• 21: Nielsen, J. Do interface standards stifle design creativity? The alertbox: Current issues in Web usability, 1999.
• 22: Nielsen, J. When bad design elements become the standard The alertbox: Current issues in web usability, 1999.
• 23: Oulasvirta, A., Kärkkäinen, L. and Laarni, J. Expectations and memory in link search. Computer in Human Behaviour, 21. 773--789.
• 24: Jim Rosenberg, The structure of hypertext activity, Proceedings of the the seventh ACM conference on Hypertext, p.22-30, March 16-20, 1996, Bethesda, Maryland, United States [doi>10.1145/234828.234831]
• 25: D. Roussinov , K. Crowston , M. Nilan , B. Kwasnik , J. Cai , X. Liu, Genre based Navigation on the Web, Proceedings of the 34th Annual Hawaii International Conference on System Sciences ( HICSS-34)-Volume 4, p.4013, January 03-06, 2001
• 26: Santini, M., Genres In Formation? An Exploratory Study of Web Pages using Cluster Analysis. in CLUK - 8th Annual Computational Linguistics Research Colloquium, (Manchester, 2005).
• 27: Swales, J. M. Genre analysis: English in academic and research settings. Cambridge University Press, Cambridge, 1990.
• 28: Toms, E. G. Recognizing Digital Genres. Bulletin - American Society for Information Science.
• 29: Misha W. Vaughan , Andrew Dillon, Why structure and genre matter for users of digital information: A longitudinal experiment with readers of a web-based newspaper, International Journal of Human-Computer Studies, v.64 n.6, p.502-526, June 2006 [doi>10.1016/j.ijhcs.2005.11.002]
• 30: Vickers, A. J. Comparison of an ordinal and a continuous outcome measure of muscle soreness. International Journal of Technology Assessment in Health Care, 15 (04). 709--716.
• 31: Waller, R. The typographic contribution to language: towards a model of typographic genres and their underlying structures Department of Typography and Graphic Communication, University of Reading, Reading, 1987, 360.
• 32: John Whiteside , Sandra Jones , Paula S. Levy , Dennis Wixon, User performance with command, menu, and iconic interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.185-191, April 1985, San Francisco, California, United States
• 33: Xu, G., Cockburn, A. and McKenzie, B., Lost on the web: An introduction to web navigation research. in 4th New Zealand Computer Science Research Students Conference, (Christchurch, New Zealand, 2001), University of Canterbury.
• 34: Yates, J. and Orlikowski, W. J. Genres of Organizational Communication: A Structurational Approach to Studying Communication and Media. Academy of Management Review, 17 (2). 299.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology; Screen design (e.g., text, graphics, color); Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors, Performance

Keywords:
conventions, genres, interface, navigation