Model-based automatic usability validation: a tool concept for improving web-based UIs

ABSTRACT

This paper describes an approach for improving automated usability tool support during the development of websites. Existing usability and accessibility validators only analyse the HTML code of a page when they create a report of possible problems. However, when a web engineering method is used to create a website, additional information is available in the form of models which describe the site. An automated validator can use these models to verify usability guidelines (such as "text on the web page should be easy to understand by the target audience") with higher accuracy. It can also perform automatic validation in situations where existent tools only output instructions for manual inspection by the developer. The paper systematically analyses existent guidelines and tools, and identifies ways in which the use of a model can improve verification quality. An extension to existing web engineering models is necessary to support automated checkers. It specifies properties of the users, the technical platform and the environment of use. A flexible approach allows the models to be used by validators running inside an integrated development environment, but also at a later time, without access to the development environment. Finally, the prototype of a model-based automatic usability validator is presented. It features verification of a number of guidelines which cannot be automated by existent validation approaches.

REFERENCES

• 1: J. Abascal, M. Arrue, N. Garay, J. Tomás: EvalIris -- A Web Service for Web Accessibility Evaluation. In Proceedings of the 12th International World Wide Web Conference (poster), Budapest, Hungary, 20--24 May 2003
• 2: R. Atterer, A. Schmidt: Adding Usability to Web Engineering Models and Tools. In Proceedings of the 5th International Conference on Web Engineering ICWE 2005, Sydney, Australia, 36--41, Springer LNCS 3579, 2005
• 3: R. Atterer, A. Schmidt, H. Hußmann: Extending Web Engineering Models and Tools for Automatic Usability Validation. In Journal of Web Engineering, vol. 5, no. 1 (2006), 43--64
• 4: Richard Atterer , Monika Wnuk , Albrecht Schmidt, Knowing the user's every move: user activity tracking for website usability evaluation and implicit interaction, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135811]
• 5: A. Beirekdar, J. Vanderdonckt, M. Noirhomme-Fraiture: A Framework and a Language for Usability Automatic Evaluation of Web Sites by Static Analysis of HTML Source Code. In Proceedings of 4th International Conference on Computer-Aided Design of User Interfaces CADUI'2002, Valenciennes, France, May 2002
• 6: Giorgio Brajnik, Comparing accessibility evaluation tools: a method for tool effectiveness, Universal Access in the Information Society, v.3 n.3, p.252-263, October 2004 [doi>10.1007/s10209-004-0105-y]
• 7: Michael D. Byrne , Scott D. Wood , James D. Foley , David E. Kieras , Piyawadee Noi Sukaviriya, Automating interface evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.232-237, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191752]
• 8: Cristina Cachero , Jaime Gómez , Oscar Pastor, Object-Oriented Conceptual Modeling of Web Application Interfaces: the OO-HMethod Abstract Presentation Model, Proceedings of the First International Conference on Electronic Commerce and Web Technologies, p.206-215, September 04-06, 2000
• 9: Stefano Ceri , Florian Daniel , Maristella Matera , Federico M. Facca, Model-driven development of context-aware Web applications, ACM Transactions on Internet Technology (TOIT), v.7 n.1, p.2-es, February 2007 [doi>10.1145/1189740.1189742]
• 10: Larry L. Constantine , Lucy A. D. Lockwood, Software for use: a practical guide to the models and methods of usage-centered design, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1999
• 11: A. Coxhead: A New Academic Word List. In TESOL Quarterly, vol. 34, no. 2, 213--238, 2000
• 12: Y. Deshpande, S. Murugesan, A. Ginige, S. Hansen, D. Schwabe, M. Gaedke, B. White: Web Engineering. In Journal of Web Engineering, vol. 1, no. 1 (2002), 3--17
• 13: Melody Y. Ivory , Marti A Hearst, The state of the art in automating usability evaluation of user interfaces, ACM Computing Surveys (CSUR), v.33 n.4, p.470-516, December 2001 [doi>10.1145/503112.503114]
• 14: Melody Y. Ivory , Rashmi R. Sinha , Marti A. Hearst, Empirically validated web page design metrics, Proceedings of the SIGCHI conference on Human factors in computing systems, p.53-60, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365035]
• 15: D. E. Kieras: A Guide to GOMS Model Usability Evaluation Using NGOMSL. In M. Helander, T. Landauer (eds.): The Handbook of Human-Computer Interaction. Amsterdam, Netherlands, 1996
• 16: A. Knapp, N. Koch, G. Zhang, H.-M. Hassler: Modeling Business Processes in Web Applications with ArgoUWE. In Proceedings of the 7th Int'l Conference on the Unified Modeling Language (UML2004). Springer Verlag, 2004
• 17: Q. Limbourg, J. Vanderdonckt, B. Michotte, L. Bouillon, V. Lopez-Jaquero: UsiXML: a Language Supporting Multi-Path Development of User Interfaces. In Proceedings of the 9th IFIP Working Conference on Engineering for Human-Computer Interaction, Hamburg, Germany, 2004
• 18: Patrick J. Lynch , Sarah Horton , Louis Rosenfeld, Web Style Guide: Basic Design Principles for Creating Web Sites, Yale University Press, New Haven, CT, 2002
• 19: G. H. McLaughlin: SMOG Grading -- a New Readability Formula. In Journal of Reading, vol. 12, 639--646, May 1969
• 20: J. Nielsen: Alertbox: Current Issues in Web Usability, ISSN 1548-5552, http://www.useit.com/alertbox/, accessed February 25th, 2008
• 21: U.S. Department of Health and Human Services: Research-Based Web Design & Usability Guidelines, 2006 ed., electronic version (usability.gov), Washington DC, USA, ISBN 0160762707
• 22: World Wide Web Commitee (W3C), Dan Connolly (ed.): Gleaning Resource Descriptions from Dialects of Languages (GRDDL), W3C Recommendation, September 2007, http://www.w3.org/TR/2007/REC-grddl-20070911/
• 23: World Wide Web Commitee (W3C), B. Adida, M. Birbeck (eds.): RDFa Primer. Embedding Structured Data in Web Pages, http://www.w3.org/TR/2007/WD-xhtml-rdfa-primer-20071026/, W3C Working Draft, October 2007
• 24: World Wide Web Commitee (W3C): Web Accessibility Initiative (WAI), http://www.w3.org/WAI/, accessed March 19th, 2008
• 25: World Wide Web Commitee (W3C), M. Birbeck, S. McCarron, S. Pemberton, T. V. Raman, R. Schwerdtfeger (eds.): XHTML Role Attribute Module, A module to support role classification of elements, W3C Working Draft, 2007, http://www.w3.org/TR/2007/WD-xhtml-role-20071004/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
accessibility, automated validation, usability model, web engineering, web usability