User interface evaluation in the real world

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

User interface evaluation in the real world: a comparison of four techniques

Full text

Pdf (697 KB)

Source

Conference on Human Factors in Computing Systems archive
Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology table of contents

New Orleans, Louisiana, United States

Pages: 119 - 124

Year of Publication: 1991

ISBN:0-89791-383-3

Authors

Robin Jeffries	Hewlett-Packard Laboratories, 1501 Page Mill Road, Palo Alto, California
James R. Miller	Hewlett-Packard Laboratories, 1501 Page Mill Road, Palo Alto, California
Cathleen Wharton	Dept. of Computer Science and Institute of Cognitive Science, University of Colorado, Boulder, Colorado and Hewlett-Packard Laboratories
Kathy Uyeda	Corporate Engineering, Hewlett-Packard, 3155 Porter Drive, Palo Alto, California

Sponsors

Human Factors Soc : Human Factors Society
IEEE-CS : Computer Society
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 118, Downloads (12 Months): 692, Citation Count: 83

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/108844.108862 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Apple Computer, Inc. Human interface guidelines: The Apple desktop interface. Cupertino, Califomia, 1989.
	2	C. M. Brown, Human-computer interface design guidelines, Ablex Publishing Corp., Norwood, NJ, 1988
	3	Hewlett-Packard Company, Corporate Human Factors Engineering. SoftGuide: Guidelines for usable software, in press, 1990.
	4	Lewis, C., & Poison, P. Theory-based design for easilylearned interfaces. Human-Computer Interaction, 1990, 5, 2-3, 191-220.
	5	Clayton Lewis , Peter G. Polson , Cathleen Wharton , John Rieman, Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.235-242, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97279]
	6	Jakob Nielsen , Rolf Molich, Heuristic evaluation of user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.249-256, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97281]
	7	Peter G. Polson , Clayton Lewis , John Rieman , Cathleen Wharton, Cognitive walkthroughs: a method for theory-based evaluation of user interfaces, International Journal of Man-Machine Studies, v.36 n.5, p.741-773, May 1992 [doi>10.1016/0020-7373(92)90039-N]
	8	Smith, S. L., & Mosier, J. N. Guidelines for designing user interface software. Report MTR-10090, The MITRE Corporation, Bedford, Massachusetts, 1986.
	9	Ben Shneiderman, Designing the user interface: strategies for effective human-computer interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1986

CITED BY 83

	David E. Rowley , David G. Rhoades, The cognitive jogthrough: a fast-paced user interface evaluation procedure, Proceedings of the SIGCHI conference on Human factors in computing systems, p.389-395, May 03-07, 1992, Monterey, California, United States
	Barry Arons, SpeechSkimmer: interactively skimming recorded speech, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.187-196, December 1993, Atlanta, Georgia, United States
	Cathleen Wharton , Janice Bradford , Robin Jeffries , Marita Franzke, Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations, Proceedings of the SIGCHI conference on Human factors in computing systems, p.381-388, May 03-07, 1992, Monterey, California, United States
	Paul Sawyer , Alicia Flanders , Dennis Wixon, Making a difference—the impact of inspections, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.376-382, April 13-18, 1996, Vancouver, British Columbia, Canada
	Jakob Nielsen , Thomas K. Landauer, A mathematical model of the finding of usability problems, Proceedings of the SIGCHI conference on Human factors in computing systems, p.206-213, April 24-29, 1993, Amsterdam, The Netherlands
	F. Garzotto , M. Matera , P. Paolini, Abstract tasks: a tool for the inspection of Web sites and off-line hypermedia, Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, p.157-163, February 21-25, 1999, Darmstadt, Germany
	Pamela Savage, User interface evaluation in an iterative design process: a comparison of three techniques, Conference companion on Human factors in computing systems: common ground, p.307-308, April 13-18, 1996, Vancouver, British Columbia, Canada
	A. vonMayrhauser , L. Przybylski, Developing requirements for a user interface, Proceedings of the 1994 ACM symposium on Applied computing, p.10-14, March 06-08, 1994, Phoenix, Arizona, United States
	Lai-Chong Law , Ebba Thora Hvannberg, Complementarity and convergence of heuristic evaluation and usability test: a case study of universal brokerage platform, Proceedings of the second Nordic conference on Human-computer interaction, October 19-23, 2002, Aarhus, Denmark
	Michelle Potts Steves , Emile Morse , Carl Gutwin , Saul Greenberg, A comparison of usage evaluation and inspection methods for assessing groupware usability, Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work, September 30-October 03, 2001, Boulder, Colorado, USA
	Melody Y. Ivory , Marti A Hearst, The state of the art in automating usability evaluation of user interfaces, ACM Computing Surveys (CSUR), v.33 n.4, p.470-516, December 2001
	Søren Lauesen , Houman Younessi, Is Software Quality Visible in the Code?, IEEE Software, v.15 n.4, p.69-73, July 1998
	Michael J. Muller , Tom Dayton , Robert Root, Comparing studies that compare usability assessment methods: an unsuccessful search for stable criteria, INTERACT '93 and CHI '93 conference companion on Human factors in computing systems, p.185-186, April 24-29, 1993, Amsterdam, The Netherlands
	Keith A. Butler, Usability engineering turns 10, interactions, v.3 n.1, p.58-75, Jan. 1996
	A. Sears, Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout, IEEE Transactions on Software Engineering, v.19 n.7, p.707-719, July 1993
	Claire-Marie Karat , Robert Campbell , Tarra Fiegel, Comparison of empirical testing and walkthrough methods in user interface evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.397-404, May 03-07, 1992, Monterey, California, United States
	Gregg Skip Bailey, Iterative methodology and designer training in human-computer interface design, Proceedings of the SIGCHI conference on Human factors in computing systems, p.198-205, April 24-29, 1993, Amsterdam, The Netherlands
	Maria R. Ebling , Bonnie E. John, On the contributions of different empirical data in usability testing, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.289-296, August 17-19, 2000, New York City, New York, United States
	Jakob Nielsen , Rita M. Bush , Tom Dayton , Nancy E. Mond , Michael J. Muller , Robert W. Root, Teaching experienced developers to design graphical user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.557-564, May 03-07, 1992, Monterey, California, United States
	Bonnie E. John , Hilary Packer, Learning and using the cognitive walkthrough method: a case study approach, Proceedings of the SIGCHI conference on Human factors in computing systems, p.429-436, May 07-11, 1995, Denver, Colorado, United States
	Jakob Nielsen, Finding usability problems through heuristic evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.373-380, May 03-07, 1992, Monterey, California, United States
	Gary Perlman, Practical usability evaluation, Conference companion on Human factors in computing systems, p.369-370, May 07-11, 1995, Denver, Colorado, United States
	Gary Perlman, Practical usability evaluation, Conference companion on Human factors in computing systems: common ground, p.348-349, April 13-18, 1996, Vancouver, British Columbia, Canada
	Joseph S. Dumas, User-based evaluations, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
	Jakob Nielsen , Victoria L. Phillips, Estimating the relative usability of two interfaces: heuristic, formal, and empirical methods compared, Proceedings of the SIGCHI conference on Human factors in computing systems, p.214-221, April 24-29, 1993, Amsterdam, The Netherlands
	Jakob Nielsen, Usability inspection methods, Conference companion on Human factors in computing systems, p.377-378, May 07-11, 1995, Denver, Colorado, United States
	Jakob Nielsen, Usability inspection methods, Conference companion on Human factors in computing systems, p.413-414, April 24-28, 1994, Boston, Massachusetts, United States
	Jakob Nielsen, Enhancing the explanatory power of usability heuristics, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.152-158, April 24-28, 1994, Boston, Massachusetts, United States
	Richard Gong , David Kieras, A validation of the GOMS model methodology in the development of a specialized, commercial software application, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.351-357, April 24-28, 1994, Boston, Massachusetts, United States
	Gary Perlman, Practical usability evaluation, Conference companion on Human factors in computing systems, p.407-408, April 24-28, 1994, Boston, Massachusetts, United States
	Barry Arons, SpeechSkimmer: a system for interactively skimming recorded speech, ACM Transactions on Computer-Human Interaction (TOCHI), v.4 n.1, p.3-38, March 1997
	Dennis Wixon, Evaluating usability methods: why the current literature fails the practitioner, interactions, v.10 n.4, July + August 2003
	Walter de Abreu Cybis , André Fabiano Dyck , Renate de Oliveira , Priscilla B. B. Pagliuso , Claudia de Andrade Tambascia , André Luiz de Castro Villas-Boas , Mirian Freitas, Approach for the development of systematic and productive verifying lists of usability, Proceedings of the Latin American conference on Human-computer interaction, August 17-20, 2003, Rio de Janeiro, Brazil
	Claire Paddison , Paul Englefield, Applying heuristics to perform a rigorous accessibility inspection in a commercial context, ACM SIGCAPH Computers and the Physically Handicapped
	Christopher J. Howell , Gregory M. Kapfhammer , Robert S. Roos, An examination of the run-time performance of GUI creation frameworks, Proceedings of the 2nd international conference on Principles and practice of programming in Java, June 16-18, 2003, Kilkenny City, Ireland
	Simon Lok , Steven Feiner , Gary Ngai, Evaluation of visual balance for automated layout, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal
	Gilbert Cockton , Darryn Lavery , Alan Woolrych, Inspection-based evaluations, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
	Bonnie E. John, Evaluating usability evaluation techniques, ACM Computing Surveys (CSUR), v.28 n.4es, Dec. 1996
	Anna-Lena Ereback , Kristina Höök, Using cognitive walkthrough for evaluating a CSCW application, Conference companion on Human factors in computing systems, p.91-92, April 24-28, 1994, Boston, Massachusetts, United States
	Rohit Mahajan , Ben Shneiderman, Visual and Textual Consistency Checking Tools for Graphical User Interfaces, IEEE Transactions on Software Engineering, v.23 n.11, p.722-735, November 1997
	Kasper Hornbæk , Erik Frøkjær, Comparing usability problems and redesign proposals as input to practical systems development, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA
	Ramesh Farzanfar , Joseph Finkelstein , Robert H. Friedman, Testing the Usability of Two Automated Home-Based Patient-Management Systems, Journal of Medical Systems, v.28 n.2, p.143-153, April 2004
	Mikael B. Skov , Jan Stage, Supporting problem identification in usability evaluations, Proceedings of the 19th conference of the computer-human interaction special interest group (CHISIG) of Australia on Computer-human interaction: citizens online: considerations for today and the future, November 21-25, 2005, Canberra, Australia
	Andreas Lecerof , Fabio Paternò, Automatic Support for Usability Evaluation, IEEE Transactions on Software Engineering, v.24 n.10, p.863-888, October 1998
	Kasper Hornbæk , Erik Frøkjær, Two psychology-based usability inspection techniques studied in a diary experiment, Proceedings of the third Nordic conference on Human-computer interaction, p.3-12, October 23-27, 2004, Tampere, Finland
	Robert Mack , Jakob Nielsen, Usability inspection methods: report on a workshop held at CHI'92, Monterey, CA, May 3–4, 1992, ACM SIGCHI Bulletin, v.25 n.1, p.28-33, Jan. 1993
	David Budgen , Mitchell Thomson, CASE tool evaluation: experiences from an empirical study, Journal of Systems and Software, v.67 n.2, p.55-75, 15 August 2003
	Jeff Johnson , Catherine Marshall, Convergent usability evaluation: a case study from the EIRS project, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA
	Rolf Molich , Robin Jeffries, Comparative expert reviews, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA
	Heather Desurvire , Jim Kondziela , Michael E. Atwood, What is gained and lost when using methods other than empirical testing, Posters and short talks of the 1992 SIGCHI conference on Human factors in computing systems, May 03-07, 1992, Monterey, California
	Gary Perlman, Practical usability evaluation, CHI '97 extended abstracts on Human factors in computing systems: looking to the future, March 22-27, 1997, Atlanta, Georgia
	Benedikte S. Als , Janne J. Jensen , Mikael B. Skov, Comparison of think-aloud and constructive interaction in usability testing with children, Proceeding of the 2005 conference on Interaction design and children, p.9-16, June 08-10, 2005, Boulder, Colorado
	Robin Jeffries , Heather Desurvire, Usability testing vs. heuristic evaluation: was there a contest?, ACM SIGCHI Bulletin, v.24 n.4, p.39-41, Oct. 1992
	Benjamin J. Halpert, Authentication interface evaluation and design for mobile devices, Proceedings of the 2nd annual conference on Information security curriculum development, September 23-24, 2005, Kennesaw, Georgia
	Berardina De Carolis , Fiorella de Rosis, Modelling adaptive interaction of OPADE by Petri nets, ACM SIGCHI Bulletin, v.26 n.2, p.48-52, April 1994
	Carmelo Ardito , Rosa Lanzilotti , Paolo Buono , Antonio Piccinno, A tool to support usability inspection, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy
	Jacob O. Wobbrock , Brad A. Myers, Analyzing the input stream for character- level errors in unconstrained text entry evaluations, ACM Transactions on Computer-Human Interaction (TOCHI), v.13 n.4, p.458-489, December 2006
	Mie Nørgaard , Kasper Hornbæk, What do usability evaluators do in practice?: an explorative study of think-aloud testing, Proceedings of the 6th ACM conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA
	S. S. (Thabo) Masemola , M. R. (Ruth) De Villiers, Towards a framework for usability testing of interactive e-learning applications in cognitive domains, illustrated by a case study, Proceedings of the 2006 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing couuntries, p.187-197, October 09-11, 2006, Somerset West, South Africa
	Ebba Thora Hvannberg , Effie Lai-Chong Law , Marta Kristín Lárusdóttir, Heuristic evaluation: Comparing ways of finding and reporting usability problems, Interacting with Computers, v.19 n.2, p.225-240, March, 2007
	Edward Waguih Ishak , Steven Feiner, Content-aware layout, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA
	Zhijun Zhang , Victor Basili , Ben Shneiderman, Perspective-based Usability Inspection: An Empirical Validationof Efficacy, Empirical Software Engineering, v.4 n.1, p.43-69, March 1999
	David Pinelle , Nelson Wong , Tadeusz Stach, Heuristic evaluation for games: usability principles for video game design, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy
	Kasper Hornbæk , Erik Frøkjær, Making use of business goals in usability evaluation: an experiment with novice evaluators, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy
	Luciana Cardoso de Castro Salgado , Sílvia Amélia Bim , Clarisse Sieckenius de Souza, Comparação entre os métodos de avaliação de base cognitiva e semiótica, Proceedings of VII Brazilian symposium on Human factors in computing systems, November 19-22, 2006, Natal, RN, Brazil
	Erik Frøkjær , Kasper Hornbæk, Metaphors of human thinking for usability inspection and design, ACM Transactions on Computer-Human Interaction (TOCHI), v.14 n.4, p.1-33, January 2008
	Tasha Hollingsed , David G. Novick, Usability inspection methods after 15 years of research and practice, Proceedings of the 25th annual ACM international conference on Design of communication, October 22-24, 2007, El Paso, Texas, USA
	David G. Novick , Edith Elizalde , Nathaniel Bean, Toward a more accurate view of when and how people seek help with computer applications, Proceedings of the 25th annual ACM international conference on Design of communication, October 22-24, 2007, El Paso, Texas, USA
	Jenny Preece , Chadia Abras , Diane Maloney-Krichmar, Designing and evaluating online communities: research speaks to emerging practice, International Journal of Web Based Communities, v.1 n.1, p.2-18, July 2004
	Victoria Bellotti , Ann Blandford , David Duke , Allan MacLean , Jon May , Laurence Nigay, Interpersonal access control in computer-mediated communications: a systematic analysis of the design space, Human-Computer Interaction, v.11 n.4, p.357-432, December 1996
	Mark A. Neerincx , H. Paul de Greef, Cognitive support: extending human knowledge and processing capacities, Human-Computer Interaction, v.13 n.1, p.73-106, March 1998
	Wayne D. Gray , Marilyn C. Salzman, Damaged merchandise? a review of experiments that compare usability evaluation methods, Human-Computer Interaction, v.13 n.3, p.203-261, September 1998
	Gary M. Olson , Thomas P. Moran, Commentary on "Damaged merchandise?", Human-Computer Interaction, v.13 n.3, p.263-323, September 1998
	Gary M. Olson , Thomas P. Moran, Commentary on "Damaged merchandise?", Human-Computer Interaction, v.13 n.3, p.263-323, September 1998
	Gary M. Olson , Thomas P. Moran, Commentary on "Damaged merchandise?", Human-Computer Interaction, v.13 n.3, p.263-323, September 1998
	Wayne D. Gray , Marilyn C. Salzman, Repairing damaged merchandise: a rejoinder, Human-Computer Interaction, v.13 n.3, p.325-335, September 1998
	Rolf Molich , Joseph S. Dumas, Comparative usability evaluation (CUE-4), Behaviour & Information Technology, v.27 n.3, p.263-281, May 2008
	T. A. Hart , B. S. Chaparro , C. G. Halcomb, Evaluating websites for older adults: adherence to 'senior-friendly' guidelines and end-user performance, Behaviour & Information Technology, v.27 n.3, p.191-199, May 2008
	Dionisios N. Dimakopoulos , George D. Magoulas, Interface design and evaluation of a personal information space for mobile learners, International Journal of Mobile Learning and Organisation, v.3 n.4, p.440-463, July 2009
	Eliane Regina de Almeida Valiati , Marcelo Soares Pimenta, Assessment of cost/benefit of interfaces evaluation techniques, Proceedings of the Working Conference on Advanced Visual Interfaces, May 22-24, 2002, Trento, Italy
	Thomas Mahatody , Mouldi Sagar , Christophe Kolski, Cognitive Walkthrough pour l'évaluation des IHM: synthèse des extensions et évolutions conceptuelles, méthodologiques et technologiques, Proceedings of the 19th International Conference of the Association Francophone d'Interaction Homme-Machine, November 12-15, 2007, Paris, France
	Viswanath Venkatesh , Ritu Agarwal, Turning Visitors into Customers: A Usability-Centric Perspective on Purchase Behavior in Electronic Channels, Management Science, v.52 n.3, p.367-382, March 2006
	Tovi Grossman , George Fitzmaurice , Ramtin Attar, A survey of software learnability: metrics, methodologies and guidelines, Proceedings of the 27th international conference on Human factors in computing systems, April 04-09, 2009, Boston, MA, USA