Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces

ABSTRACT

The value of theoretical analyses in user interface design has been hotly debated. All sides agree that it is difficult to apply current theoretical models within the constraints of real-world development projects. We attack this problem in the context of bringing the theoretical ideas within a model of exploratory learning [19] to bear on the evaluation of alternative interfaces for walk-up-and-use systems. We derived a “cognitive walkthrough” procedure for systematically evaluating features of an interface in the context of the theory. Four people independently applied this procedure to four alternative interfaces for which we have empirical usability data. Consideration of the walkthrough sheds light on the consistency with which such a procedure can be applied as well as the accuracy of the results.

REFERENCES

• 1: Anderson, J.R. Skill acquisition: Compilation of weak-method solutions. Psychological Review, 94 (1987), pp. 192-211.
• 2: Bennett, J., Lorch, D., Kieras, D. E., and Poison, P. G. Developing a user interface technology for use in industry. Proceeding of Interact87, 2nd IFIP Conference on Human-Computer Interaction (Stuttgart, Sept. 1987).
• 3: K. Butler , J. Bennett , P. Polson , J. Karrat, Report on the workshop on analytical models, ACM SIGCHI Bulletin, v.20 n.4, p.63-79, April 1989 [doi>10.1145/67243.67251]
• 4: Card, S.K. and Newell, A. The prospects for psychological science in human-computer interaction. Human-Computer Interaction, 1 (1985), pp. 209-242.
• 5: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 6: Carroll, J.M. and Campbell, R.L. Softening up hard science: Reply to NeweU and Card. Human-Computer Interaction, 2 (1986) pp. 227-250.
• 7: J. M. Carroll , W. A. Kellogg, Artifact as theory-nexus: hermeneutics meets theory-based design, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.7-14, March 1989
• 8: M E Eagan, Advances in software inspections, IEEE Transactions on Software Engineering, v.12 n.7, p.744-751, July 1986
• 9: Greeno, J.G. and Simon, H.A. Problem Solving and Reasoning. In R.C. Atkinson, R. Herrnstein, G. Lindzey, and R.D. Luce (Eds.), Steven's Handbook of Experimental Ppsychology. John Wiley and Sons, New York, 1988.
• 10: Kieras, D.E. Towards a Practical GOMS Model Methodology for User Interface Design. In M. Helander fEd.) The Handbook of Human-Computer Interaction. N0rth-Holland, Amsterdam, NV, 1988.
• 11: Kieras, D.E. and Poison, P.G. An approach to the formal analysis of user complexity. International Journal of Man-Machine Studies, 22 (1985), pp. 365- 394.
• 12: John E. Laird , Allen Newell , Paul S. Rosenbloom, SOAR: an architecture for general intelligence, Artificial Intelligence, v.33 n.1, p.1-64, Sept. 1987 [doi>10.1016/0004-3702(87)90050-6]
• 13: Lewis, C.H. How and why to learn why: Analysisbased generalization of procedures. Cognitive Science, 12 (1988), pp. 211-256.
• 14: Norman, D.A. Cognitive Engineering. In D.A. Norman and S.W. Draper (Eds.) User Centered Systems Design: New Perspectives in Human- Computer Interaction. Lawrence Erlbaum Assoc., Hillsdale, NJ, 1986
• 15: Norman, D.A. The Psychology of Everyday Things. : Basic Books, New York, NY, 1988.
• 16: Peter G. Polson, A quantitative theory of human-computer interaction, Interfacing thought: cognitive aspects of human-computer interaction, MIT Press, Cambridge, MA, 1987
• 17: Poison, P.G. Transfer and Retention. In R. Guindon (Ed.), Cognitive Science and Its Application for Human-Computer Interaction. Lawrence Erlbaum Assoc., Hillsdale, NJ, 1988.
• 18: Poison, P. G. and Jeffries,~ R. Problem solving as search and understanding. In R. J. Steinberg (Ed.) Advances in the Psychology of 11uman intelligence, Vol. I. Lawrence Erlbaum Associates, Hillsdale, N.J., 1982, pp. 367-412.
• 19: Poison, P.G. and Lewis, C.H. Theory-Based Design for Easily Learned Interfaces. Human Computer Interaction. (In press).
• 20: Rubensu;in, R. and Hersh, H.M. The Human factor: Designing Computer Systems for People. Digital Press, B~trlington, MA, 1984.
• 21: Smith, S.L. and Mosier, J.N. Guidelines for designing the user interface software. Report 7 MTR- 10090, Esd-Tr-86-278. Mitre Corporation, Bedford, MA, 1986.
• 22: Weinberg, G.M. and Freedman, D.P. Reviews, Walkthroughs, and Inspections. IEEE Transactions on Software Engineering, SE- 10, 1984, pp. 68-72.
• 23: Whiteside, J,, Bennett, J., and Holtzblatt, K. Usability Engineering: Our Experience and Evolution. In M. Helander (Ed.) The Handbook of Human- Computer Interaction. North-Holland, Amsterdam, NV, 1988, pp. 791-816.
• 24: Edward Yourdon, Structured walkthroughs: 4th edition, Yourdon Press, Upper Saddle River, NJ, 1989

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.4 Knowledge Representation Formalisms and Methods
          Subjects: Representations (procedural and rule-based)

General Terms:
Design, Human Factors, Theory