Groupware walkthrough: adding context to groupware usability evaluation

ABSTRACT

Discount usability evaluation methods have recently been introduced as a way to assess groupware systems. However, one criticism of these techniques is that they do not make use of information about users and their work contexts. To address this problem, we developed groupware walkthrough, a new usability inspection technique for groupware. The technique is a substantive modification of cognitive walkthrough to include consideration for the complexities of teamwork. The two components of groupware walkthrough are a task model for identifying and analysing real-world collaborative tasks, and a walkthrough process for assessing a system's support for those tasks. Groupware walkthrough is a low-cost technique that can identify collaboration-specific usability problems and can find problems that would not be revealed through other inspection methods

REFERENCES

• 1: Annett, J. and Duncan, K.D. Task analysis and training design. Occupational Psychology, 12, (1967), 211--221.
• 2: Kevin Baker , Saul Greenberg , Carl Gutwin, Heuristic Evaluation of Groupware Based on the Mechanics of Collaboration, Proceedings of the 8th IFIP International Conference on Engineering for Human-Computer Interaction, p.123-140, May 11-13, 2001
• 3: Hugh Beyer , Karen Holtzblatt, Contextual design: defining customer-centered systems, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 4: Dan Diaper, Task Analysis for Human-Computer Interaction, Prentice Hall PTR, Upper Saddle River, NJ, 1990
• 5: Anna-Lena Ereback , Kristina Höök, Using cognitive walkthrough for evaluating a CSCW application, Conference companion on Human factors in computing systems, p.91-92, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260065]
• 6: Garfinkel, H. Studies in Ethnomethodology. Polity Press, Cambridge, 1967.
• 7: Grudin, J., 1990, Groupware and Cooperative Work: Problems and Prospects. In The Art of Human Computer Interface Design, B. Laurel, Ed. Addison-Wesley, 171--185.
• 8: Carl Gutwin , Saul Greenberg, The Mechanics of Collaboration: Developing Low Cost Usability Evaluation Methods for Shared Workspaces, Proceedings of the 9th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, p.98-103, June 04-16, 2000
• 9: John Hughes , Val King , Tom Rodden , Hans Andersen, Moving out from the control room: ethnography in system design, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.429-439, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193065]
• 10: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 11: Wanda J. Orlikowski, Learning from Notes: organizational issues in groupware implementation, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.362-369, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143549]
• 12: David Pinelle , Carl Gutwin, Group Task Analysis for Groupware Usability Evaluations, Proceedings of the 10th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, p.102-107, June 20-22, 2001
• 13: Peter G. Polson , Clayton Lewis , John Rieman , Cathleen Wharton, Cognitive walkthroughs: a method for theory-based evaluation of user interfaces, International Journal of Man-Machine Studies, v.36 n.5, p.741-773, May 1992 [doi>10.1016/0020-7373(92)90039-N]
• 14: Jeffrey Rubin , Theresa Hudson, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, John Wiley & Sons, Inc., New York, NY, 1994
• 15: Steves, M., Morse, E., Gutwin, C. and Greenberg, S. A Comparison of Observation and Inspection Methods for Evaluating Groupware. Proc. GROUP 2001, ACM Press, 125--134.
• 16: van der Veer, G.C., Lenting, B.F., and Bergevoet, B.A.J. GTA: Groupware Task Analysis - Modeling Complexity. Acta Psychologica, 91, (1996), 297--322.
• 17: Gerrit van der Veer , Martijn van Welie, Task based groupware design: putting theory into practice, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.326-337, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347781]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.1 Office Automation
          Subjects: Groupware

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

General Terms:
Design, Human Factors, Performance, Theory

Keywords:
cognitive walkthrough, groupware walkthrough, mechanics of collaboration, usability inspection