Help-based tutorials

ABSTRACT

The consensus of the documentation literature is that users rarely use help, usually preferring to muddle through. To increase use of help, tutorials for novice users could be changed from guided presentations toward using the system's actual help system. To determine whether this approach would increase users' use of help when they encountered problems with an application, we developed an alternative, help-based tutorial introduction to Microsoft Publisher. We compared the behaviors of users introduced to Publisher with the help-based tutorial with the behaviors of users who learned from a traditional tutorial. A balanced study of 22 novice users of Publisher suggests that using a help-based tutorial leads to significantly greater use of help systems when users encounter problems. However, the data also suggest that the increased use of help may not lead to more effective task performance.

REFERENCES

• 1: Ron Baecker , Kellogg Booth , Sasha Jovicic , Joanna McGrenere , Gale Moore, Reducing the gap between what users know and what they need to know, Proceedings on the 2000 conference on Universal Usability, p.17-23, November 16-17, 2000, Arlington, Virginia, United States [doi>10.1145/355460.355467]
• 2: Jean Carletta, Assessing agreement on classification tasks: the kappa statistic, Computational Linguistics, v.22 n.2, June 1996
• 3: Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J., and Shneiderman, B. (2004). Determining causes and severity of end-user frustration, International Journal of Human-Computer Interaction, 17(3), 333--356.
• 4: John M. Carroll, The Nurnberg funnel: designing minimalist instruction for practical computer skill, MIT Press, Cambridge, MA, 1990
• 5: Carroll, J. M. (Ed.). (1998). Minimalism beyond the Nurnberg Funnel. MIT Press.
• 6: Valerie Mendoza , David G. Novick, Usability over time, Proceedings of the 23rd annual international conference on Design of communication: documenting & designing for pervasive information, September 21-23, 2005, Coventry, United Kingdom [doi>10.1145/1085313.1085348]
• 7: David G. Novick , Karen Ward, Why don't people read the manual?, Proceedings of the 24th annual ACM international conference on Design of communication, October 18-20, 2006, Myrtle Beach, SC, USA [doi>10.1145/1166324.1166329]
• 8: David G. Novick , Karen Ward, What users say they want in documentation, Proceedings of the 24th annual ACM international conference on Design of communication, October 18-20, 2006, Myrtle Beach, SC, USA [doi>10.1145/1166324.1166346]
• 9: David G. Novick , Edith Elizalde , Nathaniel Bean, Toward a more accurate view of when and how people seek help with computer applications, Proceedings of the 25th annual ACM international conference on Design of communication, October 22-24, 2007, El Paso, Texas, USA [doi>10.1145/1297144.1297165]
• 10: Smart, K., Whiting, M., and De Tienne, K (2001). Assessing the need for printed and online documentation: A study of customer preference and use, Journal of Business Communication 38, 285--314.
• 11: Karl L. Smart , Kristen Bell DeTienne , Matthew Whiting, Customers' use of documentation: the enduring legacy of print, Proceedings of the 16th annual international conference on Computer documentation, p.23-28, September 24-26, 1998, Quebec, Quebec, Canada [doi>10.1145/296336.296344]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Training, help, and documentation

General Terms:
Human Factors, Measurement

Keywords:
evaluation, tutorials, usability