Hands-on practice in learning to use software: a comparison of exercise, exploration, and combined formats

ABSTRACT

This research addresses two issues in the domain of computer training (1) whether learners are able to use exploration-based practice methods effectively to learn to use software and (2) whether some minimal computing background is necessary to be successful with minimalist training and exploration practice. An empirical study was carried out to compare exploration, exercises, and a combined format consisting of an exercise followed by exploration. Subjects of both high and low computer experience were included in the study. It was thought that the combined format might lead to superior training outcomes because it would both structure learning through an exercise and allow learners to go beyond the simple procedures in the training manual through exploration. The results showed that the performance of the low-experience subjects at test did not differ based on the type of practice. However, high-experience subjects who were trained using exercises or the combined format did significantly better than those trained using exploration alone. The similarity of performance of subjects in the exercise and combined practice conditions suggests that the exercise component of the practice explains their success.

REFERENCES

• 1: ANDERSON, J.R. 1993. Rules of the Mind. Erlbaum, Hillsdale, N.J.
• 2: John B. Black , John M. Carroll , Stuart M. McGuigan, What kind of minimal instruction manual is the most effective, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.159-162, April 05-09, 1987, Toronto, Ontario, Canada
• 3: BLAKE, R.S. 1984. Discovery versus expository instructional strategies and their implications for instruction of hearing-impaired post-secondary students. In Educational Teaching, Learning, and Development, A. H. Areson and J. J. DeCaro, Eds. Vol. 1. National Institute for the Deaf, Rochester, N.Y., 269-316.
• 4: John M. Carroll, The Nurnberg funnel: designing minimalist instruction for practical computer skill, MIT Press, Cambridge, MA, 1990
• 5: John M. Carroll, Making use: a design representation, Communications of the ACM, v.37 n.12, p.28-35, Dec. 1994 [doi>10.1145/198366.198374]
• 6: CARROLL, J. M. AND ROSSON, M.B. 1991. Deliberated evolution: Stalking the View Matcher in design space. Human-Comput. Interaction 6, 281-318.
• 7: CARROLL, J. M., MACK, R. L., LEWIS, C. L., GRISCHKOWSKI, N. L., AND ROBERTSON, S.R. 1985. Exploring exploring a word processor. Human-Comput. Interaction 1, 3, 283-307.
• 8: John M. Carroll , Janice A. Singer , Rachel K. E. Bellamy , Sherman R. Alpert, A view matcher for learning Smalltalk, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.431-437, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97320]
• 9: CARROLL, J. R., SMITH-KERKER, P. L., FORD, J. R., AND MAZUR-RIMETZ, S. A. 1987. The minimal manual. Human-Comput. Interaction 3, 2, 123-153.
• 10: Richard Catrambone , John M. Carroll, Learning a word processing system with training wheels and guided exploration, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.169-174, April 05-09, 1987, Toronto, Ontario, Canada
• 11: CHARNEY, D. a. AND REDER, L.M. 1986. Designing interactive tutorials for computer users. Human-Comput. Interaction 2, 297-317.
• 12: CHARNEY, D. H., REDER, L. M., AND WELLS, G.W. 1988. Studies of elaboration of instructional texts. In Effective Documentation: What Have We Learned from Research, S. Doheny- Farina, Ed. MIT Press, Cambridge, Mass., 47-72.
• 13: DAVIS, S. A. AND BOSTROM, R.P. 1993. Training end users: An experimental investigation of the roles of the computer interface and training methods. MIS Q. 17, 61-85.
• 14: Richard Gong , Jay Elkerton, Designing minimal documentation using a GOMS model: a usability evaluation of an engineering approach, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.99-107, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97261]
• 15: Jürgen Koenemann-Belliveau , John M. Carroll , Mary Beth Rosson , Mark K. Singley, Comparative usability evaluation: critical incidents and critical threads, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.245-251, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191755]
• 16: Ard W. Lazonder , Hans van der Meij, The minimal manual: is less really more?, International Journal of Man-Machine Studies, v.39 n.5, p.729-752, Nov. 1993 [doi>10.1006/imms.1993.1081]
• 17: Richard E. Mayer, The Psychology of How Novices Learn Computer Programming, ACM Computing Surveys (CSUR), v.13 n.1, p.121-141, March 1981 [doi>10.1145/356835.356841]
• 18: NIELSEN, J., FREHR, I., AND NYMAND, H. O. 1991. The learnability of Hypercard as an object-oriented programming system. Behav. Inf. Tech. 10, 2, 111-120.
• 19: NORMAN, D.A. 1983. Some observations on mental models. In Mental Models, D. Gentner and A. Stevens, Eds. Erlbaum, Hillsdale, N.J., 7-14.
• 20: Lorne Olfman, A comparison of applications-based and construct-based training methods for dss generator software, 1987
• 21: Susan Palmiter , Jay Elkerton, An evaluation of animated demonstrations of learning computer-based tasks, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.257-263, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108906]
• 22: Amiram Raban, Word processing techniques and user learning preferences, ACM SIGCHI Bulletin, v.20 n.2, p.83-87, Oct. 1988 [doi>10.1145/54386.54392]
• 23: Mary Beth Rosson , John M. Carrol , Rachel K. E. Bellamy, Smalltalk scaffolding: a case study of minimalist instruction, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.423-430, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97319]
• 24: Jean Scholtz , Susan Wiedenbeck, Learning to program in another language, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.925-930, August 27-31, 1990
• 25: Marc M. Sebrechts , Richard L. Marsh, Components of computer skill acquisition: some reservations about mental models and discovery learning, Proceedings of the third international conference on human-computer interaction on Designing and using human-computer interfaces and knowledge based systems (2nd ed.), p.168-173, September 1989, Boston, Massachusetts, United States
• 26: SIDDIQI, J., OSBORNE, R., ROAST, C., AND KHAZAEr, B. 1995. The pitfalls of changing paradigms. In Empirical Studies of Programmers: 6th Workshop, W. D. Gray and D. A. Boehm-Davis, Eds. Ablex, Norwood, N.J., 219-232.
• 27: Thomas R. Williams , David K. Farkas, Minimalism reconsidered: should we design documentation for exploratory learning?, ACM SIGCHI Bulletin, v.24 n.2, p.41-50, April 1992 [doi>10.1145/142386.142393]

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.2 Computer and Information Science Education
          Subjects: Information systems education

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Training, help, and documentation

General Terms:
Experimentation, Human Factors

Keywords:
computer training, exercises, exploration, minimalist training, practice methods