Learning by doing with simulated intelligent help

ABSTRACT

Intelligent advisory interfaces will afford new approaches to help and training problems, however little is known about the usability of such facilities. This recent study indicates that although intelligent help can support users, there are also specific potential problems.

REFERENCES

• 1: Aaronson, A.P. and Carroll, J.M. The answer is in the question: A protocol study of intelligent help. Behav. Inf. Tech. 6 (1987), 393-402.
• 2: Amy Aaronson , John M. Carroll, Intelligent help in a one-shot dialog: a protocol study, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.163-168, April 05-09, 1987, Toronto, Ontario, Canada
• 3: Aaronson, A.P. and Carroll, J.M. Understanding intelligent help: A protocol analysis of advisory interactions. IBM Res. Rep. RC 13059, 1987, Yorktown Heights, NY 10598.
• 4: Alty, J.L. and Coombs, M.J. University computing advisory services: The study of the man-computer interface. Softw.--PrlEct. Exp. 10 (1980), 919-934.
• 5: Brown, J.S., Burton, R.R. and deKleer, J. Pedagogical, natural language and knowledge engineering techniques in SOPHIE I, II, and III. In Intelligent Tutoring Systems, D. Sleeman and J.S. Brown Eds. Academic Press, New York, 1982.
• 6: Burton, R.R. Diagnosing bugs in a simple procedural skill. In Intelligent Tutoring Systems, D. Sleeman and J.S. Brown, Eds. Academic Press, New York, 1982.
• 7: Campbell, R.L. Evaluating online assistance empirically. IBM Res. Rep. RC 13410, 1988, Yorktown Heights, NY 10598.
• 8: CarroI1, J.M. Minimalist training. Datamation 30, 18 (Nov. 1, 1984), 125-136.
• 9: John M. Carroll, Five gambits for the advisory interface dilemma, Psychological issues of human-computer interaction in the work place, North-Holland Publishing Co., Amsterdam, The Netherlands, 1988
• 10: J. M. Carroll , D. S. Kay, Prompting, feedback and error correction in the design of a scenario machine, International Journal of Man-Machine Studies, v.28 n.1, p.11-27, January 1988 [doi>10.1016/S0020-7373(88)80050-6]
• 11: John M. Carroll , Sandra A. Mazur, LisaLearning, Computer, v.19 n.11, p.35-49, Nov. 1986 [doi>10.1109/MC.1986.1663098]
• 12: John M. Carroll , Jean McKendree, Interface design issues for advice-giving expert systems, Communications of the ACM, v.30 n.1, p.14-32, Jan. 1987 [doi>10.1145/7885.7886]
• 13: John M. Carroll , Mary Beth Rosson, Paradox of the active user, Interfacing thought: cognitive aspects of human-computer interaction, MIT Press, Cambridge, MA, 1987
• 14: Carroll, J.M., Smith-Kerker, P.A., Ford, J.R., Mazur, S.A. The minimal manual. IBM Res. Rep. 11637, 1986, Yorktown Heights, NY 10598.
• 15: Checco, J.C. and Carroll, J.M. SmartHelp. IBM Res. Rep., RC 12371, 1986, Yorktown Heights, NY 10598.
• 16: Clark, I.A. Software simulation as a tool for usable prcduct design. IBM Syst. J. 20, 3 (1981), 272-293.
• 17: Coombs, M.J. and Alty, J.L. Face-to-face guidance of university computer users--II: Characterizing advisory interactions. Int. J. Man- Mach. Studies 12 (1980), 407-429.
• 18: Coombs, M.J. and Alty, J.L. Expert systems: An alternate paradigm. Int. J. Man-Mach. Studies 20 (1984), 21-43.
• 19: Gerhard Fischer , Andreas Lemke , Thomas Schwab, Knowledge-based help systems, Proceedings of the SIGCHI conference on Human factors in computing systems, p.161-167, April 1985, San Francisco, California, United States
• 20: John D. Gould , John Conti , Todd Hovanyecz, Composing letters with a simulated listening typewriter, Communications of the ACM, v.26 n.4, p.295-308, April 1983 [doi>10.1145/2163.358100]
• 21: Halasz, F.G. Mental models and problem solving in using a calculator. Ph.D. Dissertation, Stanford University, 1984.
• 22: W. C. Hill , J. R. Miller, Justified advice: a semi-naturalistic study of advisory strategies, Proceedings of the SIGCHI conference on Human factors in computing systems, p.185-190, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57198]
• 23: Peter Jackson , Paul Lefrere, On the application of rule-based techniques to the design of advice giving systems, International Journal of Man-Machine Studies, v.20 n.1, p.63-86, Jan. 1984 [doi>10.1016/S0020-7373(84)80006-1]
• 24: J. F. Kelley, An empirical methodology for writing user-friendly natural language computer applications, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.193-196, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801609]
• 25: Kidd, A. The consultative role of an expert system. In Proceedings of Conference on HCI (Norwich, United Kingdom, 1985).
• 26: Kirson, D.A., Carroll, J.M., Eckhoff, R., Kelley, J.F., and Canetti, S. Specialist help using multiple media. Videotape demonstration, CHI'88 Human Factors in Computer Systems (Washington, D.C., May 15-17), 1988.
• 27: Krauss, R.M., Garlock, C.M., Bricker, P.D., and McMahon, L.E. The role of audible and visible back-channel responses in interpersonal communication. J. Pers. Soc. Psychol. 7 (1977), 523-529.
• 28: Lewis, C.H. Understanding what's happening in system interactions. In User-Centered System Design: New Perspectives on Human Computer Interaction, D.A. Norman and S.W. Draper, Eds. Erlbaum, Hillsdale, N.J., pp. 171-185.
• 29: Robert L. Mack , Clayton H. Lewis , John M. Carroll, Learning to use word processors: problems and prospects, ACM Transactions on Information Systems (TOIS), v.1 n.3, p.254-271, July 1983 [doi>10.1145/357436.357440]
• 30: Mathotra, A. and Sheridan, P.S. Experimental determination of design requirements for a program explanation system. IBM Res. Rep. RC 5831, 1976.
• 31: Richard E. Mayer, The Psychology of How Novices Learn Computer Programming, ACM Computing Surveys (CSUR), v.13 n.1, p.121-141, March 1981 [doi>10.1145/356835.356841]
• 32: J. McKendree , J. M. Carroll, Advising roles of a computer consultant, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-40, April 13-17, 1986, Boston, Massachusetts, United States
• 33: McKendree, J. and Carroll, J.M. Impact of feedback content on initial learning of an office system. In Proceedings of Interact'87 (Stuttgart, Sept. 1-4). H. Bullinger and B. Shackel, Eds. North-Holland, Amsterdam, 1987, pp. 855-859.
• 34: Martha E. Pollack, Information sought and information provided: an empirical study of user/expert dialogues, Proceedings of the SIGCHI conference on Human factors in computing systems, p.155-159, April 1985, San Francisco, California, United States
• 35: Reiser, B.J., Anderson, J.R., and Farrell, R.G. Dynamic student modelling in an intelligent tutor for Lisp programming. IJCAI Proceedings (Los Angeles, Calif., Aug. 18-23). Morgan Kaufman, Los Altos, CA, (1985), pp. 8-14.
• 36: Rissland, E.L., Valcarce, E. and Ashley, K. Explaining and arguing with examples. In Proceedings of the 3rd National Conference on Artificial Intelligence (Aug. 6-10). Morgan Kaufrnan, Los Altos, Calif. AAAI, Austin, TX, 1984, pp. 288-294.
• 37: Sleeman, D. and Brown, J.S. Intelligent Tutoring Systems. Academic Press, New York, 1982.
• 38: Spohrer, J.C., Soloway, E., and Pope, E. A goal/plan analysis of buggy Pascal programs. Hum. Comp. Interaction 1, (1985}, 163-207.
• 39: Terry Winograd , Fernando Flores, Understanding computers and cognition, Ablex Publishing Corp., Norwood, NJ, 1986

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE

General Terms:
Design, Documentation, Human Factors