Interface design issues for advice-giving expert systems

ABSTRACT

Advice giving could become the first successful domain for intelligent interfaces.

REFERENCES

• 1: Aaronson. A.P.. and Carroll, J.M. The answer is in the question: A protocol study of intelligent help. Res. Rep. RC 12034. IBM, Yorktown Heights, N.Y., 1986.
• 2: Allen, J.F.. and Perault, CR. Analyzing the intention of utterances. Arfif. I~tfelf. 15 (19801, 143-178.
• 3: Alty, J.L.. and Coombs. M.J. University computing advisory services: The study of the man-computer interface. Seftm. Pratt. Exper. 10 (1980), 919-934.
• 4: Anderson, J.R. Cognitive psychology and intelligent tutoring. In Proceedirrgs of fke Cognitive Science Socief!y Cmference (Boulder, Cola., June 28-30). Cognitive Science Society, 1984. pp. 37-43.
• 5: Anderson, J.R., Farrell, R.. and Sauers. R. Learning to program in Lisp. Cogrlifiue Sci. 8 (1984). 87-129.
• 6: Anderson, N.S., and Olson, J.R.. Eds. IMethods for designing software to fit human needs and capabilities. In Proceedings of the Nafimal Research Council Workshop on Software Huntarr Factors. National Academy Press, Washington. D.C., 1985.
• 7: William L. Bewley , Teresa L. Roberts , David Schroit , William L. Verplank, Human factors testing in the design of Xerox's 8010 “Star” office workstation, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.72-77, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801584]
• 8: Boies. S.J., Gould. J.D., Levy, S.. Richards, J.T.. and Schoonard, J. The 1984 Olympic Message System-A case study in system design. Res. Rep. RC 11138, IBM, Yorktown Heights, N.Y.. 1985.
• 9: Nathaniel Solomon Borenstein, The design and evaluation of online help systems, 1985
• 10: Brown, J.S.. Burton, R.R., and de Kleer, J. Pedagogical, natural language and knowledge engineering techniques in SOPHIE I. II. and III. In Ifltelligerzf Tuforiq Systems, D. Sleeman and J.S. Brown. Eds. Academic Press. New York, 1982. pp. 227-282.
• 11: Burton. R.R. Diagnosing bugs in a simple procedural skill. In Intelligem Tutoring Systems, D. Sleeman and J.S. Brown, Eds. Academic Press. New York, 1982. pp. 157-183.
• 12: Burton, R., and Brown. J.S. An investigation of computer coaching for informal learning activities. In ltltr~lligent Tutoring Systems, D. Sleeman and IS. Brown. Eds. Academic Press, New York, 1982. pp. 79-98.
• 13: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 14: Carroll, J.M. The adventure of getting to know a computer. Computrr 15.11 (Nov. 1982). 49-58.
• 15: Carroll, J.M. Minimalist training. Dafamation 30, 18 (Nov. 1984). 125-136.
• 16: Carroll, J.M. Satisfaction conditions for mental models. Corrfemp. Psychol. 30, 9 (1985), 693-695.
• 17: Carroll, J.M.. and Campbell, R.L. Softening up hard science: Reply to Newell and Card. Hunt. Comput. Interactiom To be published.
• 18: John M. Carroll , Caroline Carrithers, Training wheels in a user interface, Communications of the ACM, v.27 n.8, p.800-806, Aug 1984 [doi>10.1145/358198.358218]
• 19: John M. Carroll , Dana S. Kay, Prompting, feedback and error correction in the design of a scenario machine, Proceedings of the SIGCHI conference on Human factors in computing systems, p.149-153, April 1985, San Francisco, California, United States
• 20: Carroll. J.M., and Rosson. M.B. Usability specifications as a tool in iterative development. In Advances ii1 Humart-Computer ltlteraction, H.R. Harmon, Ed. Ablex, Norwood. N.J., 1985. pp. l-28.
• 21: John M. Carroll , Mary Beth Rosson, Paradox of the active user, Interfacing thought: cognitive aspects of human-computer interaction, MIT Press, Cambridge, MA, 1987
• 22: Carroll. J.M., Mack. R.L.. Lewis, C.H.. Grischkowsky, N.L.. and Robertson, S.R. Exploring exploring a word processor. Hum. Co?ttput. J!~tcracfim 1 (1985). 283-307.
• 23: Chin, D. An analysis of scripts generated in writing between users and computer consultants. in P&ceedirlgs of the National Computer Cortfererrcr, vol. 53. (Las Vegas. July 9-12). AFIPS Press, Reston. Va.. 1984. pp. 637-642.
• 24: Clancy, W.J. Tutoring rules for guiding a case method dialog. In IfftPlligeuf Tuforiug S@znts, D. Sleeman and J.S. Brown, Eds. Academic Press. New York, 1982, pp. 201-225.
• 25: Clark. LA. Software simulation as a tool for usable product design. IBM Sqsf. I. 20, 3 (1981). 272-293.
• 26: Coombs. M.J.. and Alty, J.L. Face-to-face guidance of university computer users-II: Characterizing advisory interactions. Irtt. 1, Mm- Mach. S&d. I2 (1980). 407-429.
• 27: Coombs. M.J.. and Alty. J.L. Expert systems: An alternate paradigm. Irlf. I. Marr-Mach. Sfud. 20 (1984). 21-43.
• 28: Cuff, R.N. On casual users. Int. I. MU-Mac/r. Stud. 12 (1980), 163-187.
• 29: Dearden. R.F. Instruction and learning by discovery. In The Cormpt of Educnfiorl. R.S. Peters, Ed. Humanities Press, Atlantic Highlands, N.J., 1967.
• 30: Draper, S.W. The nature of expertise in UNIX. In Hum+Cmrpufer Illferacfiorl-lr~fcracf '84, B. Shackel, Ed. North-Holland, Amsterdam, 1985, pp. 465-472.
• 31: Eason. K.D. The manager as a computer user. Appl. Ergortmics 5 (1974). 9-14.
• 32: Eason. K.D. Dialogue design implications of task allocation between man and computer. Ergomnlics 23 (1980), 881-891.
• 33: Edmonds. E.A. Adaptive man-computer interfaces. In Cmputirlg Skills md me User Interface, M.J. Coombs and J.F. Alty, Eds. Academic Press, New York, 1981, pp. 389-426.
• 34: Elsom-Cook. M.T. Design considerations of an intelligent teaching system for programming languages. In Hunm-Computer htterarfim--lilteracf '84, B. Shackel, Ed. North-Holland, Amsterdam, 1985. pp. 409-414.
• 35: Fikes. R.E. Automating the problem solving in procedural office work. In Proceedirtgs oJAFlPS Office Automation Cmfermce (Houston, Tex.. Mar. 23-25). AFIPS Press, Reston, Va.. 1981, pp. 367-369.
• 36: Gerhard Fischer , Andreas Lemke , Thomas Schwab, Knowledge-based help systems, Proceedings of the SIGCHI conference on Human factors in computing systems, p.161-167, April 1985, San Francisco, California, United States
• 37: Fitter, M. Towards more "natural" interactive systems. Ittt. /. Mart- Mach. Stud. II (1979). 339-350.
• 38: Gable. A.. and Page, C.V. The use of artificial intelligence techniques in computer-assisted instruction: An overview. Inf. 1. Mart- Mach. Sfud. 12 (1980). 259-282.
• 39: Gardner, H. Frames of Mired: The Theory of Multiple Infelligerrces. Basic Books. New York. 1983.
• 40: Genesereth, M.R. The role of plans in intelligent teaching systems. In Irrfrlligerrf Tuforirlg Sysfenrs, D. Sleeman and J.S. Brown. Eds. Academic Press. New York, 1982. pp. 137-155.
• 41: Goldstein, I.P. The genetic graph: A representation for the evolution of procedural knowledge. In Ir~tellige~~f Tuforirlg Sysfems, D. Sleeman and J.S. Brown, Eds. Academic Press, New York, 1982. pp. 51-77.
• 42: Michael Good, Etude and the folklore of user interface design, ACM SIGPLAN Notices, v.16 n.6, p.34-43, June 1981
• 43: Michael D. Good , John A. Whiteside , Dennis R. Wixon , Sandra J. Jones, Building a user-derived interface, Communications of the ACM, v.27 n.10, p.1032-1043, Oct 1984 [doi>10.1145/358274.358284]
• 44: John D. Gould , Clayton Lewis, Designing for usability: key principles and what designers think, Communications of the ACM, v.28 n.3, p.300-311, March 1985 [doi>10.1145/3166.3170]
• 45: John D. Gould , John Conti , Todd Hovanyecz, Composing letters with a simulated listening typewriter, Communications of the ACM, v.26 n.4, p.295-308, April 1983 [doi>10.1145/2163.358100]
• 46: Grignetti, MC., Hausmann. C.. and Gould. L. An "intelligent" online assistant and tutor-NLS-SCHOLAR. In Proceedings of fhe National Computer Cortferertce. vol. 44 (Anaheim, Calif., May i9-22). AFIPS Press. Reston, Va., 1975. pp. 775-781.
• 47: Hillen. J.R.C. Comparison of four different self-paced manuals. Rep. HF047. IBM Hursley Human Factors Laboratory, Hursley Park, U.K., 1981.
• 48: Holyoak. K.). Analogical thinking and human intelligence. In Admms irr fhc Psycholog!/ of Hunm I~~felligrr~ce, vol. 2, R.J. Sternberg. Ed. Erlhaum. Hillsdale, N.J.. 1983.
• 49: Raymond C. Houghton, Jr., Online help systems: a conspectus, Communications of the ACM, v.27 n.2, p.126-133, Feb. 1984 [doi>10.1145/69610.357985]
• 50: Peter Jackson , Paul Lefrere, On the application of rule-based techniques to the design of advice giving systems, International Journal of Man-Machine Studies, v.20 n.1, p.63-86, Jan. 1984 [doi>10.1016/S0020-7373(84)80006-1]
• 51: Jagodzinski. A.P. A theoretical basis for the representation of on-line computer systems to naive users. Inf. /, Man-Mach. Stud. 28 (1983), 215-252.
• 52: Johnson, W.L.. Draper, S.. and Soloway, E. Classifying bugs is a tricy business. In Proceedings of the 7th Annual NASA/Goddard Workshop on Soffware Engineering (Baltimore. Md., Dec. 1). NASA/ Goddard, Greenbelt. Md., 1982.
• 53: Jones, K.S. Proposals for R&D in intelligent knowledge based systems. J. Inf. Sri. 8 (1964). 139-147.
• 54: Alison L. Kidd , Martin B. Cooper, Man-machine interface issues in the construction and use of an expert system, International Journal of Man-Machine Studies, v.22 n.1, p.91-102, Jan. 1985 [doi>10.1016/S0020-7373(85)80079-1]
• 55: Kimball, R. A self-improving tutor for symbolic integration. In Intelligetlr Tutoring Sysfenls, D. Sleeman and J.S. Brown. Eds. Academic Press, New York. 1982, pp. 283-307.
• 56: Klahr, D. Transition processes in cognitive development. In Mechanisms in Cogrritiue Deuelopnwnt, R.J. Sternberg, Ed. Freeman, San Francisco, Calif., 1964.
• 57: Krauss, R.M.. and Glucksberg. S. Social and nonsocial speech. Sci. Am. 236 (1977), 100-105.
• 58: Henry Ledgard , John A. Whiteside , Andrew Singer , William Seymour, The natural language of interactive systems, Communications of the ACM, v.23 n.10, p.556-563, Oct. 1980 [doi>10.1145/359015.359018]
• 59: Lewis, M.L., and Anderson, J.R. Discrimination of operator schemata in problem solving: Learning from examples. Cognifive Psychol. 17 (1965), 26-65.
• 60: Robert L. Mack , Clayton H. Lewis , John M. Carroll, Learning to use word processors: problems and prospects, ACM Transactions on Information Systems (TOIS), v.1 n.3, p.254-271, July 1983 [doi>10.1145/357436.357440]
• 61: Malhotra, A., and Sheridan, P.S. Experimental determination of design requirements for a program explanation system. Res. Rep. RC 5831. IBM, Yorktown Heights, N.Y.. 1976.
• 62: Malone, T.W. Toward a theory of intrinsically motivating instruction. Cognitive Sci. 4 (7981), 333-369.
• 63: Marilyn Mantei , Nancy Haskell, Autobiography of a first-time discretionary microcomputer user, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.286-290, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801628]
• 64: Kathleen F. McCoy, Correcting misconceptions: What to say when the user is mistaken, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.197-201, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801610]
• 65: J. McKendree , J. M. Carroll, Advising roles of a computer consultant, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-40, April 13-17, 1986, Boston, Massachusetts, United States
• 66: McKendree, J.. Reiser, B.J., and Anderson, J.R. Tutoring goals and strategies in the instruction of programming skills. In Proceedings of fhe Cognitive Science Sociefy Conference (Boulder, Cola., June 28-30). Cognitive Science Society, 1984, pp. 252-254.
• 67: McKendree, J., Schorno, S., and Carroll, J.M. Personal Planner: The Scenario Machine as a research tool. SIGGRAPH Video Rev. 18 (1985). {Video demonstration shown at CHI 85 Human Fmtors in Computitlg Systems Conference, San Francisco, Calif.. Apr. 14-17.)
• 68: William M. Newman , Robert F. Sproull, Principles of interactive computer graphics (2nd ed.), McGraw-Hill, Inc., New York, NY, 1979
• 69: J. Nielsen , R. L. Mack , K. H. Bergendorff , N. L. Grischkowsky, Integrated software usage in the professional work environment: evidence from questionnaires and interviews, Proceedings of the SIGCHI conference on Human factors in computing systems, p.162-167, April 13-17, 1986, Boston, Massachusetts, United States
• 70: Nisbett. R.. and Wilson, T. Telling more than we can know: Verbal reports on mental processes. Psychol. Rev. 84 (1977), 231-259.
• 71: Norman, D.A. Categorization of action slips. Psychol. Rev. 88 (1961), l-15.
• 72: Papert. S. The role of artificial intelligence in psychology. In Language and Learning: The Debate between}ean Piaget and Nom Chomsky. M. Piattelli-Palmarini. Ed. Harvard University Press, Cambridge, Mass.. 1980. pp. 90-99.
• 73: Martha E. Pollack, Information sought and information provided: an empirical study of user/expert dialogues, Proceedings of the SIGCHI conference on Human factors in computing systems, p.155-159, April 1985, San Francisco, California, United States
• 74: Pope, B. A study of where users spend their time using VM/CMS. Res. Rep. RC 10953, IBM, Yorktown Heights. N.Y., 1985.
• 75: Reiser. B.J.. Anderson, J.R.. and Farrell, R.G. Dynamic student modelling in an intelligent tutor for Lisp programming. In Proceedings of I\CAI (Los Angeles. Calif., Aug. 18-23). Kaufman. Los Altos, Calif., 1985, pp. E-14.
• 76: Rich, E. A. Programs as data for their help systems. In Proceedings of the Natiottal Computer Conference, vol. 51 (Houston, Tex., June 7-10). AFIPS Press, Reston, Va., 1982, pp. 481-485.
• 77: Rich, E. Users are individuals: Individualizing user models. Int. J, Mm-Mach. Stud. 18 (1983). 199-214.
• 78: Mary Beth Rosson, Patterns of experience in text editing, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.171-175, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801604]
• 79: Rosson. M.B. The role of experience in editing. In Human-Computer lrlferacfio,l-ftlteract '84, B. Shackel. Ed. North-Holland, Amsterdam, 1985. pp. 45-50.
• 80: Rosson. M.B.. and Mellen. N.M. Behavioral issues in speech-based remote information retrieval. In Proceedings of AVIOS 85, L. Lermon, Ed. American Voice I/O Society, San Francisco. Calif.. 1985. pp. 23-34.
• 81: Rothenberg. J. On-line tutorials and documentation for the SIGMA message service. In Proceedirlgs of the National Computer Conference. vol. 48 (New York, June 4-7). AFIPS Press, Reston. Va., 1979, pp. 863-867.
• 82: Rumelhart. D.E., and Norman, D.A. Representation in memory. In Sfevm's Handbook of Psychology, R.C. Atkinson, R.J.. Hernstein, G. Wndzey. and R.D. Lute. Eds. Wiley, New York, 1986.
• 83: Shrager, J., and Finin, T. An expert system that volunteers advice. In Proceedings of the Nafional Conference on Artificial Intelligence (Aug. 18-20). AAAI, Pittsburgh, Pa., 1982, pp. 339-340.
• 84: Shulman. L.S., and Keislar. E.R., Eds. Learning by Discovery: A Crifical Appraisal. McNally, Chicago, Ill., 1966.
• 85: Simon, H.A. The functional equivalence of problem solving skills. Cognitive Psychol. 7 (1975). 268-288.
• 86: Sleeman, D. Assessing aspects of competence in basic algebra. In Irltelligettt Tutoring Sysfems, D. Sleeman and J.S. Brown, Eds. Academic Press, New York, 1982. pp. 185-199.
• 87: Sleeman, D., and Brown, J.S., Eds. Infelligent Tutoring Systems. Academic Press, New York, 1982.
• 88: Stevens, A.. Collins, A.. and Goldin, SE. Misconceptions in students' understanding. In Infelligenf Tutoring Systems, D. Sleeman and J.S. Brown, Eds. Academic Press, New York, 1982. pp. 13-24.
• 89: Teitelman. W., and Masinter, L. The Interlisp programming environment. Cornpufer 14,4 (Apr. 1981), 25-34.
• 90: Thomas. J.C. A method for studying natural language dialog. Res. Rep. RC 5882, IBM, Yorktown Heights, N.Y., 1976.
• 91: Thorndike, E.L. The psychology of learning. In Educafionnl Psychology, vol. 11. Teachers College of Colombia University, New York, 1913.
• 92: Turiel. E., and Davidson, P. Heterogeneity, inconsistency, and asynchrony in the development of cognitive structures. In Srage and Sfrucfure: Reopening the Debafe, I. Levin. Ed. Ablex, Norwood, N.J., 1986. pp. 106-143.
• 93: VanLehn. K. Bugs are not enough: Empirical studies of bugs. impasses and repairs in procedural skills. Tech. Rep. CIS-11, Xerox PARC, Palo Alto. Calif.. 1981.
• 94: VanLehn, K. Felicity conditions for human skill acquisition: Validating an AI-based theory. Tech. Rep. CIS-21. Xerox PARC, Palo Alto, Calif., 1983.
• 95: Joseph Weizenbaum, ELIZA—a computer program for the study of natural language communication between man and machine, Communications of the ACM, v.9 n.1, p.36-45, Jan. 1966 [doi>10.1145/365153.365168]
• 96: Robert Wilensky , Yigal Arens , David Chin, Talking to UNIX in English: an overview of UC, Communications of the ACM, v.27 n.6, p.574-593, June 1984 [doi>10.1145/358080.358101]
• 97: Michael David Williams, What makes RABBIT run?, International Journal of Man-Machine Studies, v.21 n.4, p.333-352, Oct. 1984 [doi>10.1016/S0020-7373(84)80052-8]
• 98: Zloof. M. Query-by-example: A data base language. IBM Sysr. /. 16 (1977). 324-343.

INDEX TERMS

Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE

General Terms:
Design, Documentation, Human Factors