The user's mental model of an information retrieval system

ABSTRACT

An empirical study was performed to train naive subjects in the use of a prototype Boolean logic-based information retrieval system on a bibliographic database. Subjects were undergraduates with little or no prior computing experience. Subjects trained with a conceptual model of the system performed better than subjects trained with procedural instructions, but only on complex, problem-solving tasks. Performance was equal on simple tasks. Differences in patterns of interaction with the system (based on a stochastic process model) showed parallel results. Most subjects were able to articulate some description of the system's operation, but few articulated a model similar to the card catalog analogy provided in training. Eleven of 43 subjects were unable to achieve minimal competency in system use. The failure rate was equal between training conditions and genders; the only differences found between those passing and failing the benchmark test were academic major and in frequency of library use.

REFERENCES

• 1: Bayman, Piraye; Mayer, Richard E. 1984. Instructional manipulation of users' mental models for electronic calculators. International Journal of Man- Machine Studies, 20, 189-199.
• 2: Frank G. Halasz , Thomas P. Moran, Mental models and problem solving in using a calculator, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.212-216, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801613]
• 3: Halasz, Frank G. 1984. Mental models and problem solving using a calculator. Ph.D. dissertation. Stanford, CA: Stanford University.
• 4: Young, Richard M. 1981. The machine inside the machine: Users' models of pocket calculators. International Journal of Man-Machine Studies, 15, 51-85.
• 5: Carroll, John M.; Thomas, John C. 1982. Metaphor and the cognitive representation of computing systems. IEEE Transactions on Systems, Man, ~ Cybernetics, SMC-12:2, 107-116.
• 6: Donald J. Foss , Mary Beth Rosson , Penny L. Smith, Reducing manual labor: An experimental analysis of learning aids for a text editor, Proceedings of the 1982 conference on Human factors in computing systems, p.332-336, March 15-17, 1982, Gaithersburg, Maryland, United States [doi>10.1145/800049.801805]
• 7: Norman, Donald A. 1983. Some observations on mental models. In Gentner, Dedre; Stevens, Albert L. (eds.), Mental models. Hillsdale, Nj: Lawrence Erlbaum Assoc.
• 8: Jagodzinski, A. P. 1983. A theoretical basis for the representation of on-line computer systems to naive users. International Journal of Man-Machine Studies, 18, 215-2-~2.
• 9: Moran, Thomas P. 1981. The command language grammar: A representation for the user interface of Interactive systems. International Journal of Man- Machine Studies, 15, 3-50.
• 10: Young, Richard M. 1983. Surrogates and mappings: Two kinds of conceptual models for interactive devices. In Gentner, Dedre; Stevens, Albert L. (eds.), Mental models. Hillsdale, NJ: Lawrence Erlbaum Assoc.
• 11: Robert L. Mack , Clayton H. Lewis , John M. Carroll, Learning to use word processors: problems and prospects, ACM Transactions on Information Systems (TOIS), v.1 n.3, p.254-271, July 1983 [doi>10.1145/357436.357440]
• 12: Sarah A. Douglas , Thomas P. Moran, Learning text editor semantics by analogy, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.207-211, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801612]
• 13: Joseph R. Matthews , Gary S. Lawrence , Douglas Ferguson, Using Online Catalogs: A Nationwide Survey, Neal-Schuman Publishers, Inc., New York, NY, 1983
• 14: Borgman, Christine L. 1984. The user's mental model of an information retrieval system: Effects o_n performance. Unpublished PhD dissertation, Stanford University.
• 15: Coombs, J.J.; Gibson, R.; Alty, J.L. 1982. Learning a first computer language: Strategies for making sense. International Journal of Man-Machine Studies, 14:4, 449-486.
• 16: Egan, Dennis E.; Gomez, Louis M. 1984. Assaying, isolating, and accommodating individual differences in learning a complex skill. In Dillon, Ronna F. (ed.), Individual differences in cognition, Vol. 2. New York, NY: Academic Press.
• 17: Borgman, Christine L. 1984. Individual differences in learning to use a library online catalog: Pilot Project. Research project funded by the Spencer Foundation.