Developing a theory to guide the process of designing information retrieval systems

ABSTRACT

The dominant approaches to information retrieval system design are based on rational theory and cognitive engineering. However, these theories as well as approaches in other disciplines, reviewed in this paper, do not account for communication, or interaction, among design participants which is critical to design outcomes. This research attempts to develop a descriptive design model that accounts for communication among users, designers, and developers throughout the design process. A pilot study has been completed and a preliminary model that represents a first step in understanding participants' evolving perceptions and expectations of the design process and its outcomes is described in this paper.

REFERENCES

• 1: Deborah G. Ancona , David F. Caldwell, Information technology and work groups: the case of new product teams, Intellectual teamwork: social and technological foundations of cooperative work, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1990
• 2: Belkin, N., Seeger, T. & Wersig, G. (1983). Distributed expert problem solving as a model for information system analysis and design. Journal of lnformation Sciences, 5, pp. 153-167.
• 3: N. J. Belkin , R. D. Hennings , T. Seeger, Simulation of a distributed expert-based information provision mechanism, Information Technology Research Development Applications, v.3 n.3, p.122-141, Aug. 1984
• 4: Berger, C.R. (1986). Social cognition and intergroup communication. In W.B. Grudykunst (Ed.), Intergroup communication (pp. 51-61). Baltimore, MD: Edward Arnold Publishers.
• 5: John Seely Brown, Research that reinvents the corporation, Harvard Business Review, v.68 n.1, p.102, 1990
• 6: Cushman, D.P., & King, S. S. (1986). The role of communication rules in explaining intergroup behavior. In W.B. Grudykunst (Ed.), Intergroup communication (pp. 39-50). Baltimore, MD: Edward Arnold Publishers.
• 7: Bill Curtis , Herb Krasner , Neil Iscoe, A field study of the software design process for large systems, Communications of the ACM, v.31 n.11, p.1268-1287, Nov. 1988 [doi>10.1145/50087.50089]
• 8: Paul Raymond Dorsey, An investigation of the effectiveness of communication between systems analysts and end users in the design of large computer systems, University of Utah, Salt Lake City, UT, 1988
• 9: Dennis E. Egan , Joel R. Remde , Louis M. Gomez , Thomas K. Landauer , Jennifer Eberhardt , Carol C. Lochbaum, Formative design evaluation of superbook, ACM Transactions on Information Systems (TOIS), v.7 n.1, p.30-57, Jan. 1989 [doi>10.1145/64789.64790]
• 10: Elan, P., & Kyng, M. (1987). The collective resource approach to systems design. In G. Bjerknes, P. Ehn, M. Kyng (Eds.), Computers and democracy: A Scandinavian challenge (pp. 17-58). Brookfield, VT: Gower Publishing Company.
• 11: Fisher, B., & Ellis, D. (1990). Small group decision making: Communication and the group process. New York: McGraw Hill Publishing Co.
• 12: Guinan, P. (1986). Specialist-generalist communication competence: A field experiment investigating the communication behavior of information systems developers. Unpublished doctoral dissertation, Indiana University, Bloomington, IN.
• 13: Hutchins, J. (1977). On the structure of scientific texts. UEA Papers in Linguistics, 5, 18-39.
• 14: Kidder, T. (1985). House. Boston: Houghton Mifflin Company.
• 15: Karen Kukich, Design of a knowledge-based report generator, Proceedings of the 21st annual meeting on Association for Computational Linguistics, June 15-17, 1983, Cambridge, Massachusetts [doi>10.3115/981311.981340]
• 16: Kukich, K. (1984, July). Knowledge-based explanation generation. In Second Annual Language Generation Workshop, Stanford University, Stanford, CA.
• 17: Karen Kukich, Explanation structures in XSEL, Proceedings of the 23rd annual meeting on Association for Computational Linguistics, p.228-237, July 08-12, 1985, Chicago, Illinois [doi>10.3115/981210.981238]
• 18: Kukich, K. (1985b). The feasibility of automatic natural language report generation. In Proceedings of the 18th Annual Hawaii International Conference on System Sciences. Honalulu, HA" IEEE Computer Society Press.
• 19: Kukich, K., McDermott, j., & Wang, T. (1985). Explaining XSEL's reasoning. Unpublished manuscript, Carnegie Mellon University, Pittsburg, PA.
• 20: Lakoff, G., & Johnson, M. (1980). Metaphors we live by. Chicago: University of Chicago Press.
• 21: Leonard-Barton, D. (1987). The case for integrative innovation: an expert system at Digital. Sloan Management Review, Fall, 7-19.
• 22: Michael Lesk, SIGIR'91: the more things change, the more they stay the same, ACM SIGIR Forum, v.25 n.2, p.4-7, Fall 1991 [doi>10.1145/122665.122666]
• 23: Lievrouw, L., & Finn, T. (1990). Identifying the common dimensions of communication: The communication systems model. In B. Ruben, L. Lievrouw (Eds.), Mediation, ir~ormation, and communication, information and behavior (Vol. 3, pp. 37-65), New Brunswick, NJ: Transaction Publishers.
• 24: John McDermott, Domain knowledge and the design process, Proceedings of the 18th conference on Design automation, p.580-588, June 29-July 01, 1981, Nashville, Tennessee, United States
• 25: McDermott, J. (1982a). RI: A rule-based configurer of computer systems. Artificial Intelligence, 19(1), 39-88.
• 26: McDermott, J. (1982b). XSEL: A computer sales person's assistant. In J. Hayes, D. Michie, Y. Pao (Eds.), Machine Intelligence 10 (pp. 325-337). New York: John Wiley and Sons.
• 27: McDermott, J. (1984). Building expert systems, in W. Reitman (Ed.), Artificial Intelligence Applications for Business: Proceedings of the NYU Symposium, May 1983 (pp. 11-22). Norwood, NJ: Ablex Publishing Corp.
• 28: Mackie, R., & Wylie, C. (1988). Factors influencing acceptance of computer-based innovations. In M. Helander (Ed.), Handbook of Human-Computer Interaction (pp. 1081-1106). New York: Elsevier Science Publishers B.V.
• 29: M. Lynne Markus, Power, politics, and MIS implementation, Communications of the ACM, v.26 n.6, p.430-444, June 1983 [doi>10.1145/358141.358148]
• 30: Mumford, E. (1987). Sociotechnical systems design: Evolving theory and practice. In G. Bjerknes, P. Ehn, M. Kyng (Eds.), Computers and democracy: A Scandinavian challenge (pp. 59-76). Brookfield, VT: Gower Publishing Company.
• 31: Enid Mumford , W. Bruce MacDonald, XSEL'S progress: the continuing journey of an expert system, John Wiley & Sons, Inc., New York, NY, 1989
• 32: O'Conner, D. (1984). Using expert systems to manage change and complexity in manufacturing. In W. Reitman (Ed.), Artificial Intelligence Applications for Business: Proceedings of the NYU Symposium, May 1983 (pp. 149-158). Norwood, NJ: Ablex Publishing Corp.
• 33: A. M. Pejtersen, A library system for information retrieval based on a cognitive task analysis and supported by an icon-based interface, Proceedings of the 12th annual international ACM SIGIR conference on Research and development in information retrieval, p.40-47, June 25-28, 1989, Cambridge, Massachusetts, United States
• 34: Poole, M. S. (1983). Decision development in small groups: iIi. A multiple sequence model of group decision development. Communication Monographs, 50, 321-341.
• 35: Rifkin, G. (1986). A whole new DEC. Computer World, 20(38A), 14-22.
• 36: Sanders, R., & Cushman, D. (1984). Rules, constraints, and strategies. In C. Arnold, J. Bowers, (Eds.), Handbook of rhetoric and communication. Boston: Allyn and Bacon.
• 37: Herbert A. Simon, The sciences of the artificial (3rd ed.), MIT Press, Cambridge, MA, 1996
• 38: Tajfel, H. (1970). Experiments in intergroup discrimination. Scientific America, 223, 96-102.
• 39: Walz, D. (1988). A longitudinal study of the group design process. Unpublished doctoral dissertation, The University of Texas at Austin.
• 40: Woods, D., & Roth, E. (1988). Cognitive systems engineering. In M. Helander, (Ed.), Handbook of Human-Computer Interaction (pp. 3-43). M. Helander (Ed.), New York: Elsevier Science Publishers B.V.
• 41: WylIys, R. (1979). System design-principles and techniques, In M. Williams (Ed.), Annual Review of Information Science and Technology, (Vol. 14, pp. 3-21), New York: American Society for Information Science.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.0 General
          Subjects: Cognitive simulation

General Terms:
Design, Human Factors, Theory