Computer-based systems for cooperative work and group decisionmaking: status of use and problems in development

ABSTRACT

Application of computer and information technology to cooperative work and group decisionmaking has grown out of three traditions: computer-based communications, computer-based information service provision, and computer-based decision support. This paper provides an overview of the various kinds of systems that have been configured to meet the needs of groups at work, evaluates the status of these systems in the United States, evaluates the experience with them, assesses barriers to their further development and use, and draws conclusions about future work in this area that should be undertaken. An extensive set of references is provided.

REFERENCES

• 1: Adelman, Leonard 1982. Real time computer support of decision analysis in a group setting. Paper presented at the ORSA/TIMS meeting, Detroit, MI, April 18--21.
• 2: Adelman, Leonard. 1984. Real time computer support for decision analysis in a group setting: Another class of decisiol support systems, Interfaces, 14(2): 75--83.
• 3: Adelman, Leonard, Michael L. Donnell, John F. Patterson and Jonathan J. Weiss. 1981. Issues in the Design and Evaluation of Decision-Analytic Aids. Technical Report TR 81-1-304. McLean, VA: Decisions and Designs, Inc.
• 4: Administrative Management, 1982. New ideas in conference rooms. September: 30--32.
• 5: Allardyce, Linda B., Dorothy M. Amey, Phillip H. Feuerwerger and Roy M. Gulick. 1979. Documentation of Decision-Aiding Software: DECISION Functional Description. McLean, VA: Decisions and Designs, Inc.
• 6: Allardyce, Linda B., Dorothy M. Amey, Phillip H. Feuerwerger and Roy M. Gulick. 1979. Documentation of Decision-Aiding Software: EVAL Functional Description. McLean, VA: Decisions and Designs, Inc.
• 7: Amey, Dorothy M., Phillip H. Feuerwerger and Roy M. Gulick. 1979. Documentation of Decision-Aiding Software: INFER Functional Description. McLean, VA: Decisions and Designs, Inc.
• 8: Amey, Dorothy M., Phillip H. Feuerwerger and Roy M. Gulick. 1979. Documentation of Decision-Aiding Software: OPINT Functional Description. McLean, VA: Decisions and Designs, Inc.
• 9: Amey, Dorothy M., Phillip H. Feuerwerger and Roy M. Gulick. 1979. Documentation of Decision-Aiding Software: RAM Functional Description. McLean, VA: Decisions and Designs.
• 10: Amey, Dorothy M., Phillip H. Feuerwerger and Roy M. Gulick. 1979. Documentation of Decision-Aiding Software: SCORING RULE Functional Description. McLean, VA: Decisions and Designs, Inc.
• 11: Applegate, Lynda M., Benn R. Kosynski and Jay F. Nunamaker. 1986. Knowledge management in organizational planning. Working paper #PL-16. Tucson, AZ: Department of Management Information Systems, University of Arizona.
• 12: Lynda M. Applegate , Benn R. Konsynski , J. F. Nunamaker, A group decision support system for idea generation and issue analysis in organization planning, Proceedings of the 1986 ACM conference on Computer-supported cooperative work, December 03-05, 1986, Austin, Texas [doi>10.1145/637069.637073]
• 13: Bode, Joseph J. 1983. An executive information system: a DSS case study, in George P. Huber (ed.), DSS-83 Transactions, Third International Conference on Decision Support Systems, June 27--29, Boston, MA. Austin, TX: Institute for Advancement of Decision Support Systems, pp. 129--130.
• 14: Brea, City of. 1982. A communications master plan for the Brea civic cultural center. Brea, CA: March, mimeo.
• 15: Brown, Rex V. 1978. Research on Decision-Analytic Technology. Final Report PR 78-11-25. McLean, VA: Decisions and Designs, Inc.
• 16: Buede, Dennis M. Undated. Decision conferences at Decisions and Designs, Incorporated. 6 pages plus overhead slides.
• 17: Buede, Dennis M. 1979. Decision analysis: engineering science clinical art? Paper prepared for Defense Advanced Research Projects Agency, November. 48 pages.
• 18: Buede, Dennis M. and Kathleen A. Waslov. 1981. Decision Analytic Workshops. Final Report PR 81-15-324. McLean, VA: Decisions and Designs, Inc.
• 19: Business Week, 1976. Corporate war rooms plug into the computer. August 23: 65,67.
• 20: CACI, Inc. 1978. CACI further development of evaluation methodologies for an interactive computer-based group decision making aid, final report. Arlington, VA: CACI, Inc.
• 21: Chastain, Jean L. 1983. Creation of an information center, DSS-83 Transactions, Third International Conference on Decision Support Systems, June 27--29, Boston, MA. Austin, TX: Institute for Advancement of Decision Support Systems, pp. 97--107.
• 22: Dalkey, Norm C. 1977. Group decision making. Rep. UCLA-ENG-7749. Los Angeles, CA: School of Engineering and Applied Science.
• 23: Dalkey, Norm C. 1975. Group decision analysis. Rep. UCLA-ENG-7571. Los Angeles, CA: School of Engineering and Applied Science. 40 pages.
• 24: Gerardine DeSanctis , Brent Gallupe, GDSS: a brief look at a new concept in decision support, Proceedings of the twenty-first annual conference on Computer personnel research, p.24-28, May 02-03, 1985, Minneapolis, Minnesota, United States [doi>10.1145/16687.16690]
• 25: Elfont, Mark 1982. Group decision aid: an interactive comuter approach to decision making. Paper presented at the ORSA/TIMS Meeting, Detroit, MI, April 18--21.
• 26: Fischer, Gregory W., Ward Edwards and Clinton W. Kelly, III. 1978. Decision Theoretic Aids for Inference, Evaluation, and Decision Making: A Review of Research and Experience. Technical Report TR 78-1-30. McLean, VA: Decisions and Designs, Inc.
• 27: Fischoff, Baruch, Bernard Goitein and Zur Shapira. 1981. Subjective expected utility: a model of decision making, Journal of the American Society for Information Science, 32(September):391--399.
• 28: Gardiner, P.C. and W. Edwards. 1975. Public values: multiattribute utility management for social decision making. In Schwartz and Kaplan, eds., Human Judgment and decision Processes. New York: Academic Press.
• 29: Gray, Paul 1983. Initial observations from the decision room project. In George P. Huber (ed.), DSS-83 Transactions, Third International Conference on Decision Support Systems, June 27--29, Boston, MA, Transactions, pp. 135--138.
• 30: Gray, P., Aronofsky, J.S. Berry, N., Hehner, O., Kane, G.R. and Perkins, T.E. 1981. The SMU decision room project. In Proceedings of the First International Conference on Decision Support Systems, Execucom Systems Corporation, Austin, TX, pp. 122--129.
• 31: Grindlay, Andrew. 1980. Information centres, Business Quarterly, Winter:84--86.
• 32: Hammond, Kenneth R. Undated. Externalizing the parameters of quasirational thought. Boulder, CO: Institute of Behavioral Science, University of Colorado, mimeo.
• 33: Hammond, Kenneth R., J.L. Mumpower, and T.H. Smith. 1977. Linking environmental models with models of human judgment; a symmetrical decision aid, IEEE Transactions on Systems, Man, and Cybernetics, 7(5):358--367.
• 34: Hammond, L.W. 1982. Management considerations for an information center, IBM Systems Journal, 21(2):131--161.
• 35: Starr Roxanne Hiltz , Murray Turoff, The evolution of user behavior in a computerized conferencing system, Communications of the ACM, v.24 n.11, p.739-751, Nov. 1981 [doi>10.1145/358790.358794]
• 36: Hogarth, Robin M., and Spyros Makridakis. 1981. The value of decision making in a complex environment, Management Science, 27(1):93--107.
• 37: Houston, V. 1983. Survey: Three DSS Products Similar. MIS Week, September 14, Section II, 2--5.
• 38: Howard, R.A. 1980. An assessment of decision analysis, Operations Research.
• 39: Huber, George P. 1980. Organizational science contributions to the design of decision support systems. In Goran Fick and Ralph H. Sprague, Jr., eds., Decision Support Systems: Issues and Challenges. New York: Pergamon Press, pp. 45--55.
• 40: Huber, George P. 1982a. Group decision support systems as aids in the use of structured group management techniques. In Gary Dickson (ed.), DSS-82, Second International Conference on Decision Support Systems Transactions, June 14--16, San Francisco, CA, pp. 96--108.
• 41: Huber, George P. 1982b. Decision support systems: their present nature and future applications. In Gerardo R. Ungson and Daniel N. Braunstein (eds.), Decision Making: An Interdisciplinary Inquiry. Belmont, CA: Kent Publishing Company, pp. 249--262.
• 42: Huber, George P. 1981a. The nature of organizational decisionmaking and the design of decision support systems. MIS Quarterly, 5(2), June, pp. 1--10.
• 43: Huber, George P. 1981b. Integrating the design of organizations and the design of decision support systems. Paper presented at the ORSA/TIMS meeting, Houston, TX, October 11--14.
• 44: Huber, George P. 1984. Issues in the design of group decision support systems. MIS Quarterly, 8(3):195--204
• 45: Huber, George P. and Andre Delbecq, 1972. Guidelines for combining the judgments of individual members in decision conferences, Academy of Management Journal, (June): 161--174.
• 46: Institute of Government and Policy Studies (undated). Decision Techtronics Group: The New Perspective. Albany, NY: Nelson A. Rockefeller College of Public Affairs and Policy, State University of New York. 5 pages.
• 47: Jerving, J. 1980. Electronic technology speeds decision making, Association Management, 32(6):108--111.
• 48: Jones, Kirk, M. 1981. Technology to support group decision making. Paper presented at the ORSA/TIMS Meeting, Houston, TX, October 11--14.
• 49: Kaplan, M.F. and S. Schwartz, eds. 1975. Human Judgment and Decision Processes. New York: Academic Press.
• 50: Kaplan, M.F. and S. Schwartz, eds. 1977. Human Judgment and Decision Processes in Applied Settings. New York: Academic Press.
• 51: Kelly, Clinton W., Roy M. Gulick and Richard R. Stewart. 1980. The Decision Template Concept. Final Technical Report PR 80-17-99. McLean, VA: Decisions and Designs, Inc.
• 52: Elaine B. Kerr , Starr Roxanne Hiltz, Computer-Mediated Communication Systems: Status and Evaluation, Academic Press, Inc., Orlando, FL, 1982
• 53: King, John Leslie, 1983. Report of visit to SUNY, Albany Decision Techtronics Group, Albany, NY, September 1.
• 54: King, John Leslie, 1983. Report of visit to First National Bank of Chicago Headquarters, Chicago, IL, September 2.
• 55: King, John Leslie, 1983. Report of visit to the Gould Corporation, Rolling Meadows, IL, September 2.
• 56: King, John L. and Kenneth L. Kraemer. 1983. Information Systems and Intergovernmental Relations. In Trudi Miller (ed), Governmental Performance. Baltimore: Johns Hopkins University Press.
• 57: Kraemer, Kenneth L. 1982. Telecommunications/transportation substitution and energy conservation, Telecommunications Policy, (March): 39--59
• 58: Kraemer, Kenneth L., Dickhoven, Siegfried, Fallows, Susan E. and King, John L. 1983. Computers, Planning Models and Policymaking. Irvine, CA: Public Policy Research Organization, University of California.
• 59: Kucia, Richard J. 1983. Designing an information center for a new headquarters, in George P. Huber (ed.), DSS-83 Transactions, Third International Conference on Decision Support Systems, June 27--29, Boston, MA. Austin, TX: The Institute for Advancement of Decision Support Systems, pp. 116--120.
• 60: Kunreuther, H.C., and P.J.H. Schoemaker. 1982. Decision analysis for complex systems: integrating descriptive and prescriptive components. In G.R. Ungson and D.N. Braunstein (eds.), Decision Making: An Interdisciplinary Inquiry. Belmont, CA: Kent Publishing Company, pp. 263--279.
• 61: Leal, Antonio, Steven Levin, Steven Johnson, Marcy Agmon, and Gershon Weltman. 1978. An interactive computer aiding system for group decision making. Tech. Rep. PQTR-1046-78-2.
• 62: Leal, Antonio and Judea Pearl. 1977. An interactive program for conversational elicitation of decision structures, IEEE Transactions on Systems, Man, and Cybernetics, SMC-7 (May): 368--376.
• 63: Mackinnon, W.J., and L.M. Anderson. 1976. The SPAN III computer program for synthesizing group decisions: weighting participants' judgments in proportion to confidence, Behavior Research Methods and Instrumentation, 8(4):409--410.
• 64: Manilla, James. 1980. The meeting room of the future, Public Relations Journal, 36(9): 29--30.
• 65: Marling, W. 1976. Advice and the consensor, MBA, 10(8):32.
• 66: Martin, Anne W., Terry A. Bresnick and Dennis M. Buede. 1981. Evaluation of Command and Control Centers. Interim Technical Report TR 81-3-328. McLean, VA: Decisions and Designs, Inc.
• 67: Mau, Sonya. 1982. The information center, Access, 82:153--161.
• 68: Merkhofer, M.W., B. Robinson, and R.J. Korsan. 1979. A computer-aided decision structuring process. Tech. Rep. 7320. Menlo Park, CA: SRI International.
• 69: Moore, Craig W. An integrated DSS for sales, marketing and planning, in George P. Huber (ed.), DSS-83 Transactions, Third International Conference on Decision Support Systems, June 27--29, Boston, MA. Austin, TX: The Institute for Advancement of Decision Support Systems, pp. 22--23.
• 70: Morris, P.A., and R.D. Smallwood, 1981. A task force decision analysis, Operations Research.
• 71: Moss, Lynn 1982. Marketing News, November 26:
• 72: Nickerson, R.S. and C.E. Feehrer, 1975. Decision making and training: a review of theoretical and empirical studies of decision making and their implications for the training of decision makers. Tech. Rep. NAVTRAEQUIPCEN 73-C-0128-1. Cambridge, MA: BBN.
• 73: Participation Systems, Inc. 1983. Participate: a tool for managers, 8 pages, mimeo.
• 74: Patterson, John F., Scott L. Randall, and Richard R. Steward. 1981. Advisory Decision Aids: A Prototype. Technical Report PR 80-27-312. McLean, VA: Decisions and Designs, Inc.
• 75: Pferd, W., L.A. Peralta, and F.X. Predergast. 1979. Interactive graphics teleconferencing, Computer, 18(10):62--72.
• 76: Quinn, Robert E. 1978. Towards a theory of changing: a means-ends model of the organizational improvement process, Human Relations, 3l(5):395--416.
• 77: Quinn, Robert E. and Michael R. McGrath 1982. Moving beyond the single-solution perspective: the competing values approach as a diagnostic tool, The Journal of Applied Behavioral Science, 18(4):463--472. Quinn, Robert, John Rohrbaugh and Michael R. McGrath. 1985. Automated decision conferencing: How it works, Personnel, 62(11):49--55.
• 78: Robinson, Patrick J. and Brent Stidsen. 1971. Experience with a management information and control laboratory. In Kriebel, Charles H., Richard Van Horn and J. Timothy Heames, Management Information Systems: Progress and Perspectives. Pittsburgh, PA: Graduate School of Industrial Administration, Carnegie-Mellon University, pp.253--277.
• 79: Rohrbaugh, John 1981. hnproving the quality of group judgment: social judgment analysis and the nominal group technique, Organizational Behavior and Human Performance, 28:272--288.
• 80: Rohrbaugh, John 1979. hnproving the quality of group judgment: social judgment analysis and the Delphi technique, Organizational Behavior and Human Performance, 24:73--92.
• 81: Rohrbaugh, John and Paul Wehr. 1978. Judgment analysis in policy formation: a new method for improving public participation, Public Opinion Quarterly, pp. 521--532.
• 82: Rouse, William B. 1973. Group-computer interaction, Proceedings of the 1973 International Conference on Cybernetics and Society, pp. 145--146.
• 83: Rouse, William B. 1974. GRPRNK: A group-computer interactive package for ranking of alternatives. Cambridge, MA MIT Community Dialog Project Report No. 10.
• 84: Rouse, William B. 1973a. TAXPKG: A group-computer interactive package for decision making on income taxation policy Cambridge, MA: MIT Community Dialog Project Report No. 3.
• 85: Rouse, William B. 1973b. SOLVER: A group-computer interactive package for general problem solving. Cambridge, MA MIT Comnmnity Dialog Project Report No. 4.
• 86: Rouse, William B. and Thomas B. Sheridan 1973. Utility Approach to Group Decision Making. Cambridge, MA: MIT Community Dialog Project Report No. 2.
• 87: Rouse, William B. and Thomas B. Sheridan 1975. Computer-aided group decision making: theory and practice, Technological Forecasting and Social Change, 7:113--126.
• 88: Saleh, J., A. Leal, J. Kim, and J. Pearl. 1979. Progress towards a goal-directed decision support system. UCLA-ENG CSL-7973. Los Angeles, CA: Cognitive Systems Lab, UCLA.
• 89: Sarin, Sunil. 1984. Interactive on-line conferences. Ph.D. thesis, MIT/LCS/TR-330. Cambridge, MA: Laboratory for Computer Science, MIT.
• 90: Sunil Sarin , Irene Greif, Computer-based real-time conferencing systems, Computer, v.18 n.10, p.33-45, Oct. 1985 [doi>10.1109/MC.1985.1662711]
• 91: Seaver, D.A. 1977. How groups can assess uncertainty: human interaction versus mathematical models. Los Angeles, CA Social Science Research Institute, University of Southern California.
• 92: Sheridan, Thomas B. 1973. Progress report of the MIT Community Dialog Project, Proceedings of the 1973 International Conference on Cybernetics and Society, Boston, MA, pp. 139--144.
• 93: Sheridan, Thomas B. 1975a. Man-Machine Systems: Information Control and Decision Models of Human Performance Cambridge, MA: MIT Press.
• 94: Sheridan, Thomas B. 1971. New technology for group dialog and social choice, Proceedings of the 1971 Fall Joint Computer Conference, pp. 327--335.
• 95: Sheridan, Thomas B. 1975b. Community dialog technology, Proceedings, IEEE Special Issue on Social Systems Engineering 63(3) (March): 463--475.
• 96: Simmons, William W. 1979. "The consensor: a new tool for decision-makers, The Futurist, April: 91--94.
• 97: Sprague, R.H. 1980. "A Framework for the Development of Group Decision Support Systems," MIS Quarterly, 4(4): 1:26
• 98: Steeb, Randall 1978. Automated management of communications with remote systems: a decision analysis approach {source is cu rrently unknown}
• 99: Steeb, Randall and Steven C. Johnston. 1981. A computer-based interactive system for group decisionmaking. IEEE Transactions on Systems, Man, and Cybernetics, 11(8):544--552.
• 100: Stefik, Mark, Gregg Foster, Daniel G. Bobrow, Kenneth Kahn, Stan Lanning, and Luch Suchman. 1985. Beyond the chalk board: Computer support for collaboration and problem solving in meetings. Palo Alto: Intelligent Systems Laboratory Xerox Palo Alto Research Center.
• 101: Sticha, Paul J., and John F. Patterson. 1981. Evaluation of Video Teleconference Systems. Final Technical Report TR 80-8-317. McLean, VA: Decisions and Designs, Inc.
• 102: Sticha, Paul J., and John F. Patterson. 1980. Video Teleconference Design Evaluation. Interim Report PR 80-19-317 McLean, VA: Decisions and Designs, Inc.
• 103: Sticha, Paul J., Scott L. Randall, and Gregory M. Hunter. 1980. Research into Teleconferencing. Final Technical Report TR 80-9-314. McLean, VA: Decisions and Designs, Inc.
• 104: Stodolsky, D., 1981. "Automatic Mediation in Group Problem Solving." Behavior Research Methods and Instrumentation 13(2): 235:242.
• 105: Mary Sumner, Organization and management of the information center: case studies, Proceedings of the twenty-first annual conference on Computer personnel research, p.38-49, May 02-03, 1985, Minneapolis, Minnesota, United States [doi>10.1145/16687.16692]
• 106: Telephone interview with Richard G. Miltner, Associate Director - Program Planning, Decision Techtronics Group, SUNY Albany, 6-23-83.
• 107: Telephone interview with Robert Quinn, Executive Director, Institute of Government and Policy Studies, SUNY, Albany 6-23-83.
• 108: Torgler, Robert H. 1983. The information center, Information Processing, 2(1): 12--27.
• 109: Turoff, M. 1972. Delphi conferencing: computer-based conferencing with anonymity. Technological Forecasting and Social Change. 3:159--204.
• 110: Turoff, M. and S.R. Hiltz 1982. Computer support systems for group versus individual decisions. IEEE Transactions on Communications. 30(1): 82--91.
• 111: Ulvila, Jacob W. 1975. A Pilot Survey of Computer Programs for Decision Analysis. Technical Report 75-2. McLean, VA: Decisions and Designs, Inc.
• 112: Ungson, G.R., and D.N. Braunstein (eds). 1982. Decision Making: An Interdisciplinary Inquiry. Belmont, CA: Kent Publishing Company.
• 113: U.S. News and World Report 1981, November, 23:
• 114: Von Winterfeldt, D. 1975. An overview, integration, and evaluation of utility theory for decision analysis. Res. Rep. 75-9. Los Angeles, CA: Social Science Research Institute, University of Southern California.
• 115: Van Nievelt, M.C. Augustus, 1982. Marketing goes on-line: a DSS case study, in Gary W. Dickson, DSS-82 Transactions, Second International Conference on Decision Support Systems, June 14--16, 1982, San Francisco, CA, pp 84--86.
• 116: Waltrip, R. 1983. The HOBO System. Sacramento, CA: County Data Processing Department.
• 117: Weiss, Jonathan J. 1980. QVAL and GENTREE: Two Approaches to Problem Structuring in Decision Aids. Technical Report TR 80-3-97. McLean, VA: Decisions and Designs, Inc.
• 118: Weiss, Jonathan J., and Clinton W. Kelly, III. 1980. RSCREEN and OPGEN: Two Problem Structuring Decision Aids which Employ Decision Templates. Technical Report TR 80-4-97. McLean, VA: Decisions and Designs, Inc.
• 119: Youstra, Ray and Enid Squire. 1983. Information Center Implementation Guide, IBM Technical Bulletin, April. New York: The IBM Corporation, 82 pages.