Time-sharing and batch-processing: an experimental comparison of their values in a problem-solving situation

ABSTRACT

An experimental comparison of problem-solving using time-sharing and batch-processing computer systems conducted at MIT is described in this paper. This study is the first known attempt to evaluate two such systems for what may well be the predominant user population within the next decade—the professionals who, as nonprogrammers, are using the computer as an aid in decision-making and problem-solving rather than as a programming end in itself. Statistically and logically significant results indicate equal cost for usage of the two computer systems; however, a much higher level of performance is attained by time-sharing users. There are indications that significantly lower costs would have resulted if the time-sharing users had stopped work when they reached a performance level equal to that of the batch users. The users' speed of problem-solving and their attitudes made time-sharing the more favorable system.

REFERENCES

• 1: BRYAN, G.E. JOSS: 20,000 hours at a console-a statistical summary. Prec. AFIPS 1967 Fall Joint Comput. Conf., Vol. 31, Thompson Book Co., Washington, D.C., pp. 769-777.
• 2: COHEN, A.M. Changing small-group communications networks. In Readings in Managerial Psychology, H. J. Leavitt and L. R. Pondy (Eds.), 1954, pp. 391-405.
• 3: CORBATO, F. J. (Chairman). A panel discussion on timesharing. Dalamalion 10, 8 (Aug. 1964), 38-50.
• 4: CORBATO, F. J., DAGGETT, M. M., AND DALEY, R. C. An experimental time-sharing system. Prec. AFIPS 1962 Fall Joint Comput. Conf., Vol. 21, Spartan Books, New York, pp. 335-344.
• 5: CRISMAN, P. A. (Ed.) The Compatible Time-Sharing: A Programmer's Guide, (2nd ed.). MIT Press, Cambridge, Mass. 1965.
• 6: DAVID, E. E., AND FANO, R.M. Some thoughts about the social implications of accessible computing. Prec. AFIPS 1965 Fall Joint Comput. Conf., Vol. 26, Spartan Books, New York, pp. 243-247.
• 7: ERIKSON, W.J. A pilot study of interactive verus noninteractive debugging. SP-2687, Sys. Develop. Corp., Santa Monica, Calif., 1966.
• 8: EVAN, WILLIAM M., AND MILLER, JAMES R. III. Differential effects on response bias of computer vs. conventional administration of a social science questionnaire: a laboratory experiment. Working paper, Alfred P. Sloan School of Management, MIT, Cambridge, Mass., 1967.
• 9: FEIN, L. Time-sharing hysteria. Datamalion 11, 11 (Nov. 1965), 14--15 (Letter to the Editor).
• 10: GOLD, MICHAEL M. Methodology for evaluating time-shared computer usage. Doctoral Diss., Alfred P. Sloan School of Management, MIT, Cambridge, Mass., 1967.
• 11: GRANT, E. E., AND SACKMAN, H. An exploratory investigation of programmer performance under on-line and off-line conditions. SP-2581, Syst. Develop. Corp. Santa Moniea, Calif. 1966.
• 12: GREENBERGER, M. (Ed.). Computers and the World of the Future. MIT Press, Cambridge, Mass., 1962.
• 13: LICKLIDER, J. C.R. Man-computer partnership, Int. Sci. and Technol. 4, 41 (May 1965).
• 14: MIT Preliminary Study Committee Reports. Quart. Prog. Reps. of the Real-Time Time-Sharing Project, MIT Comput. Center, Cambridge Mass. 1961 (unpublished).
• 15: McCARTHY, J. Time-sharing computer systems. M. Greenberger (Ed.), In Computers and the World of the Future. MIT Press, Cambridge, Mass., 1962.
• 16: NEISSER, U. MAC and its users. Memo 185, MIT Project MAC, Cambridge, Mass., 1965 (unpublished).
• 17: ROSENBERG, A. Time-sharing: a status report. Dalamalion 12, 2 (Feb. 1966), 66-77.
• 18: SACKMAN, H. Experimentalinvestigation of user performance in time-shared computing systems: retrospect, prospect, and the public interest. SP-2846, Syst. Develop. Corp., Santa Monica, Calif., 5 May 1967.
• 19: SACKMAN, H., ERIKSON, W. J., AND GRANT, E. E. Exploratory experimental studies comparing online and offline programming performance, SP-2687, Syst. Develop. Corp., Santa Monica, Calif., 1966.
• 20: SALTZER, J .H . An experiment in the use of the compatible time-sharing system in the laboratory of a computer programming subject. MIT Comput. Center {Report of Progress}, Cambridge, Mass., June, 1964 (unpublished).
• 21: M. Schatzoff , R. Tsao , R. Wing, An experimental comparison of time sharing and batch processing, Communications of the ACM, v.10 n.5, p.261-265, May 1967 [doi>10.1145/363282.363292]
• 22: A. L. Scherr, AN ANALYSIS OF TIME-SHARED COMPUTER SYSTEMS, Massachusetts Institute of Technology, Cambridge, MA, 1965
• 23: SIMON, H. A. Reflections on time-sharing from a user's point of view. In Computer Science Research Review, Carnegie Inst. Technol., Pittsburgh, Pa., 1966, 43-52.
• 24: Lyle B. Smith, A comparison of batch processing and instant turnaround, Communications of the ACM, v.10 n.8, p.495-500, Aug. 1967 [doi>10.1145/363534.363552]
• 25: SOELBERG P. O. A Study of Decision-Making and Job Choice. MIT Press, Cambridge, Mass., 1967.
• 26: STRACHEY, C. Time-sharing in large, fast computers. Proc. Int. Coaf. Inform. Process., UNESCO, Paris, 1959, 1960.
• 27: STETS, JOHN A., HARRIS, JUDITH R., McELRoV, LINDA S., AND RUDLOE, HARRY. Computer-aided instruction in perceptual identification. Behav. Sci. 11 (1966).
• 28: TUROFF, MURRAY. Immediate access and the user. Dalamation 12, 8 (Aug. 1966), 57-61.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS

  H. Information Systems
  H.1 MODELS AND PRINCIPLES

General Terms:
Design, Experimentation, Human Factors, Management, Theory

Keywords:
cost effectiveness, decision making performance, man/machine communications, man/machine symbiosis, on-line vs. off-line performance, problem-solving, programming experimental empirical studies, research in man/machine communications, time-sharing vs. batch-processing, user performance, user/programming behavior