Evaluation of text editors

ABSTRACT

This paper presents a methodology for evaluating computer text editors from the viewpoint of their users—from novices learning the editor to dedicated experts who have mastered the editor. The dimensions which this methodology addresses are: —Time to perform edit tasks by experts. —Errors made by experts. —Learning of basic edit tasks by novices. —Functionality over all possible edit tasks. The methodology is objective and thorough, yet easy to use. The criterion of objectivity implies that the evaluation scheme not be biased in favor of any particular editor's conceptual model—its way of representing text and operations on the text. In addition, data is gathered by observing people who are equally familiar with each system. Thoroughness implies that several different aspects of editor usage be considered. Ease-of-use means that methodology is usable by editor designers, managers of word processing centers, or other non-psychologists who need this kind of information, but have limited time and equipment resources. In this paper, we explain the methodology first, then give some interesting empirical results from applying it to several editors.

REFERENCES

• 1: Stuart K. Card , Thomas P. Moran , Allen Newell, The keystroke-level model for user performance time with interactive systems, Communications of the ACM, v.23 n.7, p.396-410, July 1980 [doi>10.1145/358886.358895]
• 2: Teresa Lynn Roberts, Evaluation of computer text editors, 1980
• 3: Augmentation Research Center. NLS-8 Command Summary. Menlo Park, California: Stanford Research Institute, May 1975.
• 4: Augmentation Research Center. NLS-8 Glossary. Menlo Park, California: Stanford Research Institute, July 1975.
• 5: Bolt, Beranek, and Newman, Inc. TENEX Text Editor and Corrector (Manual DEC10-NGZEB-D). Cambridge, Massachusetts: Author, 1973.
• 6: Garcia, Karla. Xerox Document System Reference Manual. Palo Alto, California: Xerox Office Products Division, 1980.
• 7: Palo Alto Research Center. Alto User's Handbook. Palo Alto, California: Xerox PARC, September 1979.
• 8: Stallman, R. M. EMACS Manual for ITS Users. MIT, AI Lab Memo 554, 1980.
• 9: Stanford Center for Information Processing. Wylbur/370 The Stanford Timesharing System Reference Manual, 3rd ed. Stanford, California: Stanford University, November 1975.
• 10: Wang Laboratories, Inc. Wang Word Processor Operator's Guide, 3rd release. Lowell, Mass., 1978.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.1 Document and Text Editing

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

General Terms:
Documentation, Performance