Integrated data capture and analysis tools for research and testing on graphical user interfaces

ABSTRACT

Our on-line data capture and analysis tools include an event capture program, event data filtering programs, a multimedia data analyzer, and a retrospective verbal protocal recorder for use with the multimedia data analyzer. Off-line observation logging is also supported. Additional plans for development include the integration of an online time-synchronized observation logger, and time-synchronized eyetracking data recording. The tool set provides an integrated multi-source data collection, processing, and analysis system for: 1) comparing and evaluating software applications and prototypes; 2) evaluating software documentation and instructional materials; and 3) evaluating on-line training. The tools currently run on Macintosh computers and under Microsoft Windows. Plans are to port the tools to run under Presentation manager and Motif.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology; Video (e.g., tape, disk, DVI)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Performance

Keywords:
data filtering, event capture, eyetracking, observation logging, verbal protocol, video analysis