Accuracy measures for evaluating computer pointing devices

ABSTRACT

In view of the difficulties in evaluating computer pointing devices across different tasks within dynamic and complex systems, new performance measures are needed. This paper proposes seven new accuracy measures to elicit (sometimes subtle) differences among devices in precision pointing tasks. The measures are target re-entry, task axis crossing, movement direction change, orthogonal direction change, movement variability, movement error, and movement offset. Unlike movement time, error rate, and throughput, which are based on a single measurement per trial, the new measures capture aspects of movement behaviour during a trial. The theoretical basis and computational techniques for the measures are described, with examples given. An evaluation with four pointing devices was conducted to validate the measures. A causal relationship to pointing device efficiency (viz. throughput) was found, as was an ability to discriminate among devices in situations where differences did not otherwise appear. Implications for pointing device research are discussed.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.295-302, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258760]
• 2: Akamatsu, M., MacKenzie, I. S., and Hasbrouq, T. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device, Ergonomics 38 (1995), 816-827.
• 3: Robert W. Bailey, Human performance engineering (3rd ed.): designing high quality professional user interfaces for computer products, applications and systems, Prentice-Hall, Inc., Upper Saddle River, NJ, 1996
• 4: Card, S. K., English, W. K., and Burr, B. J. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT, Ergonomics 21 (1978), 601-613.
• 5: Sarah A. Douglas , Arthur E. Kirkpatrick , I. Scott MacKenzie, Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.215-222, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303042]
• 6: English, W. K., Engelbart, D. C., and Berman, M. L. Display selection techniques for text manipulation, IEEE Transactions on Human Factors in Electronics HFE-8 (1967), 5-15.
• 7: Epps, B. W. Comparison of six cursor control devices based on Fitts' law models, In Proceedings of the Human Factors Society 30th Annual Meeting. Santa Monica, CA: Human Factors Society, 1986, pp. 327-331.
• 8: ISO ISO/TC 159/SC4/WG3 N147: Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9 - Requirements for non-keyboard input devices, International Organisation for Standardisation, May 25, 1998.
• 9: Karat, J., McDonald, J. E., and Anderson, M. A comparison of selection techniques: touch panel, mouse, and keyboard, In Human-Computer Interaction--INTERACT '84. Elsevier Science Publishers, 1985, pp. 189-193.
• 10: MacKenzie, I. S. Fitts' law as a research and design tool in human-computer interaction, Human-Computer Interaction 7 (1992), 91-139.
• 11: I. Scott MacKenzie , Abigail Sellen , William A. S. Buxton, A comparison of input devices in element pointing and dragging tasks, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.161-166, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108868]
• 12: Anant Kartik Mithal , Sarah A. Douglas, Differences in movement microstructure of the mouse and the finger-controlled isometric joystick, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.300-307, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238533]
• 13: Murata, A. An experimental evaluation of mouse, joystick, joycard, lightpen, trackball, and touchscreen for pointing: Basic study on human interface design, In Proceedings of the Fourth International Conference on Human-Computer Interaction. Elsevier, 1991, 123-127.
• 14: J Stevens, Applied multivariate statistics for the social sciences, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1986

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Human Factors, Measurement, Performance, Reliability, Theory

Keywords:
computer pointing devices, cursor positioning tasks, performance evaluation, performance measurement