Reaching for objects in VR displays: lag and frame rate

ABSTRACT

This article reports the results from three experimental studies of reaching behavior in a head-coupled stereo display system with a hand-tracking subsystem for object selection. It is found that lag in the head-tracking system is relatively unimportant in predicting performance, whereas lag in the hand-tracking system is critical. The effect of hand lag can be modeled by means of a variation on Fitts' Law with the measured system lag introduced as a multiplicative variable to the Fitts' Law index of difficulty. This means that relatively small lags can cause considerable degradation in performance if the targets are small. Another finding is that errors are higher for movement in and out of the screen, as compared to movements in the plane of the screen, and there is a small (10%) time penalty for movement in the Z direction in all three experiments. Low frame rates cause a degradation in performance; however, this can be attributed to the lag which is caused by low frame rates, particularly if double buffering is used combined with early sampling of the hand-tracking device.

REFERENCES

• 1: Bernard D. Adelstein , Eric R. Johnston , Stephen R. Ellis, A testbed for characterizing dynamic response of virtual environment spatial sensors, Proceedings of the 5th annual ACM symposium on User interface software and technology, p.15-22, November 15-18, 1992, Monteray, California, United States [doi>10.1145/142621.142624]
• 2: Kevin W. Arthur , Kellogg S. Booth , Colin Ware, Evaluating 3D task performance for fish tank virtual worlds, ACM Transactions on Information Systems (TOIS), v.11 n.3, p.239-265, July 1993 [doi>10.1145/159161.155359]
• 3: CARLETON, L. G. 1981. Processing visual feedback for movement control. J. Exp. Psychol. Hum. Percep. Perf. 7, 5, 1019 1030.
• 4: Michael Deering, High resolution virtual reality, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.195-202, July 1992
• 5: FITTS, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47, 6, 381-381.
• 6: KEELE, S. W. AND POSNER, M.I. 1968. Processing visual feedback in rapid movements. J. Exp. Psychol. 77, 1, 155-158.
• 7: Jiandong Liang , Chris Shaw , Mark Green, On temporal-spatial realism in the virtual reality environment, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.19-25, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120784]
• 8: MACKENZIE, I.S. 1992. Fitts' Law as a research and design tool in human-computer interaction. Hum. Comput. Interact. 7, 1, 91-139.
• 9: I. Scott MacKenzie , William Buxton, Extending Fitts' law to two-dimensional tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.219-226, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142794]
• 10: I. Scott MacKenzie , Colin Ware, Lag as a determinant of human performance in interactive systems, Proceedings of the SIGCHI conference on Human factors in computing systems, p.488-493, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169431]
• 11: MAYER, D. E., ABRAMS, R. A., KORNBLUM, S., WRIGHT, C. E., AND KEITH SMITH, J. E. 1988. Optimality in human motor performance: Ideal control of rapid aimed movements. Psychol. Rev. 95, 3, 340-370.
• 12: Michael McKenna, Interactive viewpoint control and three-dimensional operations, Proceedings of the 1992 symposium on Interactive 3D graphics, p.53-56, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147163]
• 13: OGLE, K.N. 1964. Binocular Vision. Hafner, New York.
• 14: PATTERSON, R. AND MARTIIN, W.L. 1992. Human stereopsis. Hum. Factors 34, 6, 669-692.
• 15: Randy Pausch , Matthew Conway , Robert DeLine , Rich Gossweiler , Steve Miale, Alice and DIVER: a software architecture for building environments, INTERACT '93 and CHI '93 conference companion on Human factors in computing systems, p.13-14, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/259964.259976]
• 16: Thomas B. Sheridan, Musings on telepresence and virtual presence, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.120-126, Winter 1992
• 17: SHERIDAN, T. B. AND FERRELL, W.R. 1963. Remote manipulative control with transmission delay. IEEE Trans. Hum. Factors Elec. 4, 25-29.
• 18: WELFORD, A.T. 1960. Fundamentals of Skill. Methuen, London.
• 19: Colin Ware, Color Sequences for Univariate Maps: Theory, Experiments and Principles, IEEE Computer Graphics and Applications, v.8 n.5, p.41-49, September 1988 [doi>10.1109/38.7760]
• 20: Colin Ware , Kevin Arthur , Kellogg S. Booth, Fish tank virtual reality, Proceedings of the SIGCHI conference on Human factors in computing systems, p.37-42, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169066]
• 21: Yei-Yu Yeh , Louis D. Silverstein, Limits of fusion and depth judgment in stereoscopic color displays, Human Factors, v.32 n.1, p.45-60, Feb. 1990

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Design, Human Factors, Performance

Keywords:
Fitts' Law, Haptics, virtual reality