Visual search and mouse-pointing in labeled versus unlabeled two-dimensional visual hierarchies

ABSTRACT

An experiment investigates (1) how the physical structure of a computer screen layout affects visual search and (2) how people select a found target object with a mouse. Two structures are examined---labeled visual hierarchies (groups of objects with one label per group) and unlabeled visual hierarchies (groups without labels). Search and selection times were separated by imposing a point-completion deadline that discouraged participants from moving the mouse until they found the target. The observed search times indicate that labeled visual hierarchies can be searched much more efficiently than unlabeled visual hierarchies, and suggest that people use a fundamentally different strategy for each of the two structures. The results have implications for screen layout design and cognitive modeling of visual search. The observed mouse-pointing times suggest that people use a slower and more accurate speed-accuracy operating characteristic to select a target with a mouse when visual distractors are present, which suggests that Fitts' law coefficients derived from standard mouse-pointing experiments may under-predict mouse-pointing times for typical human-computer interactions. The observed mouse-pointing times also demonstrate that mouse movement times for a two-dimensional pointing task can be most-accurately predicted by setting the w in Fitts' law to the width of the target along the line of approach.

REFERENCES

• 1: ABRAMS, R. A., MEYER,D.E.,AND KORNBLUM, S. 1990. Eye-hand coordination: Oculomotor control in rapid aimed limb movements. J. Exper. Psychol.: Human Perception Perform. 16, 2, 248-267.
• 2: ANDERSON,J.R.AND LEBIERE, C. (Eds.). 1998. The Atomic Components of Thought. Erlbaum, Hillsdale, NJ.
• 3: ANDERSON, J. R., MATESSA, M., AND LEBIERE, C. 1997. ACT-R: A theory of higher level cognition and its relation to visual attention. Human-Comput. Interaction, 12, 4, 439-462. Apple Computer INC. 1999. iMac User's Guide. Apple Computer, Inc., Cupertino, CA.
• 4: BIGUER, B., JANNEROD, M., AND PRABLANC, C. 1985. The role of position of gaze in movement accuracy. In Attention and Performance XI. M. I. Posner and O. S. M. Marin (Eds.), Erlbaum, Hillsdale, NJ, 407-424.
• 5: Catherine M. Burns, Navigation strategies with ecological displays, International Journal of Human-Computer Studies, v.52 n.1, p.111-129, Jan. 2000 [doi>10.1006/ijhc.1999.0326]
• 6: M. J. Burns , D. L. Warren , M. Rudisill, Formatting space-related displays to optimize expert and nonexpert user performance, Proceedings of the SIGCHI conference on Human factors in computing systems, p.274-280, April 13-17, 1986, Boston, Massachusetts, United States
• 7: BYRNE, M. D. 2001. ACT-R/PM and menu selection: Applying a cognitive architecture to HCI. Int. J. Human-Comput. Stud. 55, 41-84.
• 8: Michael D. Byrne , John R. Anderson , Scott Douglass , Michael Matessa, Eye tracking the visual search of click-down menus, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.402-409, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303118]
• 9: Stuart K. Card, User perceptual mechanisms in the search of computer command menus, Proceedings of the 1982 conference on Human factors in computing systems, p.190-196, March 15-17, 1982, Gaithersburg, Maryland, United States [doi>10.1145/800049.801779]
• 10: CARD, S. K., ENGLISH,W.K.,AND BURR, B. J. 1978. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics 21, 601-613.
• 11: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 12: EPPS, B. W. 1986. Comparison of six cursor control devices based on Fitts' law models. In Proceedings of the Human Factors Society 30th Annual Meeting. Human Factors Society, Santa Monica, CA, 327-331.
• 13: FITTS, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exper. Psychol. 47, 6, 381-391.
• 14: G. W. Furnas , T. K. Landauer , L. M. Gomez , S. T. Dumais, The vocabulary problem in human-system communication, Communications of the ACM, v.30 n.11, p.964-971, Nov. 1987 [doi>10.1145/32206.32212]
• 15: Wilbert O. Galitz, The essential guide to user interface design: an introduction to GUI design principles and techniques, John Wiley & Sons, Inc., New York, NY, 1997
• 16: Douglas J. Gillan , Kritina Holden , Susan Adam , Marianne Rudisill , Laura Magee, How does Fitts' law fit pointing and dragging?, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.227-234, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97278]
• 17: GRAY,W.D.AND BOEHM-DAVIS, D. A. 2000. Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. J. Exper. Psychol. Appl. 6,4, 322-335.
• 18: HAN, S. H., JORNA,G.C.,MILLER,R.H.,AND TAN, K. C. 1990. A comparison of four input devices for the Macintosh interface. In Proceedings of the Human Factors Society 34th Annual Meeting, Human Factors Society, Santa Monica, CA, 267-271.
• 19: Anthony John Hornof , David E. Kieras, Computational models of the perceptual, cognitive, and motor processes involved in the visual search of pull-down menus and computer screens, 1999
• 20: Anthony J. Hornof , David E. Kieras, Cognitive modeling reveals menu search in both random and systematic, Proceedings of the SIGCHI conference on Human factors in computing systems, p.107-114, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258621]
• 21: Anthony J. Hornof , David E. Kieras, Cognitive modeling demonstrates how people use anticipated location knowledge of menu items, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.410-417, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303120]
• 22: KIERAS,D.E.AND MEYER, D. E. 1997. An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Human-Comput. Interaction 12, 4, 391-438.
• 23: LOHSE, G. L. 1993. A cognitive model for understanding graphical perception. Human-Comput. Interaction 8, 353-388.
• 24: Ian Scott Mackenzie, Fitts' law as a performance model in human-computer interaction, University of Toronto, Toronto, Ont., Canada, 1992
• 25: MACKENZIE, I. S. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-Comput. Interaction 7, 91-139.
• 26: I. Scott MacKenzie , William Buxton, Extending Fitts' law to two-dimensional tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.219-226, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142794]
• 27: MCDONALD, J. E., STONE,J.D.,AND LIEBELT, L. S. 1983. Searching for items in menus: The effects of organization and type of target. In Proceedings of the Human Factors Society 27th Annual Meeting, Human Factors Society, Santa Monica, CA, 834-837.
• 28: MEEGAN,D.V.AND TIPPER, S. P. 1999. Visual search and target-directed action. J. Exper. Psychol. Human Perception Perform. 25, 5, 1347-1362.
• 29: Kevin Mullet , Darrell Sano, Designing visual interfaces: communication oriented techniques, Prentice-Hall, Inc., Upper Saddle River, NJ, 1995
• 30: Erik Lloyd Nilsen, Perceptual-motor control in human-computer interaction, University of Michigan, Ann Arbor, MI, 1992
• 31: Kent L. Norman , Ben Shneiderman, The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface, Greenwood Publishing Group Inc., Westport, CT, 1991
• 32: PAAP,K.R.AND COOKE, N. J. 1997. Design of menus. In Handbook of Human Computer Interaction (2nd ed.), M. Helander, T. K. Landauer, and P. Prabhu (Eds.), North-Holland, Amsterdam, 533- 572.
• 33: PIROLLI,P.AND CARD, S. K. 1999. Information foraging. Psychol. Rev. 106, 643-675.
• 34: ROSENBAUM, D. A. 1991. Human Motor Control. Academic Press, New York, NY.
• 35: Andrew Sears , Ben Shneiderman, Split menus: effectively using selection frequency to organize menus, ACM Transactions on Computer-Human Interaction (TOCHI), v.1 n.1, p.27-51, March 1994 [doi>10.1145/174630.174632]
• 36: SOMBERG,B.L.AND PICARDI, M. C. 1983. Locus of the information familiarity effect in the search of computer menus. In Proceedings of the Human Factors Society 27th Annual Meeting, Human Factors Society, Santa Monica, CA, 826-830.
• 37: Nancy Staggers, Impact of screen density on clinical nurses' computer task performance and subjective screen satisfaction, International Journal of Man-Machine Studies, v.39 n.5, p.775-792, Nov. 1993 [doi>10.1006/imms.1993.1083]
• 38: THACKER, P. P. 1986. Tabular displays: A human factors study. Ph.D. dissertation. Rice Univ., Houston, TX.
• 39: TREISMAN, A. 1982. Perceptual grouping and attention in visual search for features and for objects. J. Exper. Psychol. Human Perception Perform. 8, 2, 194-214.
• 40: T. S. Tullis, A system for evaluating screen formats: Research and application, Advances in human-computer interaction, Ablex Publishing Corp., Norwood, NJ, 1988
• 41: TULLIS, T. S. 1997. Screen design. In Handbook of Human-Computer Interaction (2nd ed.), M. Helander, T. K. Landauer, and P. Prabhu (Eds.), North-Holland, Amsterdam, 503-531.
• 42: WALKER, N., MEYER,D.E.,AND SMELLCER, J. B. 1993. Spatial and temporal characteristics of rapid cursor-positioning movements with electromechanical mice in human-computer interaction. Human Factors 35 3, 431-458.
• 43: WELFORD, A. T. 1968. Fundamentals of Skill. Methuen, London.
• 44: Robin Williams , John Tollett, Non-Designer's Web Book, The (3rd Edition) (Non-Designer's), Peachpit Press, Berkeley, CA, 2005

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); Screen design (e.g., text, graphics, color)

General Terms:
Experimentation, Human Factors

Keywords:
Fitts' law, mouse pointing, screen layout design, visual search