Visualizing real-time multivariate data using preattentive processing

ABSTRACT

A new method is presented for visualizing data as they are generated from real-time applications. These techniques allow viewers to perform simple data analysis tasks such as detection of data groups and boundaries, target detection, and estimation. The goal is to do this rapidly and accurately on a dynamic sequence of data frames. Our techniques take advantage of an ability of the human visual system called preattentive processing. Preattentive processing refers to an initial organization of the visual system based on operations believed to be rapid, automatic, and spatially parallel. Examples of visual features that can be detected in this way include hue, orientation, intensity, size, curvature, and line length. We believe that studies from preattentive processing should be used to assist in the design of visualization tools, especially those for which high speed target, boundary, and region detection are important. Previous work has shown that results from research in preattentive processing can be used to build visualization tools that allow rapid and accurate analysis of individual, static data frames. We extend these techniques to a dynamic real-time environment. This allows users to perform similar tasks on dynamic sequences of frames, exactly like those generated by real-time systems such as visual interactive simulation. We studied two known preattentive features, hue and curvature. The primary question investigated was whether rapid and accurate target and boundary detection in dynamic sequences is possible using these features. Behavioral experiments were run that simulated displays from our preattentive visualization tools. Analysis of the results of the experiments showed that rapid and accurate target and boundary detection is possible with both hue and curvature. A second question, whether interactions occur between the two features in a real-time environment, was answered positively.

REFERENCES

• 1: BECKER, R. A. AND CLEVELAND, W.S. 1991. Take a broader view of scientific visualization. Pixel 2, 2, 42-44.
• 2: BELL, P. C. AND O'KEEFE, R.M. 1994. Visual interactive simulation: A methodological perspective. Ann. Oper. Res. 53, 321 342.
• 3: Peter C. Bell , Robert M. O'Keefe, Visual interactive simulation - history, recent developments, and major issues, Simulation, v.49 n.3, p.109-116, September 1, 1987 [doi>10.1177/003754978704900304]
• 4: BIRREN, F. 1969. Munsell: A Grammar of Color. Van Nostrand Reinhold, New York.
• 5: BRADDICK, O. J. AND HOLLIDAY, I.E. 1987. Serial search for targets defined by divergence or deformation of optic flow. Perception 20, 345 354.
• 6: CALLAGHAN, T.C. 1984. Dimensional interaction of hue and brightness in preattentive field segregation. Perception Psychophys. 36, 1, 25-34.
• 7: CALLAGYIAN, T.C. 1989. Interference and domination in texture seg~cegation: Hue, geometric form, and line orientation. Perception Psychophys. 46, 4, 299 311.
• 8: CALLAG~LiN, T.C. 1990. Interference and dominance in texture segregation. In Vtsual Search, D. Brogan, Ed,, Taylor & Francis, New York, 81 87.
• 9: CLARK, M F. 1991. WITNESS: Unlocking the power of visual interactive simulation. Eltr. J. Oper. Res. 54, 293 298.
• 10: Norene Collins , Christine M. Watson, Introduction to Arena, Proceedings of the 25th conference on Winter simulation, p.205-212, December 12-15, 1993, Los Angeles, California, United States [doi>10.1145/256563.256627]
• 11: Kieran Concannon , Paul Becker, A tutorial on GENETIK simulation and scheduling (tutorial session), Proceedings of the 22nd conference on Winter simulation, p.140-145, December 09-12, 1990, New Orleans, Louisiana, United States
• 12: Robert A. Drebin , Loren Carpenter , Pat Hanrahan, Volume rendering, ACM SIGGRAPH Computer Graphics, v.22 n.4, p.65-74, Aug. 1988
• 13: DRWER, J., McLEoD, P., AND DIENES, Z. 1992. Motion coherence and conjunction search: hnplications for guided search theory. Perception Psychophys. 51, 1, 79-85.
• 14: D'ZMURA, M. 1991. Color m visual search. Vision Res. 31, 6, 951-966.
• 15: Nancy J. Earle , Daniel T. Brunner , James O. Henriksen, Proof (tutorial session): the general purpose animator, Proceedings of the 22nd conference on Winter simulation, p.106-108, December 09-12, 1990, New Orleans, Louisiana, United States
• 16: ENNS, J.T. 1990. The promise of finding effective geometric codes. In Proceedzngs Vlsualzzation '90 (San Francisco, CA, Oct.), 389 390.
• 17: ENNs, J. T. AND RENSINK, R.A. 1990. Sensitiwty to three-dimensional orientation in visual search. Psychol. Scz. 1, 5,323-326.
• 18: FIDDY, E., BRIGHT, J. D., AND HURRION, R.D. 1981. SEE-WHY: Interactive simulation on the screen. In Proceedings of the Institutzon of Mechanical Engineers C293, 167-172.
• 19: FOURNIER, A. 1994. From the look of things. In Proceedings Graphws Interfoce '94, 157-166.
• 20: William J. Garrison, A brief SIMSCRIPT II.5 tutorial (tutorial session), Proceedings of the 22nd conference on Winter simulation, p.115-117, December 09-12, 1990, New Orleans, Louisiana, United States
• 21: HEALEY, C. G., BOOTH, K. S., AND ENNS, J. T. 1993. Harnessing preattentive processes for multivariate data visualization In Proceedings Graphics Interface '93 (Toronto, Canada, May 19 21), 107 117.
• 22: Christopher G. Healey , Kellogg S. Booth , James T. Enns, High-speed visual estimation using preattentive processing, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.2, p.107-135, June 1996 [doi>10.1145/230562.230563]
• 23: James O. Henriksen, SLX, the successor to GPSS/H, Proceedings of the 25th conference on Winter simulation, p.263-268, December 12-15, 1993, Los Angeles, California, United States [doi>10.1145/256563.256645]
• 24: HURRION, R. 1976. The design, use, and required facihties of an interactive visual computer simulation lang~aage to explore production planning problems. Ph.D. thesis, The University of London, England
• 25: HURRION, R. D. 1980. An interactive visual simulation system for industrial management. Eur. J. Oper. Res. 5, 86 93.
• 26: JULI~SZ, B. AND BERGEN, J.R. 1983. Textons, the fundamental elements in preattentive vision and perception of textures. Bell Syst. Tech. J. 62, 6, 1619-1645.
• 27: David R. Kalasky , Deborah A. Davis, Computer animation with CINEMA, Proceedings of the 23rd conference on Winter simulation, p.122-127, December 08-11, 1991, Phoenix, Arizona, United States
• 28: KAUFMAN, A. AND HANANI, M.Z. 1981. Converting a batch simulation program to an interactive program with graphics. Straulation 36, 4, 125-131.
• 29: William R. Lilegdon , Julie N. Ehrlich, Introduction to SLAMSYSTEM (tutorial session), Proceedings of the 22nd conference on Winter simulation, p.77-79, December 09-12, 1990, New Orleans, Louisiana, United States
• 30: MCCORMICK, B. H., DEFANTI, T. A., AND BROWN, M.D. 1987. Visualization in scientific computing a synopsis. IEEE Comput. Graph. Appl. 7, 7, 61-70.
• 31: MELAMED, B. AND MORRIS, R. J.T. 1985. Visual simulation: The performance analysis workstation. IEEE Comput. 18, 87-94.
• 32: Charles Murgiano, A tutorial on WITNESS (tutorial session), Proceedings of the 22nd conference on Winter simulation, p.177-179, December 09-12, 1990, New Orleans, Louisiana, United States
• 33: NAKAYAMA, K. AND SILVERMAN, G.H.1986. Serial and parallel processing of visual feature conjunctions. Nature 320, 264-265
• 34: O'KEEFE, R. AND DAVIES, R. 1986. A microcomputer system for simulation modeling. Eur. J. Oper. Res. 24, 23 29.
• 35: Jean J. O'Reilly , James P. Whitford, SLAM II tutorial (tutorial session), Proceedings of the 22nd conference on Winter simulation, p.72-76, December 09-12, 1990, New Orleans, Louisiana, United States
• 36: POMERANTZ, J. AND FRISTACH, E.h. 1989. Emergent features, attention, and perceptual glue in visual form perception. J. Exper. Psychol. Hum. Perception Perform. 15, 4, 635 649.
• 37: QUINLAN, P. T. AND HUMPUREYS, G.W. 1987. Visual search for targets defined by combinations of color, shape, and size: An examination of task constraints on feature and conjunction searches. Perception Psychophys. 41, 5, 455 472.
• 38: Vishwa Ranjan , Alain Fournier, Volume models for volumetric data, Computer, v.27 n.7, p.28-36, July 1994 [doi>10.1109/2.299408]
• 39: Lawrence J. Rosenblum, Research Issues in Scientific Visualization, IEEE Computer Graphics and Applications, v.14 n.2, p.61-85, March 1994 [doi>10.1109/38.267472]
• 40: THOMSON, K. A., INGm~{AM, W. J., HEALEY, J. C., LEBLOND, P. H., GROOT, C., AND HEALEY, C. G. 1992. The influence of ocean currents on the latitude of landfall and migration speed of sockeye salmon returning to the Fraser River. Fisheries Oceanography 1, 2, 163-179.
• 41: THOMSON, K. A., INGRAHAM, W. J., HEALEY, J. C., LEBLOND, P. H., GROOT, C., ANn HEALEY, C. G. 1994. The influence of ocean currents on return timing of Fraser River sockeye salmon. Canadian J. Fisheries Aquatic Scl. (in press).
• 42: L. A. Treinish , J. D. Foley , W. J. Campbell , R. B. Habor , R. F. Gurwitz, Effective software systems for scientific data visualization, ACM SIGGRAPH Computer Graphics, v.23 n.5, p.111-136, Dec. 1989
• 43: Anne Treisman, Preattentive processing in vision, Computer Vision, Graphics, and Image Processing, v.31 n.2, p.156-177, Aug. 1985 [doi>10.1016/S0734-189X(85)80004-9]
• 44: VAREY, C. A., MELLERS, B. A., AND BIRNBAUM, M.H. 1990. Judgments of proportions. J. Exper. Psychol. Human Perception Perform. 16, 3, 613 625.
• 45: Colin Ware , John C. Beatty, Using color dimensions to display data dimensions, Human Factors, v.30 n.2, p.127-142, April, 1988
• 46: WOLFE, J.M. 1994. Guided search 2.0: A revised model of visual search. Psychonomic Bull. Rev. 1, 2, 202-238.
• 47: WOLFE, J. M. AND FRANZEL, S.L. 1988. Binocularity and visual search. Perception Psychophys. 44, 81 93.
• 48: WOLFE, J. M., FRmDMAN-HILL, S. R., STEWARD, M. I., AND O'CONNEL, K.M. 1992. The role of categorization in visual search for orientation. J. Exper. Psychol. Hum. Perception Perform. 18, 34-49.
• 49: Roni Yagel , Arie Kaufman , Qiang Zhang, Realistic volume imaging, Proceedings of the 2nd conference on Visualization '91, October 22-25, 1991, San Diego, California

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Ergonomics

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Screen design (e.g., text, graphics, color)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Ergonomics; Interaction techniques
  I.6 SIMULATION AND MODELING

General Terms:
Algorithms, Design, Experimentation, Performance, Theory

Keywords:
boundary detection, cognitive psychology, curvature, hue, human vision, icon, multivariate data, preattentive, scientific visualization, target detection, visual interactive simulation