Integrating statistics and visualization: case studies of gaining clarity during exploratory data analysis

ABSTRACT

Although both statistical methods and visualizations have been used by network analysts, exploratory data analysis remains a challenge. We propose that a tight integration of these technologies in an interactive exploratory tool could dramatically speed insight development. To test the power of this integrated approach, we created a novel social network analysis tool, SocialAction, and conducted four long-term case studies with domain experts, each working on unique data sets with unique problems. The structured replicated case studies show that the integrated approach in SocialAction led to significant discoveries by a political analyst, a bibliometrician, a healthcare consultant, and a counter-terrorism researcher. Our contributions demonstrate that the tight integration of statistics and visualizations improves exploratory data analysis, and that our evaluation methodology for long-term case studies captures the research strategies of data analysts.

REFERENCES

• 1: Tom Sawyer Visualization. Tom Sawyer, (2007).
• 2: Borgatti, S. Netdraw 2. Analytic Technologies, (2007).
• 3: Borgatti, S., Everett, M. G. and Freeman, L. C. UCINET 6. Analytic Technologies, (2007).
• 4: Brandes, U. and Wagner, D. visone -- Analysis and Visualization of Social Networks In Graph Drawing Software, M. Junger and P. Mutzel. Springer-Verlag (2003).
• 5: Stuart K. Card , Jock D. Mackinlay , Ben Shneiderman, Readings in information visualization: using vision to think, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 6: Chaomei Chen , Mary P. Czerwinski, Empirical evaluation of information visualizations: an introduction, International Journal of Human-Computer Studies, v.53 n.5, p.631-635, Nov. 2000 [doi>10.1006/ijhc.2000.0421]
• 7: Wouter de Nooy , Andrej Mrvar , Vladimir Batagelj, Exploratory Social Network Analysis with Pajek, Cambridge University Press, New York, NY, 2004
• 8: Giuseppe Di Battista , Peter Eades , Roberto Tamassia , Ioannis G. Tollis, Graph Drawing: Algorithms for the Visualization of Graphs, Prentice Hall PTR, Upper Saddle River, NJ, 1998
• 9: Freeman, L. C. Visualizing Social Networks. Journal of Social Structure, 1, 1 (2000).
• 10: Grinstein, G., et al. The VAST 2006 Contest: A tale of Alderwood. In Proc. IEEE Symp. on Visual Analytics Science and Technology(2006), 215--216.
• 11: Jeffrey Heer , Stuart K. Card , James A. Landay, prefuse: a toolkit for interactive information visualization, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055031]
• 12: Nathalie Henry , Jean-Daniel Fekete , Michael J. McGuffin, NodeTrix: a Hybrid Visualization of Social Networks, IEEE Transactions on Visualization and Computer Graphics, v.13 n.6, p.1302-1309, November 2007 [doi>10.1109/TVCG.2007.70582]
• 13: Ivan Herman , Guy Melançon , M. Scott Marshall, Graph Visualization and Navigation in Information Visualization: A Survey, IEEE Transactions on Visualization and Computer Graphics, v.6 n.1, p.24-43, January 2000 [doi>10.1109/2945.841119]
• 14: Hersh, W., et al. TREC 2005 genomics track overview. In Proc. 14th Text Retrieval Conf.(2005).
• 15: John Hughes , Val King , Tom Rodden , Hans Andersen, The role of ethnography in interactive systems design, interactions, v.2 n.2, p.56-65, April 1995 [doi>10.1145/205350.205358]
• 16: Krackhardt, D., Blythe, J. and McGrath, C. KrackPlot 3.0: An Improved Network Drawing Program. Connections, 17, 2 (1994), 53--55.
• 17: Adam Perer , Ben Shneiderman, Balancing Systematic and Flexible Exploration of Social Networks, IEEE Transactions on Visualization and Computer Graphics, v.12 n.5, p.693-700, September 2006 [doi>10.1109/TVCG.2006.122]
• 18: Perer, A. and Shneiderman, B. Systematic Yet Flexible Discovery: Guiding Domain Experts through Exploratory Data Analysis. In Proc. Intelligent User Interfaces (IUI)(2008), 109--118.
• 19: Perer, A. and Wilson, C. The Steroids Social Network: An Interactive Feature on the Mitchell Report. Slate Magazine, (2007).
• 20: Catherine Plaisant, The challenge of information visualization evaluation, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989880]
• 21: Catherine Plaisant , Jean-Daniel Fekete , Georges Grinstein, Promoting Insight-Based Evaluation of Visualizations: From Contest to Benchmark Repository, IEEE Transactions on Visualization and Computer Graphics, v.14 n.1, p.120-134, January 2008 [doi>10.1109/TVCG.2007.70412]
• 22: Marc Sageman, Understanding Terror Networks, University of Pennsylvania, Philadelphia, PA, 2004
• 23: Purvi Saraiya , Chris North , Karen Duca, An Evaluation of Microarray Visualization Tools for Biological Insight, Proceedings of the IEEE Symposium on Information Visualization, p.1-8, October 10-12, 2004 [doi>10.1109/INFOVIS.2004.5]
• 24: Purvi Saraiya , Chris North , Vy Lam , Karen A. Duca, An Insight-Based Longitudinal Study of Visual Analytics, IEEE Transactions on Visualization and Computer Graphics, v.12 n.6, p.1511-1522, November 2006 [doi>10.1109/TVCG.2006.85]
• 25: Ben Shneiderman, The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations, Proceedings of the 1996 IEEE Symposium on Visual Languages, p.336, September 03-06, 1996
• 26: Ben Shneiderman , Catherine Plaisant, Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies, Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization, May 23-23, 2006, Venice, Italy [doi>10.1145/1168149.1168158]
• 27: van Ham, F. Interactive Visualization of Large Graphs. Technische Universiteit Eindhoven, 2005.
• 28: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 29: Viegas, F. B. and Wattenberg, M. Communication-Minded Visualization: A Call to Action. IBM Systems Journal, 45, 4 (2006).
• 30: Viégas, F. B., et al. Many Eyes: A Site for Visualization at Internet Scale. In Proc. IEEE Symp. on Information Visualization(2007).
• 31: Warmington, A. Action Research: Its Methods and its Implications. Journal of Applied Systems Analysis, 7(1980), 23--29.
• 32: Wasserman, S. and Faust, K. Social Network Analysis: Methods and Applications. Cambridge University Press (1994).
• 33: Pak Chung Wong , Harlan Foote , George Chin Jr. , Patrick Mackey , Ken Perrine, Graph Signatures for Visual Analytics, IEEE Transactions on Visualization and Computer Graphics, v.12 n.6, p.1399-1413, November 2006 [doi>10.1109/TVCG.2006.92]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design; Graphical user interfaces (GUI)

General Terms:
Design, Human Factors, Measurement

Keywords:
case studies, evaluation, exploratory data analysis, information visualization, social networks, statistics