The Sandbox for analysis: concepts and methods

ABSTRACT

The Sandbox is a flexible and expressive thinking environment that supports both ad-hoc and more formal analytical tasks. It is the evidence marshalling and sense-making component for the analytical software environment called nSpace. This paper presents innovative Sandbox human information interaction capabilities and the rationale underlying them including direct observations of analysis work as well as structured interviews. Key capabilities for the Sandbox include "put-this-there" cognition, automatic process model templates, gestures for the fluid expression of thought, assertions with evidence and scalability mechanisms to support larger analysis tasks. The Sandbox integrates advanced computational linguistic functions using a Web Services interface and protocol. An independent third party evaluation experiment with the Sandbox has been completed. The experiment showed that analyst subjects using the Sandbox did higher quality analysis in less time than with standard tools. Usability test results indicated the analysts became proficient in using the Sandbox with three hours of training.

REFERENCES

• 1: Alonso, R. and H. Li, Combating Cognitive Biases in Information Retrieval, In Proc. International Conference on Intelligence Analysis, 2005.
• 2: ARDA Novel Intelligence From Massive Data, NIMD, http://www.ic-arda.org/Novel_Intelligence/ , 2002.
• 3: Bodnar, J.W., Warning Analysis for the Information Age: Rethinking the Intelligence Process, Joint Military Intelligence College (JMIC), December, 2003.
• 4: Caid, W. and Pu Oing, System and Method of Context Vector Generation and Retrieval, United States Patent 5,619,709, 1997.
• 5: Stuart K. Card , Jock D. Mackinlay , Ben Shneiderman, Readings in information visualization: using vision to think, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 6: Paula Cowley , Lucy Nowell , Jean Scholtz, Glass Box: An Instrumented Infrastructure for Supporting Human Interaction with Information, Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS'05) - Track 9, p.296.3, January 03-06, 2005 [doi>10.1109/HICSS.2005.286]
• 7: Hampson, E., and P. Cowley, Instrumenting the Intelligence Analysis Process, In Proc. International Conference on Intelligence Analysis, 2005.
• 8: Heuer, Richard, Psychology of Intelligence Analysis, Center for the Study of Intelligence, 1999.
• 9: Hughes, F. and D. Schum, Discovery-Proof-Choice, The Art and Science of the Process of Intelligence Analysis -- Preparing for the Future of Intelligence Analysis, JMIC Joint Military Intelligence College, 2003.
• 10: Hutchings, D. and J. Stasko, QuickSpace, Short Paper, ACM CHI Conference, 2002, 802--803.
• 11: Institute for Human Machine Cognition, University of West Florida., Cmap Tools, http://cmap.ihmc.us/
• 12: i2 Limited., http://www.i2inc.com
• 13: Jonker, D., W. Wright, D. Schroh, P. Proulx and B. Cort, Information Triage with TRIST, In Proc. International Conference on Intelligence Analysis, 2005.
• 14: Johnston, R., Analytic Culture in the U.S. Intelligence Community, Center for the Study of Intelligence, Government Printing Office, Pittsburgh, PA.
• 15: Thomas Kapler , William Wright, Geo time information visualization, Information Visualization, v.4 n.2, p.136-146, July 2005 [doi>10.1145/1103520.1103526]
• 16: Larkin, J. and H. Simon, Why a Diagram is (Sometimes) Worth Ten Thousand Words, Cognitive Science, 11(1), 1987, 65--99.
• 17: Mindjet Inc., http://www.mindjet.com
• 18: Morse, E., M. Potts Steves and J. Scholtz, Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts, In Proc. Conference on Intelligence Analysis, 2005.
• 19: Elizabeth D. Mynatt , Takeo Igarashi , W. Keith Edwards , Anthony LaMarca, Designing an Augmented Writing Surface, IEEE Computer Graphics and Applications, v.20 n.4, p.55-61, July 2000 [doi>10.1109/38.851751]
• 20: Peter Pirolli , Stuart Card, Information foraging in information access environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.51-58, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223911]
• 21: Pirolli, P. and S, Card, The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis, In Proc. International Conference on Intelligence Analysis, 2005.
• 22: George Robertson , Mary Czerwinski , Kevin Larson , Daniel C. Robbins , David Thiel , Maarten van Dantzich, Data mountain: using spatial memory for document management, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.153-162, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288596]
• 23: Rose, Russ, ChairP1000 Committee, P1000 Report, Office of Research and Development, CIA, 1996.
• 24: Visual Analytics Inc., http://www.visualanalytics.com
• 25: Wright, William and Kapler, Thomas, Speaking with Analysts -- Observations of Current Practices with Massive Data, submitted to Journal of Intelligence Community Research and Development.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques

Keywords:
gestures, information visualization, sense making, user-centered design, visual analytics