Tasks and scenario-based evaluation of information visualization techniques

ABSTRACT

Usability evaluation of an information visualization technique can only be done by the joint evaluation of both the visual representation and the interaction techniques. This work proposes task models as a key element for carrying out such evaluations in a structured way. We base our work on a taxonomy abstracting from rendering functions supported by information visualization techniques. CTTE is used to model these abstract visual tasks as well as to generate scenarios from this model for evaluation purposes. We conclude that the use of task models allows generating test scenarios which are more effective than informal and unstructured evaluations.

REFERENCES

• 1: Michael D. Byrne , Bonnie E. John , Neil S. Wehrle , David C. Crow, The tangled Web we wove: a taskonomy of WWW use, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.544-551, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303154]
• 2: Stuart K. Card , Jock D. Mackinlay , Ben Shneiderman, Readings in information visualization: using vision to think, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 3: Chaomei Chen , Yue Yu, Empirical studies of information visualization: a meta-analysis, International Journal of Human-Computer Studies, v.53 n.5, p.851-866, Nov. 2000 [doi>10.1006/ijhc.2000.0422]
• 4: Cockton, G., Woolrych, A., Hall, L. and Hindmarch, M. Changing Analysts' Tunes: The Surprising Impact of a New Instrument for Usability Inspection Method Assessment, Springer-Verlag, 2003.
• 5: Cugini, J., Laskowski, S. and Sebrechts, M. Design of 3D visualization of search results: evolution and evaluation. http://www.itl.nist.gov/iaui/vvrg/cugini/irlib/ paper-may2000.html. (2000)
• 6: Freitas, C. M. D. S.; Luzzardi, P. R. G.; Cava, R. A.; Winckler, M. A.; Pimenta, M. S.; Nedel, L. P. Evaluating Usability of Information Visualization Techniques. In: IHC 2002 - 5th Workshop on Human Factors in Computer Systems. Brazilian Computer Society Press (2002).
• 7: F. Garzotto , M. Matera , P. Paolini, Abstract tasks: a tool for the inspection of Web sites and off-line hypermedia, Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, p.157-163, February 21-25, 1999, Darmstadt, Germany [doi>10.1145/294469.294510]
• 8: Brian Johnson , Ben Shneiderman, Tree-Maps: a space-filling approach to the visualization of hierarchical information structures, Proceedings of the 2nd conference on Visualization '91, October 22-25, 1991, San Diego, California
• 9: John Lamping , Ramana Rao , Peter Pirolli, A focus+context technique based on hyperbolic geometry for visualizing large hierarchies, Proceedings of the SIGCHI conference on Human factors in computing systems, p.401-408, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223956]
• 10: Giulio Mori , Fabio Paternò , Carmen Santoro, CTTE: support for developing and analyzing task models for interactive system design, IEEE Transactions on Software Engineering, v.28 n.8, p.797-813, August 2002 [doi>10.1109/TSE.2002.1027801]
• 11: E. Morse , M. Lewis , K. A. Olsen, Evaluating visualizations: using a taxonomic guide, International Journal of Human-Computer Studies, v.53 n.5, p.637-662, Nov. 2000 [doi>10.1006/ijhc.2000.0412]
• 12: Fabio Paternò , Cristiano Mancini , Silvia Meniconi, ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models, Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.362-369, July 14-18, 1997
• 13: Ben Shneiderman, The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations, Proceedings of the 1996 IEEE Symposium on Visual Languages, p.336, September 03-06, 1996
• 14: Rebecca R. Springmeyer , Meera M. Blattner , Nelson L. Max, A characterization of the scientific data analysis process, Proceedings of the 3rd conference on Visualization '92, October 19-23, 1992, Boston, Massachusetts
• 15: Linda Tauscher , Saul Greenberg, Revisitation patterns in World Wide Web navigation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.399-406, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258816]
• 16: Stephen Wehrend , Clayton Lewis, A problem-oriented classification of visualization techniques, Proceedings of the 1st conference on Visualization '90, October 23-26, 1990, San Francisco, California
• 17: U. Wiss , D. Carr , H. Jonsson, Evaluating Three-Dimensional Information Visualization Designs: A Case Study of Three Designs, Proceedings of the International Conference on Information Visualisation, p.137, July 29-31, 1998
• 18: Michelle X. Zhou , Steven K. Feiner, Visual task characterization for automated visual discourse synthesis, Proceedings of the SIGCHI conference on Human factors in computing systems, p.392-399, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274698]
• 19: Manssour, I.; Freitas, C. M. D. S.; Claudio, D. M. & Wagner, F. R. Visualizing and exploring meteorological data using a tool-oriented approach. In: Earnshaw, R.; Vince, J.; Jones, H. Visualization & Modeling. London, Academic Press, 1997. Chapter 4 (16 pp.)

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
evaluation, information visualization, task modeling, visualization tasks