Systematic inspection of information visualization systems

ABSTRACT

Recently, several information visualization (IV) tools have been produced and there is a growing number of commercial products. To contribute to a widespread adoption of IV tools, it is indispensable that these tools are effective, efficient and satisfying for the intended users. Various evaluation techniques can be considered and applied at the different phases of the IV software life-cycle. In this paper we propose an inspection technique based on the use of evaluation patterns, called Abstract Tasks, that take into account the specific nature of information visualization systems.

REFERENCES

• 1: C. Ardito , F. Costabile , M. De Marsico , R. Lanzilotti , S. Levialdi , T. Roselli , V. Rossano, An approach to usability evaluation of e-learning applications, Universal Access in the Information Society, v.4 n.3, p.270-283, February 2006 [doi>10.1007/s10209-005-0008-6]
• 2: Kevin Baker , Saul Greenberg , Carl Gutwin, Empirical development of a heuristic evaluation methodology for shared workspace groupware, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587093]
• 3: Buono, P., Aris, A., Plaisant, C., Khella, A., Shneiderman, B., Interactive Pattern Search in Time Series, Visualization and Data Analysis, In Proceedings of VDA 2005, San Jose, CA, USA, January 16--20, 2005, 175--186.
• 4: De Angeli, A., Matera, M., Costabile, M. F., Garzotto, F., and Paolini, P., On the Advantages of a Systematic Inspection for Evaluating Hypermedia Usability, Intern. J. of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc, 15(3), 2003, 315--335.
• 5: Alan Dix , Janet Finlay , Gregory Abowd , Russell Beale, Human-computer interaction, Prentice-Hall, Inc., Upper Saddle River, NJ, 1997
• 6: Lanzilotti, R., A Holistic Approach to Designing and Evaluating e-Learning Quality: Usability and Educational Effectiveness, PhD dissertation, Dip. Informatica, Università di Bari, Bari, Italy, 2006.
• 7: Jennifer Mankoff , Anind K. Dey , Gary Hsieh , Julie Kientz , Scott Lederer , Morgan Ames, Heuristic evaluation of ambient displays, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642642]
• 8: Matera, M., Costabile, M. F., Garzotto, F., and Paolini, P., SUE Inspection: an Effective Method for Systematic Usability Evaluation of Hypermedia, IEEE Transactions on Systems, Man and Cybernetics- Part A, 32, 1, 2002, 93--103.
• 9: Marc Nanard , Jocelyne Nanard , Paul Kahn, Pushing reuse in hypermedia design: golden rules, design patterns and constructive templates, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.11-20, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276629]
• 10: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 11: Jakob Nielsen , Robert L. Mack, Usability inspection methods, John Wiley & Sons, Inc., New York, NY, 1994
• 12: Catherine Plaisant, The challenge of information visualization evaluation, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989880]
• 13: Jenny Preece , Yvonne Rogers , Helen Sharp, Interaction Design, John Wiley & Sons, Inc., New York, NY, 2002
• 14: Ben Shneiderman, The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations, Proceedings of the 1996 IEEE Symposium on Visual Languages, p.336, September 03-06, 1996
• 15: Somervell, J., Wahid, S. and McCrickard, D. S., Usability Heuristics for Large Screen Information Exhibits, In Proceedings of Human-Computer Interaction (INTERACT '03), Zurich, Switzerland, September 3--6, 2003, 904--907.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.8 Types of Simulation
          Subjects: Visual

General Terms:
Design, Measurement, Performance