Reading patterns and usability in visualizations of electronic documents

ABSTRACT

We present an exploration of reading patterns and usability in visualizations of electronic documents. Twenty subjects wrote essays and answered questions about scientific documents using an overview+detail, a fisheye, and a linear interface. We study reading patterns by progression maps that visualize the progression of subjects' reading activity, and by visibility maps that show for how long different parts of the document are visible. The reading patterns help explain differences in usability between the interfaces and show how interfaces affect the way subjects read. With the overview+detail interface, subjects get higher grades for their essays. All but one of the subjects prefer this interface. With the fisheye interface, subjects use more time on gaining an overview of the document and less time on reading the details. Thus, they read the documents faster, but display lower incidental learning. We also show how subjects only briefly have visible the parts of the document that are not initially readable in the fisheye interface, even though they express a lack of trust in the algorithm underlying the fisheye interface. When answering questions, the overview is used for jumping directly to answers in the document and to already-visited parts of the document. However, subjects are slower at answering questions with the overview+detail interface. From the visualizations of the reading activity, we find that subjects using the overview+detail interface often explore the document further even when a satisfactory answer to the given question has already been read. Thus, overviews may grab subjects' attention and possibly distract them.

REFERENCES

• 1: Anderson, T. H. and Armbruster, B. B. 1982. Reader and text-studying strategies. In Reading Expository Material. W. Otto and S. White, Eds. New York, NY: Academic Press. 219--242.
• 2: Bazerman, C. 1988. Shaping Written Knowledge. Madison, WI: The University of Wisconsin Press.
• 3: Bishop, A. P. 1995. Working towards an understanding of digital library use. D-Lib Magazine, October 1995, http://www.dlib.org/dlib/october95/10bishop.html.
• 4: Ann Peterson Bishop, Document structure and digital libraries: how researchers mobilize information in journal articles, Information Processing and Management: an International Journal, v.35 n.3, p.255-279, May 1999 [doi>10.1016/S0306-4573(98)00061-2]
• 5: Boguraev, B., Kennedy, C., Bellamy, R., Brawer, S., and Wong, Y. Y. 1998. Dynamic presentation of document content for rapid on-line skimming. In AAAI Spring 1998 Symposium on Intelligent Text Summarization, E. Hovy and D. Radev, Eds., AAAI Press, Stanford CA, 109--118.
• 6: Ronald Brandow , Karl Mitze , Lisa F. Rau, Automatic condensation of electronic publications by sentence selection, Information Processing and Management: an International Journal, v.31 n.5, p.675-685, Sept. 1995 [doi>10.1016/0306-4573(95)00052-I]
• 7: Donald Byrd, A scrollbar-based visualization for document navigation, Proceedings of the fourth ACM conference on Digital libraries, p.122-129, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313283]
• 8: Michael D. Byrne , Bonnie E. John , Neil S. Wehrle , David C. Crow, The tangled Web we wove: a taskonomy of WWW use, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.544-551, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303154]
• 9: Chen, C., and Rada, R. 1996. Interacting with hypertext: A meta-analysis of experimental studies. Hum.-Comput. Interact. 11, 2, 125--156.
• 10: Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
• 11: Dee-Lucas, D. and Larkin, J. H. 1995. Learning from electronic texts: Effects of interactive overviews for information access. Cogn. Instruct. 13, 3, 431--468.
• 12: Andrew Dillon, Designing usable electronic text: ergonomic aspects of information usage, Taylor & Francis, Inc., Bristol, PA, 1994
• 13: Mary C. Dyson , Mark Haselgrove, The influence of reading speed and line length on the effectiveness of reading from screen, International Journal of Human-Computer Studies, v.54 n.4, p.585-612, April 2001 [doi>10.1006/ijhc.2001.0458]
• 14: Dennis E. Egan , Joel R. Remde , Louis M. Gomez , Thomas K. Landauer , Jennifer Eberhardt , Carol C. Lochbaum, Formative design evaluation of superbook, ACM Transactions on Information Systems (TOIS), v.7 n.1, p.30-57, Jan. 1989 [doi>10.1145/64789.64790]
• 15: Stephen G. Eick , Joseph L. Steffen , Eric E. Sumner, Jr., Seesoft-A Tool for Visualizing Line Oriented Software Statistics, IEEE Transactions on Software Engineering, v.18 n.11, p.957-968, November 1992 [doi>10.1109/32.177365]
• 16: Foltz, P. W. 1996. Comprehension, coherence and strategies in hypertext and linear text. In Hypertext and Cognition. Rouet, J. F., Levonen, J. J., Dillon, Andrew P., and Spiro, R. J., Eds. New Jersey: Lawrence Erlbaum Associates. 109--136.
• 17: G. W. Furnas, Generalized fisheye views, Proceedings of the SIGCHI conference on Human factors in computing systems, p.16-23, April 13-17, 1986, Boston, Massachusetts, United States
• 18: Adam Ginsburg , Joe Marks , Stuart Shieber, A viewer for PostScript documents, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.31-32, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237095]
• 19: Goldman, S. R. and Saul, E. U. 1990. Flexibility in text processing. Learning and Individual Differences, 2, 2, 181--219.
• 20: Jamey Graham, The reader's helper: a personalized document reading environment, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.481-488, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303139]
• 21: Guthrie, J. 1998. Locating information in documents: examination of a cognitive model. Reading Research Quarterly, 23, 178--199.
• 22: Wilfred J. Hansen , Christina Haas, Reading and writing with computers: a framework for explaining differences in performance, Communications of the ACM, v.31 n.9, p.1080-1089, Sept. 1988 [doi>10.1145/48529.48532]
• 23: Morten Hertzum , Erik Frøkjær, Browsing and querying in online documentation: a study of user interfaces and the interaction process, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.2, p.136-161, June 1996 [doi>10.1145/230562.230570]
• 24: Hertzum, M., Lalmas, M., and Frøkjær, E. 2001. How are searching and reading intertwined during retrieval from hierarchically structured documents? In Proceedings of the IFIP TC 13 International Conference on Human-Computer Interaction, Tokyo, Japan, Jul. 2001, M. Kurosu, Ed., IOS Press, Amsterdam, 537--544.
• 25: Lars Erik Holmquist, Focus+context visualization with flip zooming and the zoom browser, CHI '97 extended abstracts on Human factors in computing systems: looking to the future, March 22-27, 1997, Atlanta, Georgia [doi>10.1145/1120212.1120383]
• 26: Kasper Hornbæk , Benjamin B. Bederson , Catherine Plaisant, Navigation patterns and usability of zoomable user interfaces with and without an overview, ACM Transactions on Computer-Human Interaction (TOCHI), v.9 n.4, p.362-389, December 2002 [doi>10.1145/586081.586086]
• 27: Kasper Hornbæk , Erik Frøkjær, Reading of electronic documents: the usability of linear, fisheye, and overview+detail interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.293-300, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365118]
• 28: Mark A. Horney , Lynne Anderson-Inman, The electrotext project: hypertext reading patterns of middle school students, Journal of Educational Multimedia and Hypermedia, v.3 n.1, p.71-91, 1994
• 29: Karlis Kaugars, Integrated multi scale text retrieval visualization, CHI 98 conference summary on Human factors in computing systems, p.307-308, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286782]
• 30: Julian Kupiec , Jan Pedersen , Francine Chen, A trainable document summarizer, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.68-73, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215333]
• 31: Langer, E. J. 1991. Mindfulness. London: Harvill.
• 32: Aaron Marcus, Graphic design for electronic documents and user interfaces, ACM Press, New York, NY, 1991
• 33: Carol Bergfeld Mills , Linda J. Weldon, Reading text from computer screens, ACM Computing Surveys (CSUR), v.19 n.4, p.329-357, Dec. 1987 [doi>10.1145/45075.46162]
• 34: Muter, P. 1996. Interface design and optimization of reading of continuous text. In Cognitive Aspects of Electronic Text Processing. H. van Oostendorp and S. de Mul, Eds. Norwood, NJ: Ablex.
• 35: Kenton O'Hara , Abigail Sellen, A comparison of reading paper and on-line documents, Proceedings of the SIGCHI conference on Human factors in computing systems, p.335-342, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258787]
• 36: Páez, L. B., da Silva-Fh., J. B., and Marchionini, G. 1996. Disorientation in electronic environments: A study of hypertext and continuous zooming interfaces. In Proceedings of the 59th Annual Meeting of the American Society for Information Science, Baltimore, MD, Oct. 1996, Harding, S., Ed., 58--66.
• 37: Catherine Plaisant , David Carr , Ben Shneiderman, Image-Browser Taxonomy and Guidelines for Designers, IEEE Software, v.12 n.2, p.21-32, March 1995 [doi>10.1109/52.368260]
• 38: Raskin, J. 2000. The Humane Interface. Reading MA: Addison-Wesley.
• 39: George G. Robertson , Jock D. Mackinlay, The document lens, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.101-108, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168652]
• 40: Rosenthal, R., Rosnow, R. L., and Rubin, D. B. 2000. Contrasts and Effect Sizes in Behavioral Research. Cambridge: Cambridge University Press.
• 41: Rothkopf, E. 1971. Incidental memory for location of information in text. J. Verbal Learn. Verbal Behav. 10, 608--613.
• 42: Karen A. Schriver, Dynamics in document design: creating text for readers, John Wiley & Sons, Inc., New York, NY, 1997
• 43: Abigail Sellen , Richard Harper, Paper as an analytic resource for the design of new technologies, Proceedings of the SIGCHI conference on Human factors in computing systems, p.319-326, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258780]
• 44: Abigail J. Sellen , Richard H.R. Harper, The Myth of the Paperless Office, MIT Press, Cambridge, MA, 2003
• 45: Wright, P. 1987. Reading and writing for electronic journals. In Executive Control Processes in Reading. B. K. Britton and S. M. Glynn, Eds.Hillsdale, NJ: Lawrence Erlbaum Associates. 23--55.
• 46: Polle T. Zellweger , Susan Harkness Regli , Jock D. Mackinlay , Bay-Wei Chang, The impact of fluid documents on reading and browsing: an observational study, Proceedings of the SIGCHI conference on Human factors in computing systems, p.249-256, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332440]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Experimentation, Human Factors, Measurement, Performance

Keywords:
Electronic documents, digital documents, fisheye interface, information retrieval, information visualization, overview+detail interface, reading, reading patterns