Perception of elementary graphical elements in tabletop and multi-surface environments

ABSTRACT

Information shown on a tabletop display can appear distorted when viewed by a seated user. Even worse, the impact of this distortion is different depending on the location of the information on the display. In this paper, we examine how this distortion affects the perception of the basic graphical elements of information visualization shown on displays at various angles. We first examine perception of these elements on a single display, and then compare this to perception across displays, in order to evaluate the effectiveness of various elements for use in a tabletop and multi-display environment. We found that the perception of some graphical elements is more robust to distortion than others. We then develop recommendations for building data visualizations for these environments.

REFERENCES

• 1: Baird, J.C. (1970), Psychophysical Analysis of Visual Space, New York: Pergamon Press.
• 2: Beattie, V., Jones, M.J. (2002). The impact of graph slope on rate of change judgements in corporate reports. ABACUS 38 (2). p. 177--199.
• 3: Bertin, J. (1977). La Graphique et le traitement graphique de l'information. Flammarion, Paris, France.
• 4: Carpendale, M.S.T. (2003). Considering Visual Variables as a Basis for Information Visualisation. Computer Science TR #2001-693-16. Dept. Computer Science, University of Calgary.
• 5: Cleveland, W.S., McGill, R. (1984). Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods. Journal of the American Statistical Association, 79(387). p. 531--553.
• 6: Cleveland, W.S., McGill, R. (1985). Graphical perception and graphical methods for analyzing and presenting scientific data. Science, 229(4716). p. 828--833.
• 7: Corballis, M.C., McLaren, R. (1984). Minding one's Ps and Qs: Mental rotation and mirror-image discrimination. Journal of Experimental Psychology: Human Perception and Performance, 10. p. 318--327.
• 8: Corballis, M.C., Macadie, L., Beale, I.L. (1985). Mental rotation and visual laterality in normal and reading disabled children. Cortex, 21. p. 225--236.
• 9: Coutaz, J., Lachenal, C., Dupuy-Chessa, S. (2003). Ontology for Multi-surface Interaction. Interact'03. p. 447--454.
• 10: Ellermeier, W., Faulhammer, G. (2000). Empirical evaluation of axioms fundamental to Stevens's ratio-scaling approach: I. Loudness production. Perception & Psychophysics, 62. p. 1505--1511.
• 11: Katherine Everitt , Chia Shen , Kathy Ryall , Clifton Forlines, MultiSpace: Enabling Electronic Document Micro-mobility in Table-Centric, Multi-Device Environments, Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems, p.27-34, January 05-07, 2006 [doi>10.1109/TABLETOP.2006.23]
• 12: Fechner, G.T. (1860). Element der Psychophysik. Leipzig: Breitkopf & Harterl.
• 13: Clifton Forlines , Alan Esenther , Chia Shen , Daniel Wigdor , Kathy Ryall, Multi-user, multi-display interaction with a single-user, single-display geospatial application, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166296]
• 14: Clifton Forlines , Chia Shen , Daniel Wigdor , Ravin Balakrishnan, Exploring the effects of group size and display configuration on visual search, Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, November 04-08, 2006, Banff, Alberta, Canada [doi>10.1145/1180875.1180878]
• 15: Galanter, E. (2004), Extracting magnitude estimations of loudness from pairwise judgments. The Journal of the Acoustical Society of America, 115(5). p. 2534.
• 16: Gescheider, G.A. (1988). Psychophysical Scaling. Annual Review of Psychology, 39. p. 159--200.
• 17: Green, D.M., Luce, R.D. (1974). Variability of magnitude estimates: a timing theory analysis. Perception & Psychophysics, 15(2). p. 291--300.
• 18: Green, M. (1991) Visual search, visual streams, and visual architectures. Perception and Psychophysics, 50. p. 388--403.
• 19: Green, M. (1996). Toward a Perceptual Science of Multidimensional Data Visualization: Bertin and Beyond.http://web.archive.org/web/19991104170601/http://www.ergogero.com/dataviz/dviz0.html. (archive).
• 20: Brad Johanson , Greg Hutchins , Terry Winograd , Maureen Stone, PointRight: experience with flexible input redirection in interactive workspaces, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572019]
• 21: Koike, H., Nagashima, S., Nakanishi, Y., & Yoichi Sato. (2004). EnhancedTable: Supporting small meetings in ubiquitous and augmented environment. PCM2004. p. 97--104.
• 22: Russell Kruger , Sheelagh Carpendale , Stacey D. Scott , Saul Greenberg, Roles of Orientation in Tabletop Collaboration: Comprehension, Coordination and Communication, Computer Supported Cooperative Work, v.13 n.5-6, p.501-537, December 2004 [doi>10.1007/s10606-004-5062-8]
• 23: Meredith Ringel Morris , Andreas Paepcke , Terry Winograd , Jeannie Stamberger, TeamTag: exploring centralized versus replicated controls for co-located tabletop groupware, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124964]
• 24: Miguel A. Nacenta , Samer Sallam , Bernard Champoux , Sriram Subramanian , Carl Gutwin, Perspective cursor: perspective-based interaction for multi-display environments, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124817]
• 25: Louis Narens, A theory of ratio magnitude estimation, Journal of Mathematical Psychology, v.40 n.2, p.109-129, June 1996 [doi>10.1006/jmps.1996.0011]
• 26: Lucille Terry Nowell , Deborah Hix, Graphical encoding for information visualization: using icon color, shape, and size to convey nominal and quantitative data, Virginia Polytechnic Institute and State University, 1997
• 27: Pizlo Z. (1994). A theory of shape constancy based on perspective invariants. Vision Research 34. p. 1637--1658.
• 28: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 29: Schneider, B., Erlich, D.J., Stein, R., Flaum, M., Mangel, M. (1978). Changes in the apparent lengths of lines as a function of degree of retinal eccentricity. Perception, 7. p. 215--223.
• 30: Stacey D. Scott, Territoriality in collaborative tabletop workspaces, University of Calgary, Calgary, Alta., Canada, 2005
• 31: Stacey D. Scott , M. Sheelagh T. Carpendale , Stefan Habelski, Storage Bins: Mobile Storage for Collaborative Tabletop Displays, IEEE Computer Graphics and Applications, v.25 n.4, p.58-65, July 2005 [doi>10.1109/MCG.2005.86]
• 32: Chia Shen , Kathy Ryall , Clifton Forlines , Alan Esenther , Frederic D. Vernier , Katherine Everitt , Mike Wu , Daniel Wigdor , Meredith Ringel Morris , Mark Hancock , Edward Tse, Informing the Design of Direct-Touch Tabletops, IEEE Computer Graphics and Applications, v.26 n.5, p.36-46, September 2006 [doi>10.1109/MCG.2006.109]
• 33: Chia Shen , Frédéric D. Vernier , Clifton Forlines , Meredith Ringel, DiamondSpin: an extensible toolkit for around-the-table interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.167-174, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985714]
• 34: Shepard, R.N., Metzler, J. (1971). Mental rotation of three dimensional objects. Science, 171. p. 701--703.
• 35: Stevens, S.S. (1957). On the Psychophysical law. Psychology Review, 64. p. 153--181.
• 36: Norbert A. Streitz , Jörg Geißler , Torsten Holmer , Shin'ichi Konomi , Christian Müller-Tomfelde , Wolfgang Reischl , Petra Rexroth , Peter Seitz , Ralf Steinmetz, i-LAND: an interactive landscape for creativity and innovation, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.120-127, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303010]
• 37: Norbert Streitz , Thorsten Prante , Christian Müller-Tomfelde , Peter Tandler , Carsten Magerkurth, Roomware©: the second generation, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506452]
• 38: Edward R. Tufte, The visual display of quantitative information, Graphics Press, Cheshire, CT, 1986
• 39: Voyer, D., Brydon, M.P. (1990). Gender, level of spatial ability, and lateralization of mental rotation. Brain and Cognition, 13(1). p.18--29.
• 40: Daniel Wigdor , Ravin Balakrishnan, Empirical investigation into the effect of orientation on text readability in tabletop displays, Proceedings of the ninth conference on European Conference on Computer Supported Cooperative Work, p.205-224, September 18-22, 2005, Paris, France
• 41: Daniel Wigdor , Chia Shen , Clifton Forlines , Ravin Balakrishnan, Table-centric interactive spaces for real-time collaboration, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133286]
• 42: Zimmer, K. (2005). Examining the validity of numerical ratios in loudness fractionation. Perception & Psychophysics, 67. p. 569--57.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

General Terms:
Human Factors

Keywords:
multi-display, multi-surface, tabletop, visualization