Hybrid image-/model-based gaze-contingent rendering

ABSTRACT

A nonisotropic hybrid image-/model-based gaze-contingent rendering technique utilizing ray casting on a GPU is discussed. Empirical evidence derived from human subject experiments indicates an inverse relationship between a peripherally degraded scene's high-resolution inset size and mean search time, a trend consistent with existing image- and model- based techniques. In addition, the data suggest that maintaining a target's silhouette edges decreases search times when compared to targets with degraded edges. Benefits of the hybrid technique include simplicity of design and parallelizability, both conducive to GPU implementation.

REFERENCES

• 1: Bergström, P. 2003. Eye-movement Controlled Image Coding. PhD thesis, Linköping University, Linköping, Sweden.
• 2: Cave, K. R., and Bichot, Narcisse, P. 1999. Visuospatial Attention: Beyond a Spotlight Model. Psychonomic Bulletin & Review 6, 2, 204--223.
• 3: James H. Clark, Hierarchical geometric models for visible surface algorithms, Communications of the ACM, v.19 n.10, p.547-554, Oct. 1976 [doi>10.1145/360349.360354]
• 4: Daly, S., Matthews, K., and Ribas-Corbera, J. 2001. As Plain as the Noise on Your Face: Adaptive Video Compression Using Face Detection and Visual Eccentricity Models. Journal of Electronic Imaging 10, 1, 30--46.
• 5: Danforth, R., Duchowski, A., Geist, R., and McAliley, E. 2000. A Platform for Gaze-Contingent Virtual Environments. In Smart Graphics (Papers from the 2000 AAAI Spring Symposium, Technical Report SS-00-04), AAAI, 66--70.
• 6: Andrew T. Duchowski , Arzu Çöltekin, Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.3 n.4, p.1-18, December 2007 [doi>10.1145/1314303.1314309]
• 7: Andrew T. Duchowski, Eye Tracking Methodology: Theory and Practice, Springer-Verlag New York, Inc., Secaucus, NJ, 2007
• 8: Geisler, W. S., and Perry, J. S. 1998. Real-time foveated multiresolution system for low-bandwidth video communication. In Human Vision and Electronic Imaging, SPIE.
• 9: Geisler, W. S., Perry, J. S., and Najemnik, J. 2006. Visual Search: The Role of Peripheral Information Measured Using Gaze-Contingent Displays. Journal of Vision 6, 9, 858--873.
• 10: Hugues Hoppe, View-dependent refinement of progressive meshes, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.189-198, August 1997 [doi>10.1145/258734.258843]
• 11: Marc Levoy , Ross Whitaker, Gaze-directed volume rendering, ACM SIGGRAPH Computer Graphics, v.24 n.2, p.217-223, Mar. 1990
• 12: Peter Lindstrom , David Koller , William Ribarsky , Larry F. Hodges , Nick Faust , Gregory A. Turner, Real-time, continuous level of detail rendering of height fields, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.109-118, August 1996 [doi>10.1145/237170.237217]
• 13: David Luebke , Carl Erikson, View-dependent simplification of arbitrary polygonal environments, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.199-208, August 1997 [doi>10.1145/258734.258847]
• 14: David P. Luebke , Benjamin Hallen, Perceptually-Driven Simplification for Interactive Rendering, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.223-234, June 25-27, 2001
• 15: Luebke, D., Hallen, B., Newfield, D., and Watson, B. 2000. Perceptually Driven Simplification Using Gaze-Directed Rendering. Tech. Rep. CS-2000-04, University of Virginia.
• 16: Ron MacCracken , Kenneth I. Joy, Free-form deformations with lattices of arbitrary topology, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.181-188, August 1996 [doi>10.1145/237170.237247]
• 17: Murphy, H., and Duchowski, A. T. 2001. Gaze-Contingent Level Of Detail. In EuroGraphics, EuroGraphics.
• 18: Toshikazu Ohshima , Hiroyuki Yamamoto , Hideyuki Tamura, Gaze-directed Adaptive Rendering for Interacting with Virtual Space, Proceedings of the 1996 Virtual Reality Annual International Symposium (VRAIS 96), p.103, March 30-April 03, 1996
• 19: Parkhurst, D. J., and Niebur, E. 2002. Variable Resolution Displays: A Theoretical, Practical, and Behavioral Evaluation. Human Factors 44, 4, 611--629.
• 20: Derrick Parkhurst , Ernst Niebur, A feasibility test for perceptually adaptive level of detail rendering on desktop systems, Proceedings of the 1st Symposium on Applied perception in graphics and visualization, August 07-08, 2004, Los Angeles, California [doi>10.1145/1012551.1012561]
• 21: Timothy J. Purcell , Ian Buck , William R. Mark , Pat Hanrahan, Ray tracing on programmable graphics hardware, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 22: Reddy, M. 1998. Specification and Evaluation of Level of Detail Selection Criteria. Virtual Reality: Research, Development and Application 3, 2, 132--143.
• 23: Reingold, E. M., Loschky, L. C., McConkie, G. W., and Stampe, D. M. 2002. Gaze-Contingent Multi-Resolutional Displays: An Integrative Review. Human Factors 45, 2, 307--328.
• 24: Dieter Schmalstieg , Gernot Schaufler, Smooth Levels of Detail, Proceedings of the 1997 Virtual Reality Annual International Symposium (VRAIS '97), p.12, March 01-05, 1997
• 25: Tobii Technology AB, 2003. Tobii ET-17 Eye-tracker Product Description (v1.1). URL: <http://www.tobii.se/> (last accessed January 2007).
• 26: Benjamin Watson , Neff Walker , Larry F. Hodges , Aileen Worden, Managing level of detail through peripheral degradation: effects on search performance with a head-mounted display, ACM Transactions on Computer-Human Interaction (TOCHI), v.4 n.4, p.323-346, Dec. 1997 [doi>10.1145/267135.267137]
• 27: Benjamin Watson , Neff Walker , Larry F. Hodges, Supra-threshold control of peripheral LOD, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 28: Zorin, D., and Schröder, P. 2000. Course 23: Subdivision for Modeling and Animation. ACM SIGGRAPH, New York, NY. URL: <http://www.mrl.nyu.edu/dzorin/sig00course/> (last accessed 12/30/00).
• 29: Denis Zorin , Peter Schröder , Wim Sweldens, Interactive multiresolution mesh editing, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.259-268, August 1997 [doi>10.1145/258734.258863]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Ergonomics

Keywords:
gaze-contingent rendering, gpu, perceptual rendering