On uniform resampling and gaze analysis of bidirectional texture functions

ABSTRACT

The use of illumination and view-dependent texture information is recently the best way to capture the appearance of real-world materials accurately. One example is the Bidirectional Texture Function. The main disadvantage of these data is their massive size. In this article, we employ perceptually-based methods to allow more efficient handling of these data. In the first step, we analyse different uniform resampling by means of a psychophysical study with 11 subjects, comparing original data with rendering of a uniformly resampled version over the hemisphere of illumination and view-dependent textural measurements. We have found that down-sampling in view and illumination azimuthal angles is less apparent than in elevation angles and that illumination directions can be down-sampled more than view directions without loss of visual accuracy. In the second step, we analyzed subjects gaze fixation during the experiment. The gaze analysis confirmed results from the experiment and revealed that subjects were fixating at locations aligned with direction of main gradient in rendered stimuli. As this gradient was mostly aligned with illumination gradient, we conclude that subjects were observing materials mainly in direction of illumination gradient. Our results provide interesting insights in human perception of real materials and show promising consequences for development of more efficient compression and rendering algorithms using these kind of massive data.

REFERENCES

• 1: Carr, J., Beatson, R., Cherrie, J., Mitchell, T., Fright, W., McCallum, B., and Evans, T. 2001. Reconstruction and representation of 3D objects with radial basis functions. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH). ACM, New York, 67--76.
• 2: Cochran, W. G. 1950. The comparison of percentages in matched samples. Biometrika 37, 256--266.
• 3: Daly, S. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision, A. B. Watson Ed., MIT Press, 179--206.
• 4: Dana, K., van Ginneken, B., Nayar, S., and Koenderink, J. 1999. Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18, 1, 1--34.
• 5: Deng, Z., Lewis, J. P., and Neumann, U. 2005. Automated eye motion using texture synthesis. IEEE Comput. Graph. Appl. 25, 2, 24--30.
• 6: Duchowski, A., Cournia, N., and Murphy, H. 2004. Gaze-contingent displays: A review. CyberPsych. Behave. 7, 6, 621--634.
• 7: Duchowski, A. T. 2002. A breadth-first survey of eye-tracking applications. Behav. Res. Methods. Instrum. Comput. 34, 4, 455--470.
• 8: Elhelw, M. A., Nicolaou, M., Chung, J. A., Yang, G.-Z., and Atkins, M. S. 2008. A gaze-based study for investigating the perception of visual realism in simulated scenes. ACM Trans. Appl. Percept. 5, 1.
• 9: Filip, J. and Haindl, M. 2009. Bidirectional texture function modeling: A state of the art survey. IEEE Trans. Pattern Anal. Mach. Intell. To appear.
• 10: Filip, J., Chantler, M., Green, P., and Haindl, M. 2008. A psychophysically validated metric for bidirectional texture data reduction. ACM Trans. Graph. 27, 5, 138.
• 11: Fleming, R. W., Dror, R. O., and Adelson, E. H. 2003. Real-world illumination and perception of surface reflectance properties. J. Vision 3, 347--368.
• 12: Havran, V., Smyk, M., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. 2005. Interactive system for dynamic scene lighting using captured video environment maps. In Proceedings of the Eurographics Symposium on Rendering, 31--42, 311.
• 13: Kautz, J., Boulos, S., and Durand, F. 2007. Interactive editing and modelling of bidirectional texture functions. ACM Trans. Graph. 26, 3, 53.
• 14: Lawson, R., Bülthoff, H., and Dumbell, S. 2003. Interactions between view changes and shape changes in picture—picture matching. Perception 34, 12, 1465--1498.
• 15: Lee, S. P., Badler, J. B., and Badler, N. I. 2002. Eyes alive. ACM Trans. Graph. 21, 3, 637--644.
• 16: Matusik, W., Pfister, H.P. Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Trans. Graph. 22, 3, 759--769.
• 17: Meseth, J., Müller, G., Klein, R., Röder, F., and Arnold, M. 2006. Verification of rendering quality from measured BTFs. In Proceedings of the 3rd Symposium on Applied Perception in Graphics and Visualization. ACM, New York, 127--134.
• 18: Müller, G., Meseth, J., Sattler, M., Sarlette, R., and Klein, R. 2005. Acquisition, synthesis and rendering of bidirectional texture functions. Comput. Graph. Forum 24, 1, 83--110.
• 19: Nicodemus, F., J. C., R., Hsia, J., Ginsburg, I., and Limperis, T. 1977. Geometrical considerations and nomenclature for reflectance. NBS Monograph 160. National Bureau of Standards, U.S. Department of Commerce, Washington, D.C., 1--52.
• 20: Over, E., Hooge, I., Vlaskamp, B., and Erkelens, C. 2007. Coarse-to-fine eye movement strategy in visual search. Vision Res. 47, 17, 2272--2280.
• 21: Pellacini, F. and Lawrence, J. 2007. Appwand: Editing measured materials using appearance-driven optimization. ACM Trans. Graph. 26, 3, 54:1--54:10.
• 22: Pellacini, F., Ferwerda, J., and Greenberg, D. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proceedings of the 27th International Conference on Computer Graphics and Interactive Techniques. ACM, New York, 55--64.
• 23: Pomplun, M. 2006. Saccadic selectivity in complex visual search displays. Vision Resear. 46.
• 24: Ramanarayanan, G., Ferwerda, J., Walter, B., and Bala, K. 2007. Visual equivalence: Towards a new standard for image fidelity. ACM Trans. Graph. 26, 3, 76:1--76:10.
• 25: Sundstedt, V., Stavrakis, E., Wimmer, M., and Reinhard, E. 2008. A psychophysical study of fixation behavior in a computer game. In Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization (APGV'08). ACM, New York, 43--50.
• 26: Tatler, B. W. 2007. The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. J. Vision 7, 14, 1--17.
• 27: te Pas, S. and Pont, S. 2005. A comparison of material and illumination discrimination performance for real rough, real smooth and computer generated smooth spheres. In Proceedings of the 2nd Symposium on Applied Perception in Graphics and Visualization (APGV'05). ACM, New York, 57--58.
• 28: te Pas, S., and Pont, S. 2005. Estimations of light-source direction depend critically on material BRDFs. Perception 34, 212.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.7 Feature Measurement

  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

General Terms:
Experimentation, Human Factors

Keywords:
BTF, eye tracking, phychophysical experiment, texture compression, uniform resampling, visual degradation