Evaluation of supra-threshold perceptual metrics for 3D models

ABSTRACT

Measures of dissimilarity of 3D models are necessary in a wide range of applications such as geometry compression, simplification, and 3D model retrieval. In many cases a metric that models perceptual dissimilarity is desirable. Recently, metrics for 3D models have been evaluated in that respect using concepts such as just noticeable differences, rankings, and others. We propose a simple experimental setup for evaluating supra-threshold perception of 3D models in which users select models at equal perceptual distance to given pairs of models. We discuss the advantages of our approach and report the results of a field study comparing six objective distance measures applied to palettes of simplified reference models. We found that the objective measures are biased, and generally image-based metrics perform better than metrics based on the original 3D geometry.

REFERENCES

• 1: Mark R. Bolin , Gary W. Meyer, A perceptually based adaptive sampling algorithm, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.299-309, July 1998 [doi>10.1145/280814.280924]
• 2: Chandler, D. M., and Hemami, S. S. 2003. Suprathreshold image compression based on contrast allocation and global precedence. In Proceedings of SPIE Human Vision and Electronic Imaging VIII, B. E. Rogowitz and T. N. Pappas, Eds., vol. 5007, SPIE, 73--86.
• 3: Cheng, I., and Boulanger, P. 2005. A 3d perceptual metric using just-noticeable-difference. In Eurographics Short Presentations, 97--100.
• 4: Cheng, I., Basu, A., and Wang, T. 2005. Balanced incomplete designs for 3d perceptual quality estimation. In International Conference on Image Processing, vol. 1, IEEE, 617--620.
• 5: Cignoni, P., Rocchini, C., and Scopigno, R. 1998. Metro: Measuring error on simplified surfaces. Computer Graphics Forum 17, 2, 167--174.
• 6: Falmagne, J.-C. 1985. Elements of Psychophysical Theory. Claredon Press.
• 7: Michael Garland , Paul S. Heckbert, Surface simplification using quadric error metrics, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.209-216, August 1997 [doi>10.1145/258734.258849]
• 8: Krantz, D. H., Luce, R. D., Suppes, P., and Tversky, A. 1971. Foundations of Measurement, vol. 1. Academic Press.
• 9: Lindman, H. R. 1991. Analysis of Variance in Experimental Design. Springer-Verlag.
• 10: Peter Lindstrom , Greg Turk, Image-driven simplification, ACM Transactions on Graphics (TOG), v.19 n.3, p.204-241, July 2000 [doi>10.1145/353981.353995]
• 11: Peter Lindstrom , Greg Turk, Model simplification using image and geometry-based metrics, 2000
• 12: David P. Luebke , Benjamin Hallen, Perceptually-Driven Simplification for Interactive Rendering, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.223-234, June 25-27, 2001
• 13: David Luebke , Benjamin Watson , Jonathan D. Cohen , Martin Reddy , Amitabh Varshney, Level of Detail for 3D Graphics, Elsevier Science Inc., New York, NY, 2002
• 14: Maloney, L. T., and Yang, J. N. 2003. Maximum likelihood difference scaling. Journal of Vision 3, 8, 573--585.
• 15: Reddy, M. 1997. Perceptually Modulated Level of Detail for Virtual Environments. PhD thesis, University of Edinburgh.
• 16: Martin Reddy, Perceptually Optimized 3D Graphics, IEEE Computer Graphics and Applications, v.21 n.5, p.68-75, September 2001
• 17: Rogowitz, B. E., and Rushmeier, H. E. 2001. Are image quality metrics adequate to evaluate the quality of geometric objects? In Proceedings of SPIE Human Vision and Electronic Imaging VI, SPIE, B. E. Rogowitz and T. N. Pappas, Eds., vol. 4299, 340--348.
• 18: Rushmeier, H., Rogowitz, B., and Piatko, C. 2000. Perceptual issues in substituting texture for geometry. In Proceedings of SPIE Human Vision and Electronic V, vol. 3959, SPIE, 372--383.
• 19: Suppes, P., Krantz, D. H., Luce, R. D., and Tversky, A. 1989. Foundations of Measurement, vol. 2. Academic Press.
• 20: Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4, 600--612.
• 21: Benjamin Watson , Alinda Friedman , Aaron McGaffey, Measuring and predicting visual fidelity, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.213-220, August 2001 [doi>10.1145/383259.383283]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Keywords:
image-based metric, level-of-detail, perceptual metric, supra-threshold perception