An experimental approach to predicting saliency for simplified polygonal models

ABSTRACT

In this paper, we consider the problem of determining feature saliency for 3D objects and describe a series of experiments that examined if salient features exist and can be predicted in advance. We attempt to determine salient features by using an eye-tracking device to capture human gaze data and then investigate if the visual fidelity of simplified polygonal models can be improved by emphasizing the detail of salient features identified in this way. To try to evaluate the visual fidelity of models simplified using both metrics, a set of naming time, matching time and forced-choice preference experiments were carried out. We found that our perceptually weighted metric led to a significant increase in visual fidelity for the lower levels of detail (LOD) of the natural objects, but that for the man-made artifacts the opposite was true. We therefore conclude that visually prominent features may be predicted in this way for natural objects, but our results show that saliency prediction for synthetic objects is more difficult, perhaps because it is more strongly affected by task. We hope that our results will lead to new insights into the nature of saliency in 3D graphics.

REFERENCES

• 1: K. Cater , A. Chalmers , G. Ward, Detail to attention: exploiting visual tasks for selective rendering, Proceedings of the 14th Eurographics workshop on Rendering, June 25-27, 2003, Leuven, Belgium
• 2: P. Cignoni , C. Montani , C. Rocchini , R. Scopigno, Zeta: a resolution modeling system, Graphical Models and Image Processing, v.60 n.5, p.305-329, Sept. 1998 [doi>10.1006/gmip.1998.0477]
• 3: DAVIS, M. H., MOSS, H. E., DE MORNAY, P., AND TYLER, L. K. 2003. Spot the difference: Investigations of conceptual structure for living things an artificacts using speeded word-picture matching. In Department of Experimental Psychology, University of Cambridge.
• 4: DUCHOWSKI, A. T. 2002. A breadth-first survey of eye tracking applications. In Behavior Research Methods, Instruments, and Computers, 455--470.
• 5: FITTS, P. M., JONES, R., AND MILTON, J. L. 1950. Eye movements of aircraft pilots during instrument-landing approaches. In Aeronautical Engineering Review, vol. 9(2), 24--29.
• 6: Michael Garland , Paul S. Heckbert, Surface simplification using quadric error metrics, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.209-216, August 1997 [doi>10.1145/258734.258849]
• 7: GEREN, M. A., STROMER, R., AND MACKAY, H. A. 1997. Picture naming, matching to sample, and head injury: a stimulus control analysis. In Journal of applied behaviour analysis, vol. 30, 339--342.
• 8: HAYHOE, M. 2000. Vision using routines: A functional account of vision. In In Visual Cognition 2000, vol. 7(1/2/3), 43--64.
• 9: HENDERSON, J. M., AND HOLLINGWORTH, A. 1998. Eye movements during scene viewing: An overview. In G. Underwood (Ed.), Eye Guidance in Reading and Scene Perception, 269--294.
• 10: HENDERSON, J. M. 1992. Object identification in context: The visual processing of natural scenes. In Canadian Journal of Psychology, vol. 46(3), 319--341.
• 11: Laurent Itti , Christof Koch , Ernst Niebur, A Model of Saliency-Based Visual Attention for Rapid Scene Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.11, p.1254-1259, November 1998 [doi>10.1109/34.730558]
• 12: JACOB, R. J. K. 1993. Eye-movement-based human-computer interaction techniques: Toward non-command interfaces. In Advances in Human-Computer Interaction, vol. 42, 151--190.
• 13: Youngihn Kho , Michael Garland, User-guided simplification, Proceedings of the 2003 symposium on Interactive 3D graphics, April 27-30, 2003, Monterey, California [doi>10.1145/641480.641504]
• 14: LAWSON, R., BÜLTHOFF, H., AND DUMBELL, S. 2002. Interactions between view changes and shape changes in picture-picture matching. In Technical Report No. 095.
• 15: Gong Li , Benjamin Watson, Semiautomatic simplification, Proceedings of the 2001 symposium on Interactive 3D graphics, p.43-48, March 2001 [doi>10.1145/364338.364344]
• 16: David P. Luebke , Benjamin Hallen, Perceptually-Driven Simplification for Interactive Rendering, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.223-234, June 25-27, 2001
• 17: Erik Pojar , Dieter Schmalstieg, User-controlled creation of multiresolution meshes, Proceedings of the 2003 symposium on Interactive 3D graphics, April 27-30, 2003, Monterey, California [doi>10.1145/641480.641505]
• 18: REDDY, M. 1998. Specification and evaluation of level of detail selection criteria. In Virtual Reality: Research, Development and Application, vol. 3(2), 132--143.
• 19: ROSCH, E. 1976. Natural categories. In Cognitive Psychology, vol. 4, 328--350.
• 20: RUSHMEIER, H. 2001. Metrics and geometric simplification. In Siggraph Course Notes.
• 21: Benjamin Watson , Neff Walker , Larry F. Hodges , Aileen Worden, Managing level of detail through peripheral degradation: effects on search performance with a head-mounted display, ACM Transactions on Computer-Human Interaction (TOCHI), v.4 n.4, p.323-346, Dec. 1997 [doi>10.1145/267135.267137]
• 22: Benjamin Watson , Alinda Friedman , Aaron McGaffey, Using naming time to evaluate quality predictors for model simplification, Proceedings of the SIGCHI conference on Human factors in computing systems, p.113-120, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332414]
• 23: Benjamin Watson , Alinda Friedman , Aaron McGaffey, Measuring and predicting visual fidelity, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.213-220, August 2001 [doi>10.1145/383259.383283]
• 24: WATSON, B. 2003. Frontiers in perceptually-based image synthesis: Modeling, rendering, display, validation. In Siggraph Course, San Diego.
• 25: Hector Yee , Sumanita Pattanaik , Donald P. Greenberg, Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments, ACM Transactions on Graphics (TOG), v.20 n.1, p.39-65, Jan. 2001 [doi>10.1145/383745.383748]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Keywords:
model simplification, salient features, visual perception