Photo assessment based on computational visual attention model

ABSTRACT

It is difficult to be satisfied for automatic photo assessment using only low level visual features such as brightness, lighting, hue, contrast, color distribution and so on. Instead of using low level visual features, we present a novel computational visual attention model to assess photos. Firstly, a face-sensitive saliency map analysis is deployed to estimate attention distribution. Then, a Rate of Focused Attention (RFA) measurement is proposed to quantify photo quality. By integrating top-down supervision into the visual attention model, we further achieve personalized photo assessment to take user preference into quality evaluation, which can be extended into object or semantic oriented photo assessment scenarios. Experiments on personal photo albums with comparison to ground-truth user evaluations demonstrate the effeteness of the proposed method.

REFERENCES

• 1: Wang, Z., Sheikh, R., Bovik, C. No--reference perceptual quality assessment of JPEG compressed image. ICIP 2002.
• 2: Wang, X., Bovik, A., Sheikh, H., Simoncelli, E. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing. 2004.
• 3: Sheikh, H., Bovik, A., de Veciana, G. An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Transactions on Image Processing. 2005.
• 4: Tong, H., Li, M., Zhang, H., He, J., Zhang, C. Classification of Digital Photos Taken by Photographers or Home Users. Proceeding of Pacific-Rim Conference on Multimedia. 2004.
• 5: Datta, R., Joshi, D., Li, J., Wang, J. Studying Aesthetics in Photographic Image Using a Computational Approach. ECCV 2006.
• 6: Ke, Y., Tang, X., Jing, F. The Design of High-Level Features for Photo Quality Assessment. CVPR 2006.
• 7: Luo, Y., Tang, X. Photo and Video Quality Evaluation: Focusing on the Subject. ECCV 2008.
• 8: Freeman, M. The Complete Guide to Light and Lighting. Ilex Press 2007.
• 9: Freeman, M. The Photographer's eye: Composition and Design for Better Digital Photos. Ilex Press 2007.
• 10: Itti, L., Koch, C. and Niebur, E. A Model of Saliency-Based Visual Attention for Rapid Scene Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11): 1254--1259, 1998.
• 11: Viola, P. and Jones, M. Robust Real-Time Face Detection, International Journal of Computer Vision, 2004.
• 12: Walther, D. and Koch, C. Modeling attention to salient proto-objects. Neural Networks, 19: 1395--1407, 2006.
• 13: Guo, C. Ma, Q. and Zhang, L. Spatio-temporal Saliency Detection Using Phase Spectrum of Quaternion Fourier Transform. Proc. CVRP, 2008.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

General Terms:
Algorithms, Design, Experimentation

Keywords:
bottom-up and top-down attention, computational visual attention model, photo assessment, rate of focused attention