Image retargeting using multi-map constrained region warping

ABSTRACT

Image retargeting aims to adapt images to various screens with small sizes and arbitrary aspect ratios. In this paper, we propose a novel image retargeting approach based on region warping, which emphasizes the image parts with important content while reducing the visual distortion over the whole image. First, the original image is decomposed into homogeneous regions and further represented by curve-edge trapezoid meshes. Then, two kinds of energy maps, importance map and sensitivity map, are calculated by visual attention model and weighted gradient map respectively. With mesh representation and energy map constraints, image retargeting is formulated to a constrained optimization problem of mesh vertexes relocation. Finally, the target image is generated by separately warping the regions based on the deduced optimal solution. The experiments on different images demonstrate the effective and efficiency of our algorithm.

REFERENCES

• 1: H. Liu, S. Jiang, Q. Huang, C. Xu, and W. Gao. Region-based visual attention analysis with its application in image browsing on small displays. ACM MM, Germany, 2007.
• 2: T. Ren, Y. Liu, and G. Wu. Image retargeting based on global energy optimization. ICME, USA, 2009.
• 3: V. Setlur, S. Takagi, R. Raskar, M. Gleicher, and B. Gooch. Automatic image retargeting. Int'l Conf. Mobile and Ubiquitous Multimedia, New Zealand, 2005.
• 4: L. Wolf, M. Guttmann, and D. Cohen-Or. Non--homogeneous content-driven video-retargeting. ICCV, Brazil, 2007.
• 5: L.-Q. Chen, X. Xie, X. Fan, W.-Y. Ma, H.-J. Zhang, and H.-Q. Zhou. A visual attention model for adapting images on small displays. Multimedia Systems, 9(4):353--364, 2003.
• 6: M. Rubinstein, A. Shamir, and S. Avidan. Improved seam carving for video retargeting. SIGGRAPH, USA, 2008.
• 7: F. Liu and M. Gleicher. Automatic image retargeting with fisheye-view warping. Symp. UIST, USA, 2005.
• 8: Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee. Optimized scale-and-stretch for image resizing. TOG, 27(5), 2008.
• 9: Y. Guo, F. Liu, J. Shi, Z.-H. Zhou, and M. Gleicher. Image retargeting using mesh parametrization. TMM, 2009.
• 10: D. Comaniciu, and P. Meer. Mean shift: a robust approach toward feature space analysis. TPAMI, 24(5):603--619, 2002.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Perceptual reasoning

General Terms:
Algorithms, Human Factors

Keywords:
image retargeting, mesh representation, multiple energy maps, region warping