Automatic image retargeting with fisheye-view warping

ABSTRACT

Image retargeting is the problem of adapting images for display on devices different than originally intended. This paper presents a method for adapting large images, such as those taken with a digital camera, for a small display, such as a cellular telephone. The method uses a non-linear fisheye-view warp that emphasizes parts of an image while shrinking others. Like previous methods, fisheye-view warping uses image information, such as low-level salience and high-level object recognition to find important regions of the source image. However, unlike prior approaches, a non-linear image warping function emphasizes the important aspects of the image while retaining the surrounding context. The method has advantages in preserving information content, alerting the viewer to missing information and providing robustness.

REFERENCES

• 1: Benjamin B. Bederson, Fisheye menus, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.217-225, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354782]
• 2: Benjamin B. Bederson , Aaron Clamage , Mary P. Czerwinski , George G. Robertson, DateLens: A fisheye calendar interface for PDAs, ACM Transactions on Computer-Human Interaction (TOCHI), v.11 n.1, p.90-119, March 2004 [doi>10.1145/972648.972652]
• 3: M. S. T. Carpendale , Catherine Montagnese, A framework for unifying presentation space, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502358]
• 4: Li-Qun Chen, Xing Xie, Xin Fan, Wei-Ying Ma, Hong-Jiang Zhang, and He-Qin Zhou. A visual attention model for adapting images on small displays. ACM Multimedia Systems Journal, pages 353--364, 2003.
• 5: Xin Fan , Xing Xie , He-Qin Zhou , Wei-Ying Ma, Looking into video frames on small displays, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957063]
• 6: James D. Foley , Andries van Dam , Steven K. Feiner , John F. Hughes, Computer graphics: principles and practice (2nd ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990
• 7: L. Itti and C. Koch. Computational modeling of visual attention. Nature Reviews Neuroscience, 2(3):194--203, Mar 2001.
• 8: Laurent Itti , Christof Koch , Ernst Niebur, A Model of Saliency-Based Visual Attention for Rapid Scene Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.11, p.1254-1259, November 1998 [doi>10.1109/34.730558]
• 9: Alan Keahey, The Generalized Detail-In-Context Problem, Proceedings of the 1998 IEEE Symposium on Information Visualization, p.44-51, October 19-20, 1998, North Carolina
• 10: T. A. Keahey , E. L. Robertson, Techniques for non-linear magnification transformations, Proceedings of the 1996 IEEE Symposium on Information Visualization (INFOVIS '96), p.38, October 28-29, 1996
• 11: Y. K. Leung , M. D. Apperley, A review and taxonomy of distortion-oriented presentation techniques, ACM Transactions on Computer-Human Interaction (TOCHI), v.1 n.2, p.126-160, June 1994 [doi>10.1145/180171.180173]
• 12: Ying Li, Yu-Fei Ma, and Hong-Jiang Zhang. Salient region detection and tracking in video. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME), 2003.
• 13: Hao Liu , Xing Xie , Wei-Ying Ma , Hong-Jiang Zhang, Automatic browsing of large pictures on mobile devices, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957045]
• 14: Hao Liu , Xing Xie , Xiaoou Tang , Zhi-Wei Li , Wei-Ying Ma, Effective browsing of web image search results, Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, October 15-16, 2004, New York, NY, USA [doi>10.1145/1026711.1026726]
• 15: Yu-Fei Ma , Hong-Jiang Zhang, Contrast-based image attention analysis by using fuzzy growing, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957094]
• 16: Vidya Setlur, Saeko Takagi, Ramesh Raskar, Michael Gleicher, and Bruce Gooch. Automatic image retargeting. In Technical Sketch, Siggraph 2004, 2004.
• 17: Peter Shirley, Fundamentals of Computer Graphics, A. K. Peters, Ltd., Natick, MA, 2002
• 18: R. Spence and M. Apperley. Data base navigation: an office environment for the professional. Behaviour & Information Technology, 1(1):43--54, 1982.
• 19: Bongwon Suh , Haibin Ling , Benjamin B. Bederson , David W. Jacobs, Automatic thumbnail cropping and its effectiveness, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.95-104, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964707]
• 20: P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Proc. Conf. on Computer Vision and Pattern Recognition, pages 511--518, 2001.
• 21: Jun Wang, Marcel Reinders, Reginald Lagendijk, Jasper Lindenberg, and Mohan Kankanhalli. Video content presentation on tiny devices. In IEEE International Conference on Multimedia and Expo (ICME 2004), 2004. Short Paper.
• 22: George Wolberg, Digital Image Warping, IEEE Computer Society Press, Los Alamitos, CA, 1994
• 23: Xing Xie and Yu-Fei Ma. Personal communication, November 2004.
• 24: Christopher C. Yang , Hsinchun Chen , K. K. Hong, Visualization tools for self-organizing maps, Proceedings of the fourth ACM conference on Digital libraries, p.258-259, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313444]
• 25: A. Zanella , M. S. T. Carpendale , M. Rounding, On the effects of viewing cues in comprehending distortions, Proceedings of the second Nordic conference on Human-computer interaction, October 19-23, 2002, Aarhus, Denmark [doi>10.1145/572020.572035]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Algorithms, Human Factors

Keywords:
fisheye-view warping, focus plus context, image retargeting, image warping, salience map