Contextual in-image advertising

ABSTRACT

The community-contributed media contents over the Internet have become one of the primary sources for online advertising. However, conventional ad-networks such as Google AdSense treat image and video advertising as general text advertising without considering the inherent characteristics of visual contents. In this work, we propose an innovative contextual advertising system driven by images, which automatically associates relevant ads with an image rather than the entire text in a Web page and seamlessly inserts the ads in the nonintrusive areas within each individual image. The proposed system, called ImageSense, represents the first attempt towards contextual in-image advertising. The relevant ads are selected based on not only textual relevance but also visual similarity so that the ads yield contextual relevance to both the text in the Web page and the image content. The ad insertion positions are detected based on image saliency to minimize intrusiveness to the user. We evaluate ImageSense on three photo-sharing sites with around one million images and 100 Web pages collected from several major sites, and demonstrate the effectiveness of ImageSense.

REFERENCES

• 1: AdSense. http://www.google.com/adsense/.
• 2: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 3: Stephen Boyd , Lieven Vandenberghe, Convex Optimization, Cambridge University Press, New York, NY, 2004
• 4: BritePic. http://www.britepic.com/.
• 5: Andrei Broder , Marcus Fontoura , Vanja Josifovski , Lance Riedel, A semantic approach to contextual advertising, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277837]
• 6: D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma. VIPS: a vision-based page segmentation algorithm. In Microsoft Technical Report (MSR-TR-2003-79), 2003.
• 7: CNN. http://www.cnn.com/.
• 8: Flickr. http://www.flickr.com/.
• 9: R. J. Gerrig and P. G. Zimbardo. Psychology and Life (16 Edition). Allyn & Bacon, 2001.
• 10: Xiaofei He , Deng Cai , Ji-Rong Wen , Wei-Ying Ma , Hong-Jiang Zhang, Clustering and searching WWW images using link and page layout analysis, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.3 n.2, p.10-es, May 2007 [doi>10.1145/1230812.1230816]
• 11: Jian Hu , Hua-Jun Zeng , Hua Li , Cheng Niu , Zheng Chen, Demographic prediction based on user's browsing behavior, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242594]
• 12: Amruta Joshi , Rajeev Motwani, Keyword Generation for Search Engine Advertising, Proceedings of the Sixth IEEE International Conference on Data Mining - Workshops, p.490-496, December 18-22, 2006 [doi>10.1109/ICDMW.2006.104]
• 13: Lyndon Kennedy , Mor Naaman , Shane Ahern , Rahul Nair , Tye Rattenbury, How flickr helps us make sense of the world: context and content in community-contributed media collections, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291384]
• 14: Anísio Lacerda , Marco Cristo , Marcos André Gonçalves , Weiguo Fan , Nivio Ziviani , Berthier Ribeiro-Neto, Learning to advertise, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148265]
• 15: H. Li, S. M. Edwards, and J.-H. Lee. Measuring the intrusiveness of advertisements: scale development and validation. Journal of Advertising, 31(2):37--47, 2002.
• 16: Hua Li , Duo Zhang , Jian Hu , Hua-Jun Zeng , Zheng Chen, Finding keyword from online broadcasting content for targeted advertising, Proceedings of the 1st international workshop on Data mining and audience intelligence for advertising, p.55-62, August 12-12, 2007, San Jose, California [doi>10.1145/1348599.1348608]
• 17: Live Image Search. http://www.live.com/~&scope=images.
• 18: Yu-Fei Ma , Hong-Jiang Zhang, Contrast-based image attention analysis by using fuzzy growing, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957094]
• 19: Scott McCoy , Andrea Everard , Peter Polak , Dennis F. Galletta, The effects of online advertising, Communications of the ACM, v.50 n.3, p.84-88, March 2007 [doi>10.1145/1226736.1226740]
• 20: Aranyak Mehta , Amin Saberi , Umesh Vazirani , Vijay Vazirani, AdWords and generalized online matching, Journal of the ACM (JACM), v.54 n.5, p.22-es, October 2007 [doi>10.1145/1284320.1284321]
• 21: T. Mei, X.-S. Hua, W. Lai, L. Yang, and et al. MSRA-USTC-SJTU at TRECVID 2007: High-level feature extraction and search. In TREC Video Retrieval Evaluation Online Proceedings, 2007.
• 22: Tao Mei , Xian-Sheng Hua , Linjun Yang , Shipeng Li, VideoSense: towards effective online video advertising, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291467]
• 23: Vanessa Murdock , Massimiliano Ciaramita , Vassilis Plachouras, A noisy-channel approach to contextual advertising, Proceedings of the 1st international workshop on Data mining and audience intelligence for advertising, p.21-27, August 12-12, 2007, San Jose, California [doi>10.1145/1348599.1348603]
• 24: MySpace. http://www.myspace.com/.
• 25: photoSIG. http://www.photosig.com/.
• 26: Berthier Ribeiro-Neto , Marco Cristo , Paulo B. Golgher , Edleno Silva de Moura, Impedance coupling in content-targeted advertising, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076119]
• 27: Matthew Richardson , Ewa Dominowska , Robert Ragno, Predicting clicks: estimating the click-through rate for new ads, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242643]
• 28: S. E. Robertson, S. Walker, and M. Hancock-Beaulieu. Okapi at TREC-7. In the Seventh Text REtrieval Conference, Gaithersburg, USA, Nov. 1998.
• 29: Dou Shen , Jian-Tao Sun , Qiang Yang , Zheng Chen, Building bridges for web query classification, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148196]
• 30: Srinivasan H. Sengamedu , Neela Sawant , Smita Wadhwa, vADeo: video advertising system, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291338]
• 31: TRECVID. http://www-nlpir.nist.gov/projects/trecvid/.
• 32: Yahoo! Image. http://images.search.yahoo.com/images.
• 33: Bo Yang , Tao Mei , Xian-Sheng Hua , Linjun Yang , Shi-Qiang Yang , Mingjing Li, Online video recommendation based on multimodal fusion and relevance feedback, Proceedings of the 6th ACM international conference on Image and video retrieval, p.73-80, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282290]
• 34: Yiming Yang , Xin Liu, A re-examination of text categorization methods, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.42-49, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312647]
• 35: Wen-tau Yih , Joshua Goodman , Vitor R. Carvalho, Finding advertising keywords on web pages, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135813]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Selection process

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services
          Subjects: Web-based services

General Terms:
Algorithms, Experimentation, Human Factors

Keywords:
image advertising, image saliency, web page segmentation