Mobile media search: has media search finally found its perfect platform? part II

ABSTRACT

Recently, many exciting media search applications have been introduced to take advantage of smart phones' audiovisual capture capabilities and their being always on and connected. These applications address a real pain point for most mobile users and allow them to search with minimal text entry, if any. Is the mobile platform an ideal fit for media search? Are audio and visual signal processing technologies sufficiently accurate to support most mobile search applications? What are the killer applications of mobile media search? Earlier in 2009 at ICASSP, a panel on this topic stirred up great interest and enthusiasm while leaving many questions untouched due to the limited time.

In this panel, we continue and expand the discussions on the challenges and potentials of mobile media search, with a different mix in the panel.

REFERENCES

• 1: Berna Erol, Emilio Antúnez, Jonathan J. Hull, "HOTPAPER: Multimedia Interaction with Paper using Mobile Phones", ACM Multimedia 2008.
• 2: Google Mobile App with Voice Search http://www.google.com/mobile/apple/app.html
• 3: Shazam Audio Search, http://www.shazam.com/
• 4: Kooaba Image Recognizer, http://www.kooaba.com/
• 5: Yahoo OneSearch with Voice, http://mobile.yahoo.com/onesearch/voice
• 6: Minoru Etoh, "Cellular Phones as Information Hubs," ACM SIGIR Workshop on Mobile Information Retrieval, 2008.
• 7: Xing Xie, Lie Lu, Menglei Jia, Hua Li, Frank Seide, Wei-Ying Ma, Mobile Search with Multimodal Queries, Proceedings of the IEEE, Vol. 96, No. 4, Apr. 2008.
• 8: Lie Lu, Frank Seide. "Mobile Ringtone Search through query by Humming," ICASSP 2008.
• 9: Jiebo Luo, Matthew Boutell, Christopher Brown, "Exploiting context for semantic scene content understanding," IEEE Signal Processing Magazine, pp. 101--114, 2006.
• 10: Jiebo Luo, Jie Yu, Dhiraj Joshi, Wei Hao, "Event Recognition with a Third Eye," ACM Multimedia 2008.
• 11: S. Ahern, M. Davis, et al., "Zonetag: Designing context-aware mobile media capture to increase participation", Workshop on Pervasive Image Capture and Sharing, 2006.
• 12: SnapTell, http://www.Snaptell.com
• 13: C. Alberti, M. Bacchiani, A. Bezman et al., "An Audio Indexing System for Election Video Material", ICASSP 2009.
• 14: S.-F. Chang, D. Zhong, and R. Kumar, "Real-Time Content--Based Adaptive Streaming of Sports Video," IEEE Workshop on Content-Based Access to Video/Image Library, 2001.
• 15: Peng Wu, Eamonn O'Brien-Strain, Jerry Liu, "Snapfish Lab: An Open Online Imaging Community", 2008 International Workshop on Multimedia Signal Processing, MMSP 2008.
• 16: V. Setlur, A. Battestini,. "Using Comics as a Visual Metaphor for Enriching SMS Messages with Contextual and Social Media," Workshop on Sharing Experiences with Social Mobile Media, MobileHCI 2009.
• 17: V. Setlur, T. Capin, S. hitturi, R. Vedantham, and M. Ingrassia, "MORE: Mobile Open Rich-media Environment," IEEE International Conference on Multimedia and Expo (ICME), 2006.
• 18: A. Haro, K. Mori, V. Setlur, and T. Capin, "Mobile Camera-based Adaptive Viewing," Mobile and Ubiquitous Multimedia (MUM) 2005.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Design, Experimentation, Human Factors, Performance, Standardization, Theory

Keywords:
image retrieval, interfaces, mobile media search, social networks, video retrieval, visualization