Metadata creation system for mobile images

ABSTRACT

The amount of personal digital media is increasing, and managing it has become a pressing problem. Effective management of media content is not possible without content-related metadata. In this paper we describe a content metadata creation process for images taken with a mobile phone. The design goals were to automate the creation of image content metadata by leveraging automatically available contextual metadata on the mobile phone, to use similarity processing algorithms for reusing shared metadata and images on a remote server, and to interact with the mobile phone user during image capture to confirm and augment the system supplied metadata. We built a prototype system to evaluate the designed metadata creation process. The main findings were that the creation process could be implemented with current technology and it facilitated the creation of semantic metadata at the time of image capture.

REFERENCES

• 1: Aigrain, P., Zhang, H., and Petkovic, D. Content-based Representation and Retrieval of Visual Media: A State-of-the-Art Review. Multimedia Tools and Applications, vol. 3, 1996; pp. 178--202.
• 2: Adobe. Photoshop Album. http://www.adobe.com/
• 3: Benjamin B. Bederson, PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502359]
• 4: Chad Carson , Megan Thomas , Serge Belongie , Joseph M. Hellerstein , Jitendra Malik, Blobworld: A System for Region-Based Image Indexing and Retrieval, Proceedings of the Third International Conference on Visual Information and Information Systems, p.509-516, June 02-04, 1999
• 5: IEEE MultiMedia, The Holy Grail of Content-Based Media Analysis, IEEE MultiMedia, v.9 n.2, p.6-10, April 2002 [doi>10.1109/93.998041]
• 6: Guanling Chen , David Kotz, A Survey of Context-Aware Mobile Computing Research, Dartmouth College, Hanover, NH, 2000
• 7: Marc Davis, Editing out Video Editing, IEEE MultiMedia, v.10 n.2, p.54-64, March 2003 [doi>10.1109/MMUL.2003.1195161]
• 8: Marc Davis, Media Streams: an iconic visual language for video representation, Human-computer interaction: toward the year 2000, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1995
• 9: Chitra Dorai , Svetha Venkatesh, Computational Media Aesthetics: Finding Meaning Beautiful, IEEE MultiMedia, v.8 n.4, p.10-12, October 2001 [doi>10.1109/93.959093]
• 10: G. W. Furnas , T. K. Landauer , L. M. Gomez , S. T. Dumais, The vocabulary problem in human-system communication, Communications of the ACM, v.30 n.11, p.964-971, Nov. 1987 [doi>10.1145/32206.32212]
• 11: Girgensohn, A., Adcock, J., Cooper, M., Foote, J., and Wilcox, L. Simplifying the Management of Large Photo Collections. Human-Computer Interaction INTERACT'03, IOS Press, 2003; pp.196--203.
• 12: Allan Kuchinsky , Celine Pering , Michael L. Creech , Dennis Freeze , Bill Serra , Jacek Gwizdka, FotoFile: a consumer multimedia organization and retrieval system, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.496-503, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303143]
• 13: Naaman, M., Paepcke, A., and Garcia-Molina, H. From Where to What: Metadata Sharing for Digital Photographs with Geographic Coordinates. On The Move to Meaningful Internet Systems 2003: CoopIS, DOA and ODBASE. Springer-Verlag 2003. pp.196--217.
• 14: Nokia Image Upload Server API, version 1.1, available at http://www.forum.nokia.com/
• 15: Schilit, B., Adams, N., and Want, R. Context-aware computing applications. In Proceedings of IEEE Workshop on Mobile Computing Systems and Applications, Santa Cruz, California, December 1994. IEEE Computer Society Press; pp. 85--90.
• 16: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 17: Stentiford, F. W. M. An attention based similarity measure with application to content based information retrieval. In Storage and Retrieval for Media Databases 2003, M. M. Yeung, R. W. Lienhart, C-S Li, Editors, Proc. SPIE Vol. 5021, pp. 20--24.
• 18: Kentaro Toyama , Ron Logan , Asta Roseway, Geographic location tags on digital images, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957046]
• 19: Vartiainen, P. Using Metadata and Context Information in Sharing Personal Content of Mobile Users. Master's Thesis, Department of Computer Science, University of Helsinki, Finland, 2003.
• 20: Wenyin, L., Dumais, S.T., Sun, Y.F., Zhang, H.J., Czerwinski, M.P., Field, B. Semi-automatic image annotation. In Proceedings of Interact 2001, Eighth IFIP TC.13 Conference on Human Computer Interaction. July 2001.
• 21: XHTML Mobile Profile Specification, version 29-Oct-2001, available at http://www.wapforum.org/
• 22: Ka-Ping Yee , Kirsten Swearingen , Kevin Li , Marti Hearst, Faceted metadata for image search and browsing, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642681]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.m Miscellaneous
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications

General Terms:
Design, Human Factors

Keywords:
automated content metadata, content-based image retrieval, digital image management, mobile camera phones, wireless multimedia applications