Construction of extended geographical database based on photo shooting history

ABSTRACT

This study proposes an extended geographical database based on photo shooting history to enable the suggestion of candidate captions to newly shot photos. The extended geographical database consists of not only subject positions but also the likely shooting positions and directions estimated using the histories of the shooting positions and directions of the subjects. A user can add a caption to a photo by selecting an appropriate one from the candidate captions. The candidate captions are acquired using the shooting position and direction as a key to the extended geographical database. In this paper, we present the results of experiments for constructing the extended geographical database using a prototype system.

REFERENCES

• 1: Google Web API. http://api.google.com/.
• 2: Panoramio. http://www.panoramio.com/.
• 3: ZoneTag Photos. http://zonetag.research.yahoo.com/.
• 4: S. Ahern, M. Davis, D. Eckles, S. King, M. Naaman, R. Nair, M. Spasojevic, and J. H.-I. Yang. Zonetag: Designing context-aware mobile media capture to increase participation. In Proc. Pervasive Image Capture and Sharing: New Social Practices and Implications for Technology Workshop, 2006.
• 5: H. Fujita and M. Arikawa. A photo vector field model for photo mapping considering users? lines of sight. In Proc. Int. Joint Workshop on Ubiquitous, Pervasive and Internet Mapping, pages 143--152, 2004.
• 6: S. Ikehara, M. Miyazaki, S. Shirai, A. Yokoo, H. Nakaiwa, K. Ogura, Y. Ooyama, and Y. Hayashi. Goi-Taikei -- A Japanese Lexicon CDROM. Iwanami Shoten, Tokyo, 1999.
• 7: K. Iwasaki, K. Yamazawa, and N. Yokoya. An indexing system for photos based on shooting position and orientation with geographic database. In Proc. IEEE Int. Conf. on Multimedia and Expo, 1259, 2005.
• 8: Japan Electronics and Information Technology Industries Association(JEITA). Exchangeable image file format for digital still cameras: Exif version 2.2, 2002.
• 9: Allan Kuchinsky , Celine Pering , Michael L. Creech , Dennis Freeze , Bill Serra , Jacek Gwizdka, FotoFile: a consumer multimedia organization and retrieval system, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.496-503, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303143]
• 10: Henry Lieberman , Elizabeth Rozenweig , Push Singh, Aria: An Agent for Annotating and Retrieving Images, Computer, v.34 n.7, p.57-62, July 2001 [doi>10.1109/2.933504]
• 11: M. Naaman, A. Paepcke, and H. Garcia-Molina. From where to what: Metadata sharing for digital photographs with geographic coordinates. In Proc. 10th Int. Conf. on Cooperative Information Systems, pages 196--217, 2003.
• 12: Mor Naaman , Yee Jiun Song , Andreas Paepcke , Hector Garcia-Molina, Automatic organization for digital photographs with geographic coordinates, Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2004, Tuscon, AZ, USA [doi>10.1145/996350.996366]
• 13: Mor Naaman , Ron B. Yeh , Hector Garcia-Molina , Andreas Paepcke, Leveraging context to resolve identity in photo albums, Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2005, Denver, CO, USA [doi>10.1145/1065385.1065430]
• 14: A. Pigeau , M. Gelgon, Building and tracking hierarchical geographical & temporal partitions for image collection management on mobile devices, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101170]
• 15: Risto Sarvas , Mikko Viikari , Juha Pesonen , Hanno Nevanlinna, MobShare: controlled and immediate sharing of mobile images, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027690]
• 16: Satoshi Sato , Yasuhiro Sasaki, Automatic collection of related terms from the web, Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, p.121-124, July 07-12, 2003, Sapporo, Japan [doi>10.3115/1075178.1075196]
• 17: Direct Annotation: A Drag-and-Drop Strategy for Labeling Photos, Proceedings of the International Conference on Information Visualisation, p.88, July 19-21, 2000
• 18: Brian K. Smith , Erik Blankinship , Alfred Ashford, III , Michael Baker , Timothy Hirzel, Image Maps: Exploring Urban History through Digital Photography, Digital Cities, Technologies, Experiences, and Future Perspectives [the book is based on an international symposium held in Kyoto, Japan, in September 1999, p.326-337, September 01, 1999
• 19: Diomidis D. Spinellis, Position-Annotated Photographs: A Geotemporal Web, IEEE Pervasive Computing, v.2 n.2, p.72-79, April 2003 [doi>10.1109/MPRV.2003.1203756]
• 20: Amanda Stent , Alexander Loui, Using event segmentation to improve indexing of consumer photographs, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.59-65, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383960]
• 21: Tele Tan , Jiayi Chen , Philippe Mulhem , Mohan Kankanhalli, SmartAlbum: a multi-modal photo annotation system, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641025]
• 22: Kentaro Toyama , Ron Logan , Asta Roseway, Geographic location tags on digital images, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957046]
• 23: L. Wenyin, S. Dumais, Y. Sun, H. Zhang, M. Czerwinski, and B. Field. Semi-automatic image annotation. In Proc. Human-Computer Interaction - Interact'01, pages 326--333, 2001.
• 24: Yi Wu , Edward Y. Chang , Belle L. Tseng, Multimodal metadata fusion using causal strength, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101338]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

General Terms:
Design

Keywords:
extended geographical database, indexing, photo captioning, shooting position and direction