A gesture based game for image tagging

ABSTRACT

This paper proposes and discusses the ASAA (Application for Semi-Automatic Annotation) interface, a new computer game for image tagging. The application is composed by a 3D game interface, a game engine that uses a system for automatic image annotation and gestural input to play the game. The paper describes the rational and design principles for the application and presents ideas for future developments.

REFERENCES

• 1: David Frohlich , Allan Kuchinsky , Celine Pering , Abbe Don , Steven Ariss, Requirements for photoware, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587102]
• 2: Jesus, R., Dias, R., Frias, R., Abrantes, A., Correia, N., Sharing Personal Experiences while Navigating in Physical Spaces. In 5th Workshop on Multimedia Information Retrieval in 30th international ACM Information Retrieval Conf (SIGIR07), (2007).
• 3: Jia Li , James Z. Wang, Real-time computerized annotation of pictures, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180841]
• 4: Over, P., Ianeva, T., Kraaij, W., Smeaton, A., Trecvid 2006 overview. In NIST TRECVID-2006, (2006).
• 5: Tuulos, V., Scheible, J., Nyholm, H., Combining Web, Mobile Phones and Public Displays in Large- Scale: Manhattan Story Mashup. In Proceedings of the Fifth International Conference on Pervasive Computing, (2007).
• 6: Luis von Ahn , Laura Dabbish, Labeling images with a computer game, Proceedings of the SIGCHI conference on Human factors in computing systems, p.319-326, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985733]
• 7: Wenyin, L., Dumais, S., Sun, Y., Zhang, H., Czerwinski, M., Field, B., Semi-Automatic Image Annotation. In Human-Computer Interaction--Interact '01, (2001).

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Experimentation, Human Factors

Keywords:
games with a purpose, gesture based interface, human computation, image annotation