Tag around: a 3D gesture game for image annotation

ABSTRACT

Manual annotation is difficult to perform in large image databases and the automatic methods deliver results that are far from what is desired by the users. New and fun ways to provide image annotation are required. This paper describes Tag Around, a computer game for image tagging. The application is based on a 3D game interface, a game engine that uses a system for automatic image classification and gestural input to play the game. We present the game, how it is used to improve image annotation, the design principles of the interface and the usability tests that were carried out in order to validate the application.

REFERENCES

• 1: Ritendra Datta , Dhiraj Joshi , Jia Li , James Z. Wang, Image retrieval: Ideas, influences, and trends of the new age, ACM Computing Surveys (CSUR), v.40 n.2, p.1-60, April 2008 [doi>10.1145/1348246.1348248]
• 2: Duarte Gonçalves , Rui Jesus , Nuno Correia, A gesture based game for image tagging, CHI '08 extended abstracts on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1358628.1358745]
• 3: Guodong Guo , Stan Z. Li , Kapluk Chan, Face Recognition by Support Vector Machines, Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, p.196, March 26-30, 2000
• 4: Jesus, R., Gonçalves, D., Abrantes, A., Correia, N. Playing Games as a Way to Improve Automatic Image Annotation. In Proceedings of the IEEE International Workshop on Semantic Learning Applications in Multimedia (SLAM08), in CVPR08 (2008).
• 5: Tuulos, V., Scheible, J. and Nyholm, H., Combining Web, Mobile Phones and Public Displays in Large-Scale: Manhattan Story Mashup. In Proceedings of Pervasive Computing 07, (2007).
• 6: Luis von Ahn , Laura Dabbish, Labeling images with a computer game, Proceedings of the SIGCHI conference on Human factors in computing systems, p.319-326, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985733]
• 7: Wenyin, L., Dumais, S., Sun, Y., Zhang, H., Czerwinski, M., Field, B. Semi-Automatic Image Annotation. In Proceedings of the Human-Computer Interaction-Interact '01 (2001).

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.8 PERSONAL COMPUTING
      K.8.0 General
          Subjects: Games

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

General Terms:
Design, Experimentation, Human Factors

Keywords:
computer games, gesture based interface, image annotation