An image-centred "search and indexation system" based in user's data and perceived emotion

ABSTRACT

In recent years, we can find a lot of studies about the better way to categorize the image in digital media for its later use more personalized and efficient.

The large and growing number of image banks, Web pages, and search engines where we can find billions of images, is the principal reason to study the subjective relationship between the user and the image to increase the usability of interfaces where we can look, index or find images.

The main objective of this work is to make a new customized interface to categorize and search images in function of statistic and subjective user data. With this system we increase the "usability" and the successful results in the task of searching and indexing photographic images in function of the user, because like we will see, there is a subjective component in the task of searching images: the origin, age, sex, or simply the user experience with the media.

A secondary objective is to find the optimum relationship that has to exist among the technical characteristics of the image (like colour, compression, or resolution), the distance from the screen of the visualization and the size of it, to achieve that all the emotional information of the image it remains reflected in the user.

REFERENCES

• 1: Alison Gilchrest, H. L. (2001). An analytical study of Browsing Strategies in a Content-Based Image Retrieval System.
• 2: Berlin, B., Kay, P. (1969). Basic Colour Terms: Their Universality and Evolution. Berkeley University.
• 3: Kirsten Boehner , Rogério DePaula , Paul Dourish , Phoebe Sengers, How emotion is made and measured, International Journal of Human-Computer Studies, v.65 n.4, p.275-291, April, 2007 [doi>10.1016/j.ijhcs.2006.11.016]
• 4: Bruno Verschuere, Geert Crombez, Ernst Koster. (2007). Cross Cultural Validation of the IAPS. Ghent, Belgium: Ghent University.
• 5: Bryllant, J., & Zillman, D. (1996). Los efectos de los medios de comunicacióón. Investigaciones y Teorías. Barc. Paidós.
• 6: Burgstahler, Sheryl. Universal Design of Instruction (UDI): Definition, Principles, Guidelines, and Examples. DO-IT: Disabilities, Opportunities, Internetworking and Technology, University of Washington, 2006.
• 7: S. -K. Chang , A. Hsu, Image Information Systems: Where Do We Go From Here?, IEEE Transactions on Knowledge and Data Engineering, v.4 n.5, p.431-442, October 1992 [doi>10.1109/69.166986]
• 8: Chen, H.-l. (2001). An analysis of image retrieval tasks in the field of art history. (E. S. Ltd, Ed.) Information Processing and Management (37), 701-720.
• 9: Connell, B.R., Jones, M., Mace, R., Mueller, J., Mullick, A., Ostroff, E., et al. The Centre for Universal Design. 1997. http://design.ncsu.edu/cud/about_ud/udprinciples.htm
• 10: Eakins, J.P. (2002). Towards intelligent image retrieval. (P. R. Society, Ed.) Pattern Recognition (35), 3--14.
• 11: Enser, P. (2000). Visual image retrieval: seeking the alliance of concept-based and content-based paradigms. (C. I. Professionals, Ed.) Journal of Information Science, 26 (4), 199--210.
• 12: Fidel, R. (1997). The Image Retrieval Task Implications for the Design and Evaluation of Image Databases (Vols. The New Hypermedia and Multimedia, 181--199).
• 13: Francisco Aguilar, Antonio Verdejo, Mª Isabel Peralta, María Sánchez, Miguel Pérez. (2005). Experience of emotions in substance abusers exposed to images containing neutral, positive, and negative affective stimuli. (Elsevier, Ed.) Drug and Alcohol Dependence (78), 159--167.
• 14: Amarnath Gupta , Ramesh Jain, Visual information retrieval, Communications of the ACM, v.40 n.5, p.70-79, May 1997 [doi>10.1145/253769.253798]
• 15: Henry Lieberman , Hugo Liu, Adaptive Linking between Text and Photos Using Common Sense Reasoning, Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, p.2-11, May 29-31, 2002
• 16: Hong, S., Ahn, C., Nah, Y., Choi, L. (2005). Searching Colour Images by Emotional Concepts. Searching Colour Images by Emotional Concepts, 3597/2005.
• 17: Houtveen JH, Rietveld S, Schoutrop M, Spiering M, Brosschot JF. (2001). A repressive coping style and affective, facial and physiological responses to looking at emotional pictures. International Journal of Psychophysiology, 42, 265--277.
• 18: J.H. Xin 1, K.M. Cheng, G. Taylor, T. Sato, A. Hansuebsai. (2004). Cross-Regional Comparison of Colour Emotions Part I. Quantitative Analysis. Colour Research & Application, 29 (6), 451--457.
• 19: Jörgensen, C. (1996). Testing an Image Description Template. Procee. 59th Meeting of the American Society for Information Science, 21-24: 209--213. Baltimore.
• 20: L. Hollink , A. Th. Schreiber , B. J. Wielinga , M. Worring, Classification of user image descriptions, International Journal of Human-Computer Studies, v.61 n.5, p.601-626, November 2004 [doi>10.1016/j.ijhcs.2004.03.002]
• 21: Manchón, Eduardo. Ainda.info: Usabilidad, diseño web fácil de usar. www.ainda.info/estetica_vs_usabilidad.html
• 22: Mikels, Fredrickson, Larkin, Lindberg, Maglio, Reuter-Lorenz. (2005). Emotional category data on images from the IAPS. Behaviour Research Methods, 37 (4), 626--630.
• 23: O'Reilly, Tim. What is Web 2.0. 30 de 09 de 2005. http://www.oreilly.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html
• 24: Ou, L.-C. (2006-2008). World of colour emotion. (L.-C. Ou, Editor) http://colour-emotion.co.uk
• 25: Pask, A. M. (2005). Art Historians' Use of Digital Images: a Usability Test of ARTstor. A Master's Paper for the M.S. in L.S. degree.
• 26: Paul Clough, Henning Müller, Mark Sanderson. (2004). The CLEF 2004 Cross-Language Image Retrieval (Vol. Image and Video Retrieval). Springer Berlin/Heidelberg.
• 27: Peter Enser, Linda Armitage. (1997). "Analysis of User Need in Image Archives". Journal of Information 23. nº4. 287--299.
• 28: Peter J. Lang, Margaret M. Bradley & Bruce N. Cuthbert. (2005). International Affective Picture System: Affective ratings of pictures and instruction manual. University of Florida, NIME. Gainesville: University of Florida.
• 29: Plutchik.R. (2001). The Nature of Emotions. (H. a. Row, Ed.) The Nature of Emotions, 89 (4), 344--350.
• 30: Ramirez O., Molto, J. et Al. (1999). Un Nuevo método para el estudio experimental de las emociones: El international affective picture system (IAPS). Adaptación Española. Revista de Psicología General y Aplicada/Journal of Psychophysiology, 55/22 (1), 55--87/312--313.
• 31: Raquel Chayo, A.E. (2003). Valencia, activación, dominancia y contenido moral, ante estímulos visuales con contenido emocional y moral: Estudio en población mexicana. Revista Española de Neuropsicología, 3-4 (5), 213--225.
• 32: Santamaría, Sergio Ortega.Evolución del perfil del usuario: Usuarios 2.0. Yusef Hassan Montero. 6, s.l.: Nosolousabilidadjournal, 28 de 05 de 2007, No Solo Usabilidad Journal -- NSU.
• 33: Chih-Fong Tsai , Ken McGarry , John Tait, Qualitative evaluation of automatic assignment of keywords to images, Information Processing and Management: an International Journal, v.42 n.1, p.136-154, January 2006 [doi>10.1016/j.ipm.2004.11.001]
• 34: Venkat N. Gudivada , Vijay V. Raghavan, Modeling and retrieving images by content, Information Processing and Management: an International Journal, v.33 n.4, p.427-452, July 1997 [doi>10.1016/S0306-4573(97)00007-1]
• 35: W1: www.casadomo.com
• 36: W2: http://en.wikipedia.org/wiki/Eye_tracking
• 37: W3: http://www.dublincore.org/
• 38: W4: http://www.ifla.org/II/metadata.htm
• 39: W5: http://www.textuality.com/mcf/NOTE-MCF-XML.html
• 40: W6: http://www.imsproject.org/
• 41: W7: http://www.chiariglione.org/mpeg/
• 42: W8: http://www.iptc.org/IIM/
• 43: W9: http://www.exif.or
• 44: W10: http://www.adobe.com/products/xmp/
• 45: W11: http://photobucket.com
• 46: W12: http://www.flickr.com/
• 47: W13: http://imageshack.us
• 48: W14: www.picasaweb.google.com
• 49: Y. H. Montero, F. J.M. Fernández. Diseño Inclusivo: Marco Metodológico para el Desarrollo de Sitios Web Accesibles. No Solo Usabildad Journal. 2, www.nosolousabilidad.com: s.n., 2 de 10 de 2003, No Solo Usabilidad Journal

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Software psychology; Human information processing
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Experimentation, Human Factors

Keywords:
cultural differences, emotional usability, image compression, image indexation, semantic relationships, web 2.0