Application of computational media aesthetics methodology to extracting color semantics in film

ABSTRACT

Using film grammar as the underpinning, we study the extraction of structures in video based on color using a wide configuration of clustering methods combined with existing and new similarity measures. We study the visualisation of these structures, which we call Scene-Cluster Temporal Charts and show how it can bring out the interweaving of different themes and settings in a film. We also extract color events that filmmakers use to draw/force a viewer's attention to a shot/scene. This is done by first extracting a set of colors used rarely in film, and then building a probabilistic model for color event detection. We demonstrate with experimental results from ten movies that our algorithms are effective in the extraction of both scene-cluster temporal charts and color events.

REFERENCES

• 1: Carlo Colombo , Alberto Del Bimbo , Pietro Pala, Semantics in Visual Information Retrieval, IEEE MultiMedia, v.6 n.3, p.38-53, July 1999 [doi>10.1109/93.790610]
• 2: Chitra Dorai , Svetha Venkatesh, Computational Media Aesthetics: Finding Meaning Beautiful, IEEE MultiMedia, v.8 n.4, p.10-12, October 2001 [doi>10.1109/93.959093]
• 3: B. S. Everitt. Cluster Analysis. Edward Arnold, 3rd edition, 1993.
• 4: W. Johnson. Coming to term with color. Film Quaterly, 20(1):2--22, 1996.
• 5: M. R. Napahde and T. S. Huang. A probablistics framework for semantic video indexing, filtering and retrieval. IEEE Transactions on Multimedia, 3(1):141--151, March 2001.
• 6: S. Neale. Cinema and Technology: Image, Sound and Color. MacMillan Education Ltd, 1985.
• 7: B. T. Truong, C. Dorai, and S. Venkatesh. Automatic scene extraction in motion pictures. Technical Report 1/2001, School of Computing, Curtin University of Technology, Perth, Western Australia, 2001.
• 8: H. Zettl. Sight Sound Motion: Applied Media Aesthetics. Wadsworth Publishing, 3rd edition, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing