Is that a smile?: gaze dependent facial expressions

ABSTRACT

Based on artistic methods used for manipulating perception, we present a technique that creates facial images with conflicting emotional states at different spatial frequencies. The foveal and peripheral components of the human visual system tend to interpret emotional states differently, adding a degree of elusiveness to the facial image. Our technique first isolates the coarser low spatial frequency components and finer high spatial frequency details from two images with differing facial expressions. We then perform image segmentation with edge detection, and morph the images. In practice we have found that high spatial frequency elements determine the dominant expression in the resulting image, while the low spatial frequency elements contribute subtlety.

REFERENCES

• 1: Thaddeus Beier , Shawn Neely, Feature-based image metamorphosis, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.35-42, July 1992
• 2: Volker Blanz , Thomas Vetter, A morphable model for the synthesis of 3D faces, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.187-194, July 1999 [doi>10.1145/311535.311556]
• 3: DURAND, F., AGRAWALA, M., GOOCH, B., INTERRANTE, V., OSTROMOUKHOV, V., AND ZORIN, D. 2002. Perceptual and artistic principles for effective computer depiction. In Course 13, SIGGRAPH 2002, San Antonio, Texas, ACM.
• 4: EKMAN, P. 2003. Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life. Henry Holt and Company, Incorporated.
• 5: K. Fei, Expressive textures, Proceedings of the 1st international conference on Computer graphics, virtual reality and visualisation, November 05-07, 2001, Camps Bay, Cape Town, South Africa [doi>10.1145/513867.513897]
• 6: William T. Freeman , Edward H. Adelson , David J. Heeger, Motion without movement, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.27-30, July 1991
• 7: GOMBRICH, E. H. 1995. Story of Art. Phaidon Press, Incorporated.
• 8: Brian Guenter , Cindy Grimm , Daniel Wood , Henrique Malvar , Fredric Pighin, Making faces, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.55-66, July 1998 [doi>10.1145/280814.280822]
• 9: Marcin Iwanowski , Jean Serra, Morphological Interpolation and Color Images, Proceedings of the 10th International Conference on Image Analysis and Processing, p.50, September 27-29, 1999
• 10: V.F. F. Leavers, Shape Detection in Computer Vision Using the Hough Transform, Springer-Verlag New York, Inc., Secaucus, NJ, 1992
• 11: Yuencheng Lee , Demetri Terzopoulos , Keith Walters, Realistic modeling for facial animation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.55-62, September 1995 [doi>10.1145/218380.218407]
• 12: Zicheng Liu , Ying Shan , Zhengyou Zhang, Expressive expression mapping with ratio images, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.271-276, August 2001 [doi>10.1145/383259.383289]
• 13: LIVINGSTONE, M. 2002. Vision and Art: The Biology of Seeing. Harry N. Abrams.
• 14: Jun-yong Noh , Ulrich Neumann, Expression cloning, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.277-288, August 2001 [doi>10.1145/383259.383290]
• 15: Frédéric Pighin , Jamie Hecker , Dani Lischinski , Richard Szeliski , David H. Salesin, Synthesizing realistic facial expressions from photographs, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.75-84, July 1998 [doi>10.1145/280814.280825]

INDEX TERMS

Keywords:
acuity, cognitive dissonance, emotion, facial expression, spatial frequency, visual perception