Interactive 3D caricature generation based on double sampling

ABSTRACT

Recently, 3D caricature generation and applications have attracted wide attention from both the research community and the entertainment industry. This paper proposes a novel interactive approach for various and interesting 3D caricature generation based on double sampling. Firstly, according to user's operation, we obtain a coarse 3D caricature with local features transformation by sampling in well-built principle component analysis (PCA) subspace. Secondly, to utilize information of the 2D caricature dataset, we sample in the local linear embedding (LLE) manifold subspace. Finally, we use the learned 2D caricature information to further refine the coarse caricature by applying Kriging interpolation. The experiments show that the 3D caricature generated by our method can preserve highly artistic styles and also reflect the user's intention.

REFERENCES

• 1: E. Akleman and J. Reisch. Modeling expressive 3d caricatures. In Proc. ACM SIGGRAPH'04, 2004.
• 2: G. Fu, Y. Chen, J. Liu, J. Zhou, and P. Li. Interactive expressive 3d caricature design. In Proc. ICME'08,pages 965--968, 2008.
• 3: T. Fujiwara, H. Koshimizu, K. Fujimura, G. Fujita,Y. Noguchi, and N. Ishikawa. A method for 3d face modeling and caricatured figure generation. In Proc. ICME'02, volume 2, pages 137--140, 2002.
• 4: T. Fujiwara, H. Koshimizu, K. FujimUra, H. Kiham,Y. Noguchi, and N. Ishikawa. 3d modeling system of human face and full 3d facial caricaturing. In Proc. of the Seventh International Conference on Virtual Systems and Multimedia, pages 625--633, 2001.
• 5: T. Fujiwara, T. Nishihara, M. Tominaga, K. Kato, K. Murakami, and H. Koshirnizu. On the detection of feature points of 3d facial image and its application to 3d facial caricature. In Proc. of International Conference on 3-D Digital Imaging and Modeling, pages 490--496, 1999.
• 6: T. Kondo, K. Murakami, and H. Koshimizu. From coarse to fine correspondence of 3-d facial images and its application to 3-d facial caricaturing. In Proc. of International Conference on Recent Advances in 3-D Digital Imaging and Modeling, pages 283--288, 1997.
• 7: P. Li, Y. Chen, J. Liu, and G. Fu. 3d caricature generation by manifold learning. In Proc. ICME'08, pages 941--944, 2008.
• 8: J. D. Long. Realistic 3D Facial Synthesis. Institute of Computing Technology, Chinese Academy of Sciences, 2003.
• 9: M. A. Oliver and R. Webster. Kriging: a method of interpolation for geographical information system. INT. J. Geographical Information Systems, 4(3):313--332, 3 1990.
• 10: S. T. Roweis and L. K. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323--2326, Dec. 2000.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

General Terms:
Experimentation, Human Factors, Performance

Keywords:
3D caricature, LLE, PCA, manifold, sampling