Ranking on semantic manifold for shape-based 3d model retrieval

ABSTRACT

Semantics associated with 3D shapes are often as important as the shapes themselves in defining "shape similarity" among them. So far, only a small subset of 3D model retrieval methods took semantics into account. Most popular approach to semantic 3D model retrieval is based on Relevance Feedback (RF), an iterative, interactive approach for a system to learn a semantic class that embodies "user intention" for the query. A drawback of a typical RF-based method is its low initial performance as it starts cold without any semantic knowledge. An alternative approach is off-line learning of multiple semantic classes. The approach produces a good retrieval performance without per-query training iterations, but is unable to capture user intention per-query. The method proposed in this paper attempts to combine benefits of the two approaches so that both shared multiple semantic classes and per-query intention can be captured to improve 3D model retrieval. Our method first learns, off-line, the multiple semantic classes by using a semi-supervised manifold learning algorithm to produce a "semantic manifold" of the input features. The RF iteration based on manifold ranking algorithm is then run on the semantic manifold. Our empirical evaluation showed that this method significantly outperforms the manifold ranking run in the original, ambient feature space.

REFERENCES

• 1: Charu C. Aggarwal , Alexander Hinneburg , Daniel A. Keim, On the Surprising Behavior of Distance Metrics in High Dimensional Spaces, Proceedings of the 8th International Conference on Database Theory, p.420-434, January 04-06, 2001
• 2: Herbert Edelsbrunner , Ernst P. Mücke, Three-dimensional alpha shapes, ACM Transactions on Graphics (TOG), v.13 n.1, p.43-72, Jan. 1994 [doi>10.1145/174462.156635]
• 3: Michael Elad , Ayellet Tal , Sigal Ar, Content based retrieval of VRML objects: an iterative and interactive approach, Proceedings of the sixth Eurographics workshop on Multimedia 2001, p.107-118, September 08-09, 2001, Manchester, UK
• 4: Simon Haykin, Neural Networks: A Comprehensive Foundation, Prentice Hall PTR, Upper Saddle River, NJ, 1998
• 5: X. He, P. Niyogi, Locality Preserving Projections, Advances in Neural Information Processing Systems, 16, Vancouver, Canada (2003). http://people.cs.uchicago.edu/~xiaofei/LPP.html
• 6: Jingrui He , Mingjing Li , Hong-Jiang Zhang , Hanghang Tong , Changshui Zhang, Manifold-ranking based image retrieval, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027531]
• 7: M. Iyer, S. Jayanti, K. Lou, Y. Kalyanaraman, K. Ramani, Three Dimensional Shape Searching: State-of-the-art Review and Future Trends, Computer Aided Design, 5(15), pp. 509--530, (2005).
• 8: G. Leifman, R. Meir, A. Tal, Semantic-oriented 3d shape retrieval using relevance feedback, The Visual Computer, 21(8--10), pp. 865--875, (2005).
• 9: M. Novotni, G.-J. Park, R. Wessel, R. Klein, Evaluation of Kernel Based Methods for Relevance Feedback in 3D Shape Retrieval, Proc. The Fourth International Workshop on Content-Based Multimedia Indexing (CBMI'05) (2005).
• 10: NTU 3D Model Database, ver.1, http://3d.csie.ntu.edu.tw/
• 11: Ryutarou Ohbuchi , Akihiro Yamamoto , Jun Kobayashi, Learning semantic categories for 3D model retrieval, Proceedings of the international workshop on Workshop on multimedia information retrieval, September 24-29, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290082.1290090]
• 12: J. Pu, K. Lou, K. Ramani, A 2D Sketch-Based User Interface for 3D CAD Model Retrieval, Computer Aided Design and Application, 2(6), pp.717--727 (2005).
• 13: S. T. Roweis, L. K. Saul, Nonlinear Dimensionality Reduction by Locally Linear Embedding, Science, 290(5500), pp. 2323--2326 (2000).
• 14: J. J. Roccio, Relevance feedback in information retrieval, The SMART Retrieval System, pp. 313--323, Prentice-Hall (1971).
• 15: Y. Rui, T. S. Huang, M. Ortega, S. Mehrotra, Relevance feedback: a power tool for interactive content-based image retrieval, IEEE Trans. Circuits and Systems for Video Technology, p. 59--66 (1998).
• 16: The Princeton Shape Benchmark, Proceedings of the Shape Modeling International 2004, p.167-178, June 07-09, 2004 [doi>10.1109/SMI.2004.63]
• 17: Masashi Sugiyama, Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis, The Journal of Machine Learning Research, 8, p.1027-1061, 5/1/2007
• 18: A Survey of Content Based 3D Shape Retrieval Methods, Proceedings of the Shape Modeling International 2004, p.145-156, June 07-09, 2004 [doi>10.1109/SMI.2004.10]
• 19: J. B. Tanenbaum, V. de Silva, J. C. Langford, A Global Geometric Framework for Nonlinear Dimensionality Reduction, Science, 290(5500), pp. 2319--2323 (2000).
• 20: Simon Tong , Edward Chang, Support vector machine active learning for image retrieval, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500159]
• 21: R. C. Veltkamp, R. Ruijsenaars, M. Spagnuolo, Roelof van Zwol, SHREC2006 3D Shape Retrieval Contest, Dept of Info and Comp. Sci., Utrecht University, Technical Report UU-CS-2006--030 (ISSN: 0924--3275).(2006).
• 22: R.C. Veltkamp, F.B. ter Harr, SHREC 2007 3D Shape Retrieval Contest, Dept of Info and Comp. Sci., Utrecht University, Technical Report UU-CS--2007--015 (2007).
• 23: E. Wahl, U. Hillenbrand, G. Hirzinger, Surflet-Pair-Relation Histograms: A Statistical 3D-Shape Representation for Rapid Classification, Proc. 3DIM 2003, pp. 474--481 (2003).
• 24: L. Zhang, F. Lin, B. Zhang, Support vector machine learning for image retrieval, Proc. IEEE ICIP 2001, vol. 2, pp. 721--724 (2001).
• 25: D. Zhou, O. Bousquet, T. N. Lal, J. Weston, B. Schölkopf, Learning with Local and Global Consistency, Proc. NIPS 2003 (2003).

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

General Terms:
Algorithms, Experimentation

Keywords:
3d models, content-based retrieval, manifold learning., manifold ranking, relevance feedback, semi-supervised learning