3D object retrieval using 2D line drawing and graph based relevance reedback

ABSTRACT

This paper aims to provide a user-friendly interface for 3D object retrieval. In previous 3D retrieval systems, the user mainly uses two methods to input a query: providing an existing 3D objects, or providing partial shape information of desired objects such as text and 2D shapes. The first method fails when the user does not have a similar 3D object in hand, and the second method cannot sufficiently describe 3D shapes of objects. We believe that the best way is to have a good interface that can convert a 2D sketch drawn by the user into a 3D object as the query. A 2D line drawing is easy to be drawn and is the simplest and most direct way of illustrating a 3D object. In this paper, we develop an interface of 3D object reconstruction from line drawings, which allows the user to draw line drawings of objects with both planar and curved surfaces. In addition, in order to refine the retrieved results, we develop a relevance feedback algorithm based on a novel graph discriminant analysis. Compared with recently published relevance feedback algorithms, our algorithm achieves better retrieval performance.

REFERENCES

• 1: H. Barrow and J. Tenenbaum. Interpreting line drawings as three-dimensional surfaces. Artificial Intelligence 17(1-3):75--116, 1981.
• 2: L. Cao. 3D object reconstruction from line drawings. Master Thesis, Dept. Information Engineering, the Chinese University of Hong Kong 2005.
• 3: C. Chow and C. Liu. Approximating discrete probability distributions with dependence trees.IEEE Trans. Information Theory 14(3):462--467,1968.
• 4: Roger A. Horn , Charles R. Johnson, Matrix analysis, Cambridge University Press, New York, NY, 1985
• 5: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 6: H. Lipson and M. Shpitalni. Optimization-based reconstruction of a 3D object from a single freehand line drawing. CAD 28(8):651--663, 1996.
• 7: Jianzhuang Liu , Yong Tsui Lee , Wai-Kuen Cham, Identifying Faces in a 2D Line Drawing Representing a Manifold Object, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.12, p.1579-1593, December 2002 [doi>10.1109/TPAMI.2002.1114850]
• 8: P. Min, M. Kazhdan, and T. Funkhouser. A comparison of text and shape matching for retrieval of online 3D models. European Conf. Digital Libraries 2004.
• 9: Y. Rui, T. S. Huang, and S. Mehrotra. Content-based image retrieval with relevance feedback in mars. ICIP 2:815--818,1997.
• 10: A. Shesh and B. Chen. Smartpaper: An interactive and user friendly sketching system. EuroGraphics 2004.
• 11: The Princeton Shape Benchmark, Proceedings of the Shape Modeling International 2004 (SMI'04), p.167-178, June 07-09, 2004 [doi>10.1109/SMI.2004.63]
• 12: Thomas Funkhouser , Patrick Min , Michael Kazhdan , Joyce Chen , Alex Halderman , David Dobkin , David Jacobs, A search engine for 3D models, ACM Transactions on Graphics (TOG), v.22 n.1, p.83-105, January 2003 [doi>10.1145/588272.588279]
• 13: A Survey of Content Based 3D Shape Retrieval Methods, Proceedings of the Shape Modeling International 2004 (SMI'04), p.145-156, June 07-09, 2004 [doi>10.1109/SMI.2004.10]
• 14: X. S. Zhou and T. S. Huang.Small sample learning during multimedia retrieval using biasmap. CVPR 1:11--17,2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

General Terms:
Algorithms, Design

Keywords:
3D object retrieval, 3D reconstruction, query generation, relevance feedback