|
ABSTRACT
As the number of 3D models available on the Web grows, there is an increasing need for a search engine to help people find them. Unfortunately, traditional text-based search techniques are not always effective for 3D data. In this article, we investigate new shape-based search methods. The key challenges are to develop query methods simple enough for novice users and matching algorithms robust enough to work for arbitrary polygonal models. We present a Web-based search engine system that supports queries based on 3D sketches, 2D sketches, 3D models, and/or text keywords. For the shape-based queries, we have developed a new matching algorithm that uses spherical harmonics to compute discriminating similarity measures without requiring repair of model degeneracies or alignment of orientations. It provides 46 to 245% better performance than related shape-matching methods during precision--recall experiments, and it is fast enough to return query results from a repository of 20,000 models in under a second. The net result is a growing interactive index of 3D models available on the Web (i.e., a Google for 3D models).
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
Aherne, F., Thacker, N., and Rockett, P. 1997. Optimal pairwise geometric histograms. In Proceedings of BMVC (Essex, UK), 480--490.
|
| |
2
|
Alt, H. and Guibas, L. J. 1996. Discrete geometric shapes: Matching, interpolation, and approximation: A survey. Tech. Rep. B 96-11, EVL-1996-142, Institute of Computer Science, Freie Universität Berlin.
|
| |
3
|
Amit, Y., Grenander, U., and Piccioni, M. 1991. Structural image restoration through deformable templates. J. Am. Stat. Assn. 86, 440, 376--387.
|
| |
4
|
|
| |
5
|
|
| |
6
|
|
| |
7
|
|
 |
8
|
|
| |
9
|
|
| |
10
|
Bardinet, E., Vidal, S. F., Arroyo, S. D., Malandain, G., and de la Blanca Capilla, N. P. 2000. Structural object matching. Tech. Rep. DECSAI-000303, Dept. of Computer Science and AI, University of Granada, Spain, February.
|
| |
11
|
|
| |
12
|
Barrow, H., Tenenbaum, J., Bolles, R., and Wolf, H. 1977. Parametric correspondence and chamfer matching: Two new techniques for image matching. In Proceedings of the International Joint Conference on Artificial Intelligence, 659--663.
|
| |
13
|
Belongie, S., Malik, J., and Puzicha, J. 2001. Matching shapes. ICCV.
|
 |
14
|
|
| |
15
|
|
| |
16
|
|
 |
17
|
|
| |
18
|
|
| |
19
|
Binford, T. 1971. Visual perception by computer. In IEEE Conference on Systems Science and Cybernetics.
|
| |
20
|
|
| |
21
|
Blum, H. 1967. A transformation for extracting new descriptors of shape. In Proceedings of Models for the Perception of Speech and Visual Form, W. Wathen-Dunn, Ed. MIT Press, Cambridge, Mass., 362--380.
|
| |
22
|
|
| |
23
|
|
| |
24
|
|
 |
25
|
|
 |
26
|
|
| |
27
|
De Espona Infographica. 2001. 3D model collection. Available at http://www.deespona.com.
|
| |
28
|
|
| |
29
|
Delingette, H., Hebert, M., and Ikeuchi, K. 1993. A spherical representation for the recognition of curved objects. In Proceedings of ICCV, 103--112.
|
| |
30
|
|
| |
31
|
|
| |
32
|
Evans, A., Thacker, N., and Mayhew, J. 1992. Pairwise representation of shape. In Proceedings of the Eleventh ICPR, vol. 1 (The Hague, the Netherlands), 133--136.
|
| |
33
|
Myron Flickner , Harpreet Sawhney , Wayne Niblack , Jonathan Ashley , Qian Huang , Byron Dom , Monika Gorkani , Jim Hafner , Denis Lee , Dragutin Petkovic , David Steele , Peter Yanker, Query by Image and Video Content: The QBIC System, Computer, v.28 n.9, p.23-32, September 1995
[doi> 10.1109/2.410146]
|
| |
34
|
|
 |
35
|
|
| |
36
|
|
| |
37
|
André Guéziec , Gabriel Taubin , Francis Lazarus , William Horn, Converting sets of polygons to manifold surfaces by cutting and stitching, Proceedings of the conference on Visualization '98, p.383-390, October 18-23, 1998, Research Triangle Park, North Carolina, United States
|
 |
38
|
|
| |
39
|
Horn, B. 1984. Extended Gaussian images. Proc. IEEE 72, 12 (Dec.), 1671--1686.
|
| |
40
|
|
| |
41
|
|
| |
42
|
Ikeuchi, K. and Flynn, P. 1995. Recent progress in CAD-based vision. Comput. Vis. Image Understand 61, 3.
|
 |
43
|
|
 |
44
|
|
| |
45
|
|
| |
46
|
|
| |
47
|
Kashyap, R. and Chellappa, R. 1981. Stochastic models for closed boundary analysis: Representation and reconstruction. IEEE Trans. Inf. Theor. 27, 627--637.
|
| |
48
|
Kastenmüller, G., Kriegel, H.-P., and Seidl, T. 1998. Similarity search in 3D protein databases. In Proceedings of GCB.
|
| |
49
|
Lamdam, Y. and Wolfson, H. 1988. Geometric hashing: A general and efficient model-based recognition scheme. In Proceedings of ICCV.
|
| |
50
|
Lamdan, Y., Schwartz, J., and Wolfson, H. 1990. Affine invariant model-based object recognition. IEEE Trans. Robotics Autom. 6, 578--589.
|
| |
51
|
|
| |
52
|
|
| |
53
|
Loncaric, S. 1998. A survey of shape analysis techniques. Pattern Recogn. 31, 8, 983--1001.
|
| |
54
|
|
| |
55
|
McCallum, A. 1996. Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering. Available at http://www.cs.cmu.edu/∼mccallum/bow.
|
| |
56
|
MeshNose. 2001. Available at http://www.deepfx.com/meshnose.
|
 |
57
|
|
| |
58
|
Mori, G., Belongie, S., and Malik, J. 2001. Shape contexts enable efficient retrieval of similar shapes. Proc. CVPR.
|
 |
59
|
|
| |
60
|
|
| |
61
|
|
| |
62
|
Okino. 2001. Polytrans. Available at http://www.okino.com/conv/conv.htm.
|
| |
63
|
|
| |
64
|
Palmer, S., Rosch, E., and Chase, P. 1981. Canonical perspective and the perception of objects. Attention Perf. IX, 135--151.
|
| |
65
|
Paquet, E. and Rioux, M. 2000. Nefertiti: A tool for 3-D shape databases management. SAE Trans. J. Aerospace 108, 387--393.
|
| |
66
|
|
| |
67
|
|
| |
68
|
Porter, M. 1980. An algorithm for suffix stripping. Program 14, 3, 130--137.
|
| |
69
|
|
| |
70
|
Regli, W. 2001. National design repository. Geometric and Intelligent Computing Laboratory, Drexel University, Available at http://repos.mcs.drexel.edu.
|
| |
71
|
Reyna, R. D. 1996. How to Draw What You See. Watson-Guptil, New York.
|
| |
72
|
Rocchio, J. 1971. The SMART Retrieval System: Experiments in Automatic Document Processing. Prentice-Hall, Englewood Cliffs, N.J., 313--323.
|
| |
73
|
Rowe, J., Razdan, A., Collins, D., and Pachanathan, S. 2001. A 3D digital library system: Capture, analysis, query, and display. Proceedings of the Fourth International Conference on Digital Libraries (ICADL).
|
| |
74
|
|
| |
75
|
Salton, G. 1971. The SMART Retrieval System. Prentice-Hall, Englewood Cliffs, N.J.
|
| |
76
|
|
| |
77
|
Schurmans, U., Razdan, A., Simon, A., McCartney, P., Marzke, M., Alfen, D. V., Jones, G., Rowe, J., Farin, G., Collins, D., Zhu, M., Liu, D., and Bae, M. 2001. Advances in geometric modeling and feature extraction on pots, rocks and bones for representation and query via the Internet. Comput. Appl. Archaeology (CAA).
|
| |
78
|
|
| |
79
|
Shokoufandeh, A., Dickinson, S. J., Siddiqi, K., and Zucker, S. W. 1999. Indexing using a spectral encoding of topological structure. In Proceedings of Computer Vision and Pattern Recognition. vol. 2, IEEE, Los Alamitos, Calif., 491--497.
|
| |
80
|
|
| |
81
|
|
| |
82
|
|
| |
83
|
SpharmonicKit 2.5. 1998. Fast spherical transforms: Spharmonickit. Available at http://www.cs.dartmouth.edu/∼geelong/sphere/.
|
 |
84
|
Duane W. Storti , George M. Turkiyyah , Mark A. Ganter , Chek T. Lim , Derek M. Stal, Skeleton-based modeling operations on solids, Proceedings of the fourth ACM symposium on Solid modeling and applications, p.141-154, May 14-16, 1997, Atlanta, Georgia, United States
[doi> 10.1145/267734.267771]
|
| |
85
|
Suzuki, M. T. 2001. A Web-based retrieval system for 3D polygonal models. Joint Ninth IFSA World Congress and Twentieth NAFIPS International Conference (IFSA/NAFIPS2001), 2271--2276.
|
| |
86
|
Tappert, C. 1982. Cursive script recognition by elastic matching. IBM J. Res. Dev. 26, 6, 765--771.
|
| |
87
|
Taubin, G. and Cooper, D. 1992. Geometric Invariance in Computer Vision. MIT Press, Cambridge, Mass.
|
| |
88
|
|
| |
89
|
Tsai, W. and Yu, S. 1985. Attributive string matching with merging for shape recognition. IEEE Trans. Pattern Anal. Mach. Intell. 7, 453--462.
|
 |
90
|
|
| |
91
|
Uras, C. and Verri, A. 1994. On the recognition of the alphabet of the sign language through size functions. In Proceedings of IAPR (Jerusalem), 334--338.
|
| |
92
|
|
| |
93
|
Veltkamp, R. C., Burkhardt, H., and Kriegel, H.-P. 2001. State-of-the-Art in Content-Based Image and Video Retrieval. Kluwer Academic, Hingham, Mass.
|
| |
94
|
Viewpoint Corporation. 2001. Available at http://www.viewpoint.com.
|
| |
95
|
Vranic, D. V., Saupe, D., and Richter, J. 2001. Tools for 3D-object retrieval: Karhunen--Loeve transform and spherical harmonics. In IEEE 2001 Workshop on Multimedia Signal Processing, 293--298.
|
 |
96
|
|
| |
97
|
Wu, K. and Levine, M. 1994. Recovering parametric geons from multiview range data. In Proceeding of CVPR, 159--166.
|
| |
98
|
Young, I., Walker, J., and Bowie, J. 1974. An analysis technique for biological shape. Comput. Graph. Image Process. 25, 357--370.
|
| |
99
|
Zahn, C. and Roskies, R. 1972. Fourier descriptors for plane closed curves. IEEE Trans. Comput. 21, 269--281.
|
 |
100
|
|
| |
101
|
Zhang, D. and Hebert, M. 1999. Harmonic maps and their applications in surface matching. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR '99).
|
CITED BY 67
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Thomas Funkhouser , Michael Kazhdan , Philip Shilane , Patrick Min , William Kiefer , Ayellet Tal , Szymon Rusinkiewicz , David Dobkin, Modeling by example, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
|
|
|
|
|
|
N. Vajramushti , I. A. Kakadiaris , T. Theoharis , G. Papaioannou, Efficient 3D object retrieval using depth images, Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, October 15-16, 2004, New York, NY, USA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Michael S. Lew , Nicu Sebe , Chabane Djeraba , Ramesh Jain, Content-based multimedia information retrieval: State of the art and challenges, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.2 n.1, p.1-19, February 2006
|
|
|
|
|
|
|
|
|
|
|
|
Jeng-Sheng Yeh , Chung-Lin Wen , Jen-Yuan Chiang , Liang-Kai Wang , Ting-Hao Huan , Ding-Yun Chen , Li-Fong Lin , Yung-Yu Chuang , Ming-Yang Yu , Bing-Yu Chen , Jean Y. C. Tsai , Ming Ouhyoung, Hand-shadow illusions and 3D DDR based on efficient model retrieval, ACM SIGGRAPH 2006 Emerging technologies, July 30-August 03, 2006, Boston, Massachusetts
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Susumu Endo , Takayuki Baba , Shuichi Shiitani , Yusuke Uehara , Daiki Masumoto , Shigemi Nagata, Shape based 3D model retrieval without query, Proceedings of the 6th ACM international conference on Image and video retrieval, p.218-225, July 09-11, 2007, Amsterdam, The Netherlands
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Sen Wang , Yang Wang , Miao Jin , Xianfeng David Gu , Dimitris Samaras, Conformal Geometry and Its Applications on 3D Shape Matching, Recognition, and Stitching, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.29 n.7, p.1209-1220, July 2007
|
|
|
|
|
|
Xiuzi Ye , Hongzheng Liu , Lei Chen , Zhiyang Chen , Xiang Pan , Sanyuan Zhang, Reverse innovative design - an integrated product design methodology, Computer-Aided Design, v.40 n.7, p.812-827, July, 2008
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|