Motion map: image-based retrieval and segmentation of motion data

ABSTRACT

Recent proliferation of motion capture systems enables motion data to be saved as an archive system, and the data are usually extracted by selecting an appropriate file by its name or annotation explaining the content of motions. Such semantic-based retrieval, however, is not suited to unstructured files that include many types of elemental motions, due to the difficulty in giving comprehensible annotations. Moreover, expected motion clips are often included as a part of entire sequences, and the data therefore should be manually clipped using some authoring tools.

This paper proposes an image-based user interface for retrieving motion data using a self-organizing map for supplying recognizable icons of postures. The postures are used as keys for retrieval, and the desirable segments of the motion data can be accurately extracted by specifying and ending postures. The number of possible motion segments is flexibly controlled by changing the scope of postures used as the keys.

REFERENCES

• 1: Okan Arikan , David A. Forsyth , James F. O'Brien, Motion synthesis from annotations, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 2: Matthew Brand , Aaron Hertzmann, Style machines, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.183-192, July 2000 [doi>10.1145/344779.344865]
• 3: Stuart K. Card , Jock D. Mackinlay , Ben Shneiderman, Readings in information visualization: using vision to think, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 4: James Davis , Maneesh Agrawala , Erika Chuang , Zoran Popović , David Salesin, A sketching interface for articulated figure animation, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 5: {dOL03} De Olivera M. C. F., Levkowitz H.: From visual data exploration to visual data mining: A survey. IEEE Transaction on Visualization and Computer Graphics 9, 3 (2003), 378--394.
• 6: {EP02} Elliman D., Pulido J.: Visualizing ontology components through self-organizing maps. In Proc. of Sixth International Conference on Information Visualization (IV'02) (2002), pp. 434--438.
• 7: {HB92} Hummel J. E., Biederman I.: Dynamic binding in a neural network for shape recognition. Psychological Review 99, 3 (1992), 480--517.
• 8: Ivan Herman , Guy Melançon , M. Scott Marshall, Graph Visualization and Navigation in Information Visualization: A Survey, IEEE Transactions on Visualization and Computer Graphics, v.6 n.1, p.24-43, January 2000 [doi>10.1109/2945.841119]
• 9: Pourang Irani , Maureen Tingley , Colin Ware, Using Perceptual Syntax to Enhance Semantic Content in Diagrams, IEEE Computer Graphics and Applications, v.21 n.5, p.76-85, September 2001
• 10: Lucas Kovar , Michael Gleicher, Automated extraction and parameterization of motions in large data sets, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 11: Lucas Kovar , Michael Gleicher , Frédéric Pighin, Motion graphs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 12: {Koh88} Kohonen T.: Self-organized formation of topologically correct feature maps. Biological Cybernetics 43 (1988), 59--69.
• 13: {Koh90} Kohonen T.: The self-organizing map. Proceedings IEEE 78, 9 (1990), 1464--1480.
• 14: Teuvo Kohonen , T. Kohonen , M. R. Schroeder , T. S. Huang, Self-Organizing Maps, Springer-Verlag New York, Inc., Secaucus, NJ, 2001
• 15: Jehee Lee , Jinxiang Chai , Paul S. A. Reitsma , Jessica K. Hodgins , Nancy S. Pollard, Interactive control of avatars animated with human motion data, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 16: {Mac67} MacQueen J.: Some methods for classification and analysis of multivariate data. In 5th Berkeley Symposium (1967), vol. 1, pp. 281--297.
• 17: J. Marks , B. Andalman , P. A. Beardsley , W. Freeman , S. Gibson , J. Hodgins , T. Kang , B. Mirtich , H. Pfister , W. Ruml , K. Ryall , J. Seims , S. Shieber, Design galleries: a general approach to setting parameters for computer graphics and animation, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.389-400, August 1997 [doi>10.1145/258734.258887]
• 18: Charles Rose , Michael F. Cohen , Bobby Bodenheimer, Verbs and Adverbs: Multidimensional Motion Interpolation, IEEE Computer Graphics and Applications, v.18 n.5, p.32-40, September 1998 [doi>10.1109/38.708559]
• 19: D. A. Rushall , M. R. Ilgen, DEPICT: Documents Evaluated as Pictures. Visualizing information using context vectors and self-organizing maps, Proceedings of the 1996 IEEE Symposium on Information Visualization (INFOVIS '96), p.100, October 28-29, 1996
• 20: {RS00} Roweis S. T., Saul L. K.: Nonlinear dimensionality reduction by locally linear embedding. SCIENCE 290, 22 (2000), 2323--2326.
• 21: {Spe01} Spence R.: Information Visualization. Addison-Wesley, 2001.
• 22: {TdSL00} Tenenbaum J. B., De Silva V., Langford J. C.: A global geometric framework for nonlinear dimensionality reduction. SCIENCE 290, 22 (2000), 2319--2322.
• 23: L. M. Tanco , A. Hilton, Realistic synthesis of novel human movements from a database of motion capture examples, Proceedings of the Workshop on Human Motion (HUMO'00), p.137, December 07-08, 2000
• 24: Munetoshi Unuma , Ken Anjyo , Ryozo Takeuchi, Fourier principles for emotion-based human figure animation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.91-96, September 1995 [doi>10.1145/218380.218419]
• 25: Douglas J. Wiley , James K. Hahn, Interpolation Synthesis of Articulated Figure Motion, IEEE Computer Graphics and Applications, v.17 n.6, p.39-45, November 1997 [doi>10.1109/38.626968]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)