A study on a geometry transformation method for a geometry and scene modeler by a verbal interface

ABSTRACT

The authors have developed a modeling system Do in three dimensional computer graphics (3D-CG) that, by verbal instructions in natural language, models geometrical shapes and renders the images. The former system is based on a step-by-step construction scheme using static instructions and a static display, that is, a static verbal instruction creates a static scene and an image. This static-based system scheme has a critical limitation at the conversation stage between a user and the system. In this paper, the authors propose a dynamic instruction and dynamic display methods for the modeling system. First, the dynamic display enables users to watch the animation indicating the change between the previous geometries and the next geometries with smooth transition during the execution of an instruction from the user. Second, the dynamic instruction enables users to give the next instruction before the animation ends. For those purposes, two geometrical transformation methods by affine transformation: (a) with a common difference matrix, and (b) with a common ratio matrix, are introduced and studied to generate frames for the animation. The proposed methods are implemented and evaluated by some experiments. The changes between instructions are observed naturally by the common ratio matrix method.

REFERENCES

• 1: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, Proceedings of the 7th annual conference on Computer graphics and interactive techniques, p.262-270, July 14-18, 1980, Seattle, Washington, United States
• 2: Cynthia Breazeal, Emotion and sociable humanoid robots, International Journal of Human-Computer Studies, v.59 n.1-2, p.119-155, July 2003 [doi>10.1016/S1071-5819(03)00018-1]
• 3: James H. Clark, Designing surfaces in 3-D, Communications of the ACM, v.19 n.8, p.454-460, Aug. 1976 [doi>10.1145/360303.360329]
• 4: Clay, S., and Wilhelms, J. 1996. Language-Based Interactive Manipulation of Objects. IEEE Computer Graphics and Applications.
• 5: H. Nishiyama, T. O., and Matsusita, Y. 1997. A Language Creation from a Scene Descriptive Sentence. Trans. Information Processing Society Japan.
• 6: Jeff Butterworth , Andrew Davidson , Stephen Hench , Marc. T. Olano, 3DM: a three dimensional modeler using a head-mounted display, Proceedings of the 1992 symposium on Interactive 3D graphics, p.135-138, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147182]
• 7: Doris H. U. Kochanek , Richard H. Bartels, Interpolating splines with local tension, continuity, and bias control, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.33-41, January 1984
• 8: Kozima, H., and Zlatev, J. 2000. An epigenetic Approach to Human-robot Communication. IEEE Int'l Workshop on Robot and Human Interactive Communication.
• 9: M. Yokota, M. S., and Capi, G. 2005. Human-robot Communication through a Mind model based on the Mental Image Directed Semantic Theory. Proc. of the 10th Int'l Symposium on Artificial Life and Robotics.
• 10: S. Miyazaki, J. Shen, T. Y. M. K. T. A., and Yasuda, H. 2003. A System from Script to Motion Picture. Int'l Conf. on Computer Communication and Control Technologies.
• 11: S. Mizuno, M. O., and Toriwaki, J. 1999. An Interactive Designing System with Virtual Sculpting and Virtual Woodcut Printing. Computer Graphics Forum.
• 12: Sekine, S., and Grishman, R. 1995. A Corpus-based Probabilistic Grammar with Only Two Non-terminals. Proc. of IWPT - 4th Int'l Workshop on Parsing Technologies.
• 13: Wolf, W. 1996. Key Frame Selection by Motion Analysis. Proc. of Int'l Conf. on Acoustics, Speech, and Signal Processing.
• 14: Y. Kawai, Y. Higashiyama, K. K., and Okada, M. 1996. A Fundamental Study on a Natural-Language-Based 3DCG Modeling. Proc. of SMC'99 - 1999 IEEE Systems, Man, and Cybernetics Conference.
• 15: Y. Zhuang, Y. Rui, T. H., and Mehrotra, S. 1998. Adaptive key frame extraction using unsupervised clustering. IEEE Int'l Conf. on Image Process.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Hierarchy and geometric transformations

Keywords:
animation, computer graphics, geometry transformation, modeler, natural language