Constraint-based conversion of fiction text to a time-based graphical representation

ABSTRACT

This paper presents a method for converting unrestricted fiction text into a time-based graphical form. Key concepts extracted from the text are used to formulate constraints describing the interaction of entities in a scene. The solution of these constraints over their respective time intervals provides the trajectories for these entities in a graphical representation.

Three types of entity are extracted from fiction books to describe the scene, namely Avatars, Areas and Objects. We present a novel method for modeling the temporal aspect of a fiction story using multiple time-line representations after which the information extracted regarding entities and time-lines is used to formulate constraints. A constraint solving technique based on interval arithmetic is used to ensure that the behaviour of the entities satisfies the constraints over multiple universally quantified time intervals. This approach is demonstrated by finding solutions to multiple time-based constraints, and represents a new contribution to the field of Text-to-Scene conversion. An example of the automatically produced graphical output is provided in support of our constraint-based conversion scheme.

REFERENCES

• 1: Ola Åkerberg , Hans Svensson , Bastian Schulz , Pierre Nugues, CarSim: an automatic 3D text-to-scene conversion system applied to road accident reports, Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics, April 12-17, 2003, Budapest, Hungary [doi>10.3115/1067737.1067782]
• 2: Frédéric Benhamou , Frédéric Goualard , Laurent Granvilliers , Jean-François Puget, Revising hull and box consistency, Proceedings of the 1999 international conference on Logic programming, p.230-244, November 1999, Las Cruces, New Mexico, United States
• 3: Frédéric Benhamou , Frédéric Goualard , Éric Languénou, , Marc Christie, Interval constraint solving for camera control and motion planning, ACM Transactions on Computational Logic (TOCL), v.5 n.4, p.732-767, October 2004 [doi>10.1145/1024922.1024927]
• 4: F. Benhamou , D. McAllester , P. van Hentenryck, CLP(intervals) revisited, Proceedings of the 1994 International Symposium on Logic programming, p.124-138, November 1994, Symposia, Melbourne
• 5: Sharon R. Clay and Jane Wilhelms. Put: Language-based interactive manipulation of objects. IEEE Computer Graphics and Applications, pages 31--39, March 1996.
• 6: Bob Coyne , Richard Sproat, WordsEye: an automatic text-to-scene conversion system, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.487-496, August 2001 [doi>10.1145/383259.383316]
• 7: Christiane Fellbaum, editor. WordNet: An Electronic Lexical Database. MIT Press, 1998.
• 8: Kevin Glass , Shaun Bangay, Hierarchical rule generalisation for speaker identification in fiction books, Proceedings of the 2006 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries, p.31-40, October 09-11, 2006, Somerset West, South Africa [doi>10.1145/1216262.1216266]
• 9: Frank Jardillier and Eric Languénou. Screen-space constraints for camera movements: the virtual cameraman. Computer Graphics Forum, 17(3):175--186, 1998.
• 10: Richard Johansson, Anders Berglund, Magnus Danielsson, and Pierre Nugues. Automatic text-to-scene conversion in the traffic accident domain. In IJCAI-05, Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, pages 1073--1078, Edinburgh, Scotland, July 2005.
• 11: Automatic generation of computer animation: using AI for movie animation, Springer-Verlag, London, 2002
• 12: Minhua Ma and Paul McKevitt. Using lexical knowledge of verbs in language-to-vision applications. In Proceedings of the 15th Artificial Intelligence and Cognitive Science Conference (AICS 2004), Castlebar, Ireland, September 2004.
• 13: Minhua Eunice Ma. CONFUCIUS: An intelligent multimedia storytelling interpretation and presentation system. Technical report, School of Computing and Intelligent Systems, University of Ulster, Magee, September 2002.
• 14: Marvin Minsky. A framework for representing knowledge, chapter 6, pages 211--277. The Psychology of Computer Vision. McGraw-Hill, Inc., 1975.
• 15: Ramon E. Moore. Interval Analysis. Prentice-Hall, Inc., 1966.
• 16: F. K. Musgrave , C. E. Kolb , R. S. Mace, The synthesis and rendering of eroded fractal terrains, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.41-50, July 1989
• 17: A. Narayanan , D. Manuel , L. Ford , D. Tallis , M. Yazdani, Language visualisation: applications and theoretical foundations of a primitive-based approach, Artificial Intelligence Review, v.9 n.2-3, p.215-235, June 1995 [doi>10.1007/BF00849181]
• 18: Arnold Neumaier. Interval Methods for Systems of Equations, volume 37 of Encyclopedia of Mathematics and its Applications. Cambridge Univ. Press, Cambridge, 1990.
• 19: Yoav I. H. Parish , Pascal Müller, Procedural modeling of cities, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.301-308, August 2001 [doi>10.1145/383259.383292]
• 20: Roger C. Schank, The fourteen primitive actions and their inferences., Stanford University, Stanford, CA, 1973
• 21: Hans Svensson and Ola Akerberg. Development and integration of linguistic components for an automatic text-to-scene conversion system. Master's thesis, Lund Institute of Technology, 2002.
• 22: Nina Wacholder , Yael Ravin , Misook Choi, Disambiguation of proper names in text, Proceedings of the fifth conference on Applied natural language processing, p.202-208, March 31-April 03, 1997, Washington, DC [doi>10.3115/974557.974587]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Language parsing and understanding

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Keywords:
constraint solving, interval arithmetic, interval constraint solving, text-to-scene, text-to-scene conversion