Strategies for lifelong knowledge extraction from the web

ABSTRACT

The increasing availability of electronic text has made it possible to acquire information using a variety of techniques that leverage the expertise of both humans and machines. In particular, the field of Information Extraction (IE), in which knowledge is extracted automatically from text, has shown promise for large-scale knowledge acquisition. While IE systems can uncover assertions about individual entities with an increasing level of sophistication,alltext understanding -- the formation of a coherent theory from a textual corpus -- involves representation and learning abilities not currently achievable by today's IE systems. Compared to individual relational assertions outputted by IE systems, a theory includes coherent knowledge of abstract concepts and the relationships among them. We believe that the ability to fully discover the richness of knowledge present within large, unstructured and heterogeneous corpora will require a lifelong learning process in which earlier learned knowledge is used to guide subsequent learning. This paper introduces Alice, a lifelong learning agent whose goal is to automatically discovera collection of concepts, facts and generalizations that describe a particular topic of interest directly from a large volume of Web text. Building upon recent advances in unsupervised information extraction, we demonstrate that Alice can iteratively discover new concepts and compose general domain knowledge with a precision of 78%.

REFERENCES

• 1: M. Banko, M. Cararella, S. Soderland, M. Broadhead, and O. Etzioni. Open information extraction from the web. In Procs. of IJCAI, 2007.
• 2: Stephen Clark , David Weir, Class-based probability estimation using a semantic hierarchy, Computational Linguistics, v.28 n.2, p.187-206, June 2002 [doi>10.1162/089120102760173643]
• 3: D. Downey, O. Etzioni, and S. Soderland. A probabilistic model of redundancy in information extraction. In Procs. of IJCAI 2005, 2005.
• 4: O. Etzioni, M. Banko, and M. Cafarella. Machine reading. In AAAI, 2006.
• 5: Oren Etzioni , Michael Cafarella , Doug Downey , Ana-Maria Popescu , Tal Shaked , Stephen Soderland , Daniel S. Weld , Alexander Yates, Unsupervised named-entity extraction from the web: an experimental study, Artificial Intelligence, v.165 n.1, p.91-134, June 2005 [doi>10.1016/j.artint.2005.03.001]
• 6: D. Lenat. Automated theory formation in mathematics. In Procs. of IJCAI, 1977.
• 7: Maria Liakata , Stephen Pulman, Learning theories from text, Proceedings of the 20th international conference on Computational Linguistics, p.183-es, August 23-27, 2004, Geneva, Switzerland [doi>10.3115/1220355.1220382]
• 8: J. B. MacQueen. Some methods for classification and analysis of multivariate observations. In Proc. of 5th Berkeley Symposium on Mathematical Statistics and Probability, 1967.
• 9: T. Mitchell. Reading the web: A breakthrough goal for AI. In AI Magazine. AAAI Press, 2005.
• 10: Mark B. Ring, CHILD: A First Step Towards Continual Learning, Machine Learning, v.28 n.1, p.77-104, July 1997 [doi>10.1023/A:1007331723572]
• 11: Lenhart Schubert , Matthew Tong, Extracting and evaluating general world knowledge from the Brown corpus, Proceedings of the HLT-NAACL 2003 workshop on Text meaning, p.7-13, May 31, 2003 [doi>10.3115/1119239.1119241]
• 12: Y. Shinyama and S. Sekine. Preemptive information extraction using unrestricted relation
• 13: Peter Stone , Manuela M. Veloso, Layered Learning, Proceedings of the 11th European Conference on Machine Learning, p.369-381, May 31-June 02, 2000
• 14: Fabian M. Suchanek , Gjergji Kasneci , Gerhard Weikum, Yago: a core of semantic knowledge, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242667]
• 15: A. Teller. Exegesis. Random House, 1999.
• 16: Sebastian Thrun, Lifelong learning algorithms, Learning to learn, Kluwer Academic Publishers, Norwell, MA, 1998
• 17: S. Thrun and T. Mitchell. Lifelong robot learning. Robotics and Autonomous Systems, 15:25--46, 1995.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning
          Subjects: Knowledge acquisition

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.8 Problem Solving, Control Methods, and Search
          Subjects: Control theory

General Terms:
Algorithms

Keywords:
lifelong learning, machine reading