Semantic deep web: automatic attribute extraction from the deep web data sources

ABSTRACT

"Deep Web" refers to the rich information and data hidden in backend databases, etc., that search engines or Web crawlers cannot access. It is mostly accessible through manual query interfaces. This paper introduces the Semantic Deep Web, utilizing an ontology to determine relevance of query interface attributes to access the Deep Web. In addition, we present a novel approach to automatically extracting attributes from query interfaces in order to address the current limitations in accessing Deep Web data sources. Our Automatic Attribute Extraction method (1) identifies attributes that are used by query Web page designers, called Programmer Viewpoint Attributes, and (2) attributes that are presented as labels to users, called User Viewpoint Attributes. An ontology enriches the candidate query attributes by providing synonyms and by supporting the attributes used by designers and users. Our experimental results in several e-commerce domains show that the attributes obtained by our algorithm compare favorably with manually determined attributes to be used for Deep Web queries.

REFERENCES

• 1: Munindar P. Singh, Deep Web Structure, IEEE Internet Computing, v.6 n.5, p.4-5, September 2002 [doi>10.1109/MIC.2002.1036032]
• 2: Thanaa M. Ghanem , Walid G. Aref, Databases Deepen the Web, Computer, v.37 n.1, p.116-117, January 2004 [doi>10.1109/MC.2004.1260731]
• 3: UC Berkeley. Invisible or Deep Web: What it is, Why it exists, How to find it, and Its inherent ambiguity. Available at http://www.lib.berkeley.edu/TeachingLib/Guides/Internet/InvisibleWeb.html, July 2006.
• 4: M. K. Bergman, The Deep Web: Surfacing Hidden Value. Available at http://www.brightplanet.com/resources/details/deepweb.html, May 2006.
• 5: Govind Kabra , Chengkai Li , Kevin Chen-Chuan Chang, Query Routing: Finding Ways in the Maze of the DeepWeb, Proceedings of the International Workshop on Challenges in Web Information Retrieval and Integration, p.64-73, April 08-09, 2005
• 6: Arvind Arasu , Hector Garcia-Molina , Stanford University, Extracting structured data from Web pages, Proceedings of the 2003 ACM SIGMOD international conference on Management of data, June 09-12, 2003, San Diego, California [doi>10.1145/872757.872799]
• 7: Sriram Raghavan , Hector Garcia-Molina, Crawling the Hidden Web, Proceedings of the 27th International Conference on Very Large Data Bases, p.129-138, September 11-14, 2001
• 8: T. Berners-Lee, J. Hendler, and O. Lassila. The Semantic Web. Scientific American, 284, 5 (May 2001), 34--43.
• 9: W. Wu, A. Doan, C. Yu and W. Meng. Bootstrapping Domain Ontology for Semantic Web Services from Source Web Sites. In Proceedings of the 6th VLDB workshop on Technologies for E-Services (TES-05) (Trondheim, Norway, Sep. 2--3, 2005). ACM press, Sep. 2005, 11--12.
• 10: Hasan Davulcu , Srinivas Vadrevu , Saravanakumar Nagarajan , I. V. Ramakrishnan, OntoMiner: Bootstrapping and Populating Ontologies from Domain-Specific Web Sites, IEEE Intelligent Systems, v.18 n.5, p.24-33, September 2003 [doi>10.1109/MIS.2003.1234766]
• 11: George A. Miller, WordNet: a lexical database for English, Communications of the ACM, v.38 n.11, p.39-41, Nov. 1995 [doi>10.1145/219717.219748]
• 12: Giannis Varelas , Epimenidis Voutsakis , Paraskevi Raftopoulou , Euripides G.M. Petrakis , Evangelos E. Milios, Semantic similarity methods in wordNet and their application to information retrieval on the web, Proceedings of the 7th annual ACM international workshop on Web information and data management, November 04-04, 2005, Bremen, Germany [doi>10.1145/1097047.1097051]
• 13: K. C. Chang, B. He, C. Li and Z. Zhang. The UIUC web integration repository. Computer Science Department, University of Illinois at Urbana-Champaign. Available at http://metaquerier.cs.uiuc.edu/repository/, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.7 Database Administration

General Terms:
Design, Management

Keywords:
automatic attribute extraction, deep web, semantic deep web, semantic web