Pollock: automatic generation of virtual web services from web sites

ABSTRACT

As the usage of Web Services proliferates dramatically, new tools to help quickly generate web services are needed. In this paper, we propose a methodology that helps to automatically generate Web Services from the FORM-based query interfaces of a web site. Since the majority of web data are rather "hidden" behind such a FORM interface, we believe turning such a human-oriented query interface into machine-oriented web services is an important problem. Toward this goal, we adopt the Wrapper technology successfully developed and deployed in Database community, and demonstrate how to generate Web Services components (e.g., WSDL, UDDI, SOAP) automatically. We present the overall architecture of our developed prototype and a few showcases based on real web sites.

REFERENCES

• 1: Amazon. "Amazon.com Web Services 2.0". Web page, 2002. http://www.amazon.com/gp/aws/landing.html.
• 2: T. Berners-Lee, J. Hendler, and O. Lassila. "The Semantic Web". Scientific American, May 2001. http://www.sciam.com/issue.cfm?issuedate=May-01.
• 3: Joe Clabby, Web Services Explained: Solutions and Applications for the Real World, Prentice Hall PTR, Upper Saddle River, NJ, 2002
• 4: Hector Garcia-Molina , Yannis Papakonstantinou , Dallan Quass , Anand Rajaraman , Yehoshua Sagiv , Jeffrey Ullman , Vasilis Vassalos , Jennifer Widom, The TSIMMIS Approach to Mediation: Data Models and Languages, Journal of Intelligent Information Systems, v.8 n.2, p.117-132, March/April 1997 [doi>10.1023/A:1008683107812]
• 5: Daniela Florescu , Alon Levy , Alberto Mendelzon, Database techniques for the World-Wide Web: a survey, ACM SIGMOD Record, v.27 n.3, p.59-74, Sept. 1, 1998 [doi>10.1145/290593.290605]
• 6: S. Ghandeharizadeh, C. A. Knoblock, C. Papadopoulos, C. Shahabi, E. Alwagait, J. L. Ambite, M. Cai, C.-C. Chen, P. Pol, R. Schmidt, S. Song, S. Thakkar, and R. Zhou. "Proteus: A System for Dynamically Composing and Intelligently Executing Web Services". In Int'l Conf. on Web Services (ICWS), Las Vegas, CA, Jun. 2003.
• 7: Google. "Google Web APIs". Web page, 2002. http://www.google.com/apis/.
• 8: Jean-Robert Gruser , Louiqa Raschid , M. E. Vidal , Laura Bright, Wrapper Generation for Web Accessible Data Sources, Proceedings of the 3rd IFCIS International Conference on Cooperative Information Systems, p.14-23, August 20-22, 1998
• 9: Y. Hong, B.-W. On, and D. Lee. "System Support for Name Authority Control Problem in Digital Libraries: OpenDBLP Approach". In European Conf. on Digital Libraries (ECDL), Bath, UK, Sep. 2004.
• 10: IBM. "IBM WebSphere Studio". Web page, 2002. http://www- 3.ibm.com/software/webservers/studio/index.html.
• 11: T. Kirk, A. Y. Levy, Y. Sagiv, and D. Srivastava. "The Information Manifold". In AAAI Symp. on Information Gathering, 1995.
• 12: C. A. Knoblock and S. Minton. "The Ariadne Approach to Web-based Information Integration". IEEE Intelligent System, 13(5), 1998.
• 13: N. Kushmerick, R. Doorenbos, and D. Weld. "Wrapper Induction for Information Extraction". In AAAI IJCAI, 1995.
• 14: C. Lau and A. Ryman. "Developing XML Web services with WebSphere Studio Application Developer". IBM Systems J., 41(2):178--197, 2002.
• 15: L. Liu, C. Pu, and W. Han. "XWRAP: An XML-enabled Wrapper Construction System for Web Information Sources". In IEEE ICDE, San Diego, CA, Feb. 2000.
• 16: T. Malik, A. S. Szalay, T. Budavari, and A. R. Thakar. "SqkQuery: A Web Service Approach to Federate Databases". In Biennial Conference on Innovative Data Systems Reserch (CIDR), Asilomar, CA, Jan. 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.5 Heterogeneous Databases

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.0 General

Keywords:
translation, web services, wrappers