A flight meta-search engine with metamorph

ABSTRACT

We demonstrate a flight meta-search engine that is based on the Metamorph framework. Metamorph provides mechanisms to model web forms together with the interactions which are needed to fulfil a request, and can generate interaction sequences that pose queries using these web forms and collect the results. In this paper, we discuss an interesting new feature that makes use of the forms themselves as an information source. We show how data can be extracted from web forms (rather than the data behind web forms) to generate a graph of flight connections between cities.

The flight connection graph allows us to vastly reduce the number of queries that the engine sends to airline websites in the most interesting search scenarios; those that involve the controversial practice of creative ticketing, in which agencies attempt to find lower price fares by using more than one airline for a journey. We describe a system which attains data from a number of websites to identify promising routes and prune the search tree. Heuristics that make use of geographical information and an estimation of cost based on historical data are employed. The results are then made available to improve the quality of future search requests.

REFERENCES

• 1: Metamorph, A Framework for Automated Ontology-driven Metasearch Generation (2008), Technical Report TR-DBAI-2008-3
• 2: Hai He , Weiyi Meng , Clement Yu , Zonghuan Wu, Wise-integrator: an automatic integrator of web search interfaces for E-commerce, Proceedings of the 29th international conference on Very large data bases, p.357-368, September 09-12, 2003, Berlin, Germany
• 3: Bin He , Zhen Zhang , Kevin Chen-Chuan Chang, Towards Building a MetaQuerier: Extracting and Matching Web Query Interfaces, Proceedings of the 21st International Conference on Data Engineering, p.1098-1099, April 05-08, 2005 [doi>10.1109/ICDE.2005.145]
• 4: Wolfgang Holzinger , Bernhard Kruepl , Robert Baumgartner, Exploiting semantic web technologies to model web form interactions, Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China [doi>10.1145/1367497.1367698]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software

General Terms:
Algorithms, Design, Experimentation

Keywords:
hidden web, web data extraction, web form extraction, web form mapping