Query optimization for vector space problems

ABSTRACT

We present performance measurement results for a parallel SQL based information retrieval system implemented on a PC cluster system. We used the Web-TREC dataset under a left-deep query execution plan. We achieved satisfactory speed up.

REFERENCES

• 1: O. Frieder,A.Chowdhury,D.Grossman,and M.C. McCabe.On the integration of structured data and text:A review of the SIRE architecture.In DELOS Workshop on Information Seeking, Searching, and Querying in Digital Libraries December 2000.
• 2: T. Grabs,K.Boehm,and H.-J.Schek.A parallel document engine built on top of a cluster of databases - design,implementation,and experiences.In IEEE Data Engineering Conference April 2001.
• 3: David A. Grossman , Ophir Frieder , David O. Holmes , David C. Roberts, Integrating structured data and text: a relational approach, Journal of the American Society for Information Science, v.48 n.2, p.122-132, Feb. 1997 [doi>10.1002/(SICI)1097-4571(199702)48:2<122::AID-ASI3>3.0.CO;2-#]
• 4: Amit Singhal , Chris Buckley , Mandar Mitra, Pivoted document length normalization, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.21-29, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243206]
• 5: Takayuki Tamura , Masato Oguchi , Masaru Kitsuregawa, Parallel database processing on a 100 Node PC cluster: cases for decision support query processing and data mining, Proceedings of the 1997 ACM/IEEE conference on Supercomputing (CDROM), p.1-16, November 15-21, 1997, San Jose, CA [doi>10.1145/509593.509642]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

Additional Classification:
  G. Mathematics of Computing
  G.4 MATHEMATICAL SOFTWARE
      Subjects: Parallel and vector implementations

  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Query processing
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

General Terms:
Design, Experimentation, Performance