Categorizing web queries

ABSTRACT

Over the past ten years, the user base for the World Wide Web (WWW) has grown over 400% [1]. This increased user base has naturally led to an enormous amount of data available for users to search. Corporations, such as Google, often store user search records and there are many concerns, as well as positive aspects, for how search records may be used. One aspect in particular, categorizing web queries, presents several challenges. This paper will discuss the challenging aspects of categorizing web queries, review previous categorical research, and conclude with a method for tackling one of the challenging aspects.

REFERENCES

• 1: "Internet Penetration and Impact," http://www.pewinternet.org/PPF/r/182/report_display.asp, April 26, 2006.
• 2: "CNBC Special Report: Big Brother, Big Business - Technology is being used to monitor Americans more than ever before," http://www.msnbc.msn.com/id/15519811, November 6, 2006.
• 3: "Murder in the moonlight", http://www.msnbc.msn.com/id/14738060/page/3/, September 8, 2006.
• 4: Steven M. Beitzel , Eric C. Jensen , David D. Lewis , Abdur Chowdhury , Ophir Frieder, Automatic classification of Web queries using very large unlabeled query logs, ACM Transactions on Information Systems (TOIS), v.25 n.2, p.9-es, April 2007 [doi>10.1145/1229179.1229183]
• 5: "AOL search data mirrors", http://www.gregsadetsky.com/aol-data/
• 6: "Click Through Rate of Google Search Results - AOL-data.tgz - Want to Know How Many Clicks The #1 Google Position Gets?", http://www.redcardinal.ie/search-engine-optimisation/12-08-2006/clickthrough-analysis-of-aol-datatgz/
• 7: "Leaked AOL data: the importance of top search engine rankings", http://www.free-seo-news.com/newsletter226.htm
• 8: "AOL Proudly Releases Massive Amounts of Private Data", http://www.techcrunch.com/2006/08/06/aol-proudly-releases-massive-amounts-of-user-search-data/
• 9: "AOL Gate: Search Query Data Scandal", http://elliottback.com/wp/archives/2006/08/07/aol-gate-search-query-data-scandal/
• 10: "KDD Cup 2005", http://www.sigkdd.org/kdd2005/kddcup.html
• 11: "ODP -- Open Directory Project", http://www.dmoz.org
• 12: "The world's most popular open source database", http://www.mysql.com/
• 13: "The Apache Software Foundation", www.apache.org/
• 14: "ActiveState - ActivePerl - The complete and ready-to-install Perl distribution. - Dynamic Tools for Dynamic Languages", www.activestate.com/ActivePerl/
• 15: "DBD::mysql - MySQL driver for the Perl5 Database Inter-face (DBI)", http://search.cpan.org/dist/DBD-mysql/lib/DBD/mysql.pm

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Query processing

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Design, Experimentation, Measurement, Performance

Keywords:
categorization, data mining, information retrieval, query categorization, search, text classification, text mining