Searching the workplace web

ABSTRACT

The social impact from the World Wide Web cannot be underestimated, but technologies used to build the Web are also revolutionizing the sharing of business and government information within intranets. In many ways the lessons learned from the Internet carry over directly to intranets, but others do not apply. In particular, the social forces that guide the development of intranets are quite different, and the determination of a "good answer" for intranet search is quite different than on the Internet. In this paper we study the problem of intranet search. Our approach focuses on the use of rank aggregation, and allows us to examine the effects of different heuristics on ranking of search results.

REFERENCES

• 1: James Allan, Margaret E. Connel, W. Bruce Croft, Fang-Fang Feng, David Fisher, and Zioayan Li. INQUERY and TREC-9. http://trec.nist.gov/pubs/trec9/papers/umass-trec9.pdf In Proc. 9th TREC, pages 551--562, 2000.
• 2: Kenneth J. Arrow. Social Choice and Individual Values. Yale University Press, New Haven, 2nd edition, 1963.
• 3: Javed A. Aslam , Mark Montague, Models for metasearch, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.276-284, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384007]
• 4: Lauren A. Bednarcyk and Kevin D. Bond. A local web for information delivery http://archive.ncsa.uiuc.edu/SDG/IT94/Proceedings/CorInfSys/bednarcyk/bednarcyk.html. In Proc. 2nd WWW, 1994.
• 5: Krishna Bharat , Monika R. Henzinger, Improved algorithms for topic distillation in a hyperlinked environment, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.104-111, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290972]
• 6: A. Rosina Bignall, Dalinda Kae Bond, Judy Cossel Rice, and Phllip J. Windley. Uses of Mosaic in a university setting http://archive.ncsa.uiuc.edu/SDG/IT94/Proceedings/Educ/rice.university/article.html. In Proc. 2nd WWW, 1994.
• 7: Sergey Brin and Lawrence Page. The anatomy of a large-scale hypertextual web search engine. http://www7.scu.edu.au/programme/fullpapers/1921/com1921.htm pages 107--117, 1998.
• 8: Andrei Broder , Ravi Kumar , Farzin Maghoul , Prabhakar Raghavan , Sridhar Rajagopalan , Raymie Stata , Andrew Tomkins , Janet Wiener, Graph structure in the Web, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.309-320, June 2000, Amsterdam, The Netherlands
• 9: Andrei Z. Broder , Steven C. Glassman , Mark S. Manasse , Geoffrey Zweig, Syntactic clustering of the Web, Computer Networks and ISDN Systems, v.29 n.8-13, p.1157-1166, Sep. 1997
• 10: Soumen Chakrabarti , Byron Dom , Prabhakar Raghavan , Sridhar Rajagopalan , David Gibson , Jon Kleinberg, Automatic resource compilation by analyzing hyperlink structure and associated text, Proceedings of the seventh international conference on World Wide Web 7, p.65-74, April 1998, Brisbane, Australia
• 11: Soumen Chakrabarti, Byron E. Dom, David Gibson, Ravi Kumar, Prabhakar Raghavan, Sridhar Rajagopalan, and Andrew Tomkins. Experiments in topic distillation http://www.almaden.ibm.com/cs/k53/abstract.html. In SIGIR Workshop on Hypertext Information Retrieval, pages 13--21, 1998.
• 12: Mike Crandall , Mark C. Swenson, Integrating electronic information through a corporate Web, Proceedings of the fifth international World Wide Web conference on Computer networks and ISDN systems, p.1175-1186, May 1996, Paris, France
• 13: W. Bruce Croft. Combining approaches to information retrieval. In W. Bruce Croft, editor, Advances in Information Retrieval. Kluwer Academic Publishers, 2000.
• 14: Stephen Dill , Ravi Kumar , Kevin S. McCurley , Sridhar Rajagopalan , D. Sivakumar , Andrew Tomkins, Self-similarity in the Web, Proceedings of the 27th International Conference on Very Large Data Bases, p.69-78, September 11-14, 2001
• 15: Chris Ding , Xiaofeng He , Parry Husbands , Hongyuan Zha , Horst D. Simon, PageRank, HITS and a unified framework for link analysis, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564440]
• 16: Cynthia Dwork , Ravi Kumar , Moni Naor , D. Sivakumar, Rank aggregation methods for the Web, Proceedings of the 10th international conference on World Wide Web, p.613-622, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372165]
• 17: Ronald Fagin , Ravi Kumar , D. Sivakumar, Comparing top k lists, Proceedings of the fourteenth annual ACM-SIAM symposium on Discrete algorithms, January 12-14, 2003, Baltimore, Maryland
• 18: Shannon L. Fowler , Anne-Marie J. Novack , Michael J. Stillings, The evolution of a manufacturing Web site, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.365-376, June 2000, Amsterdam, The Netherlands
• 19: Eric J. Glover , Kostas Tsioutsiouliklis , Steve Lawrence , David M. Pennock , Gary W. Flake, Using web structure for classifying and describing web pages, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511520]
• 20: Djoerd Hiemstra. Using Language Models for Information Retrieval http://wwwhome.cs.utwente.nl/~hiemstra/papers/thesis.pdf. PhD thesis, University of Twente, Twente, The Netherlands, 2001.
• 21: M. Huynh, L. Popkin, and M. Stecker. Constructing a corporate memory infrastructure from internet discovery technologies http://archive.ncsa.uiuc.edu/SDG/IT94/Proceedings/CorInfSys/huynh/cmi.html. In Proc. 2nd WWW, 1994.
• 22: Vlad Ionesco, Using an intranet for real-time production management: experiences and effects, Proceedings of the seventh international conference on World Wide Web 7, p.479-488, April 1998, Brisbane, Australia
• 23: Rong Jin , Alex G. Hauptmann , Cheng Xiang Zhai, Title language model for information retrieval, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564386]
• 24: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Journal of the ACM (JACM), v.46 n.5, p.604-632, Sept. 1999 [doi>10.1145/324133.324140]
• 25: Wessel Kraaij , Thijs Westerveld , Djoerd Hiemstra, The Importance of Prior Probabilities for Entry Page Search, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564383]
• 26: Mark Montague , Javed A. Aslam, Condorcet fusion for improved retrieval, Proceedings of the eleventh international conference on Information and knowledge management, November 04-09, 2002, McLean, Virginia, USA [doi>10.1145/584792.584881]
• 27: Marc Najork , Janet L. Wiener, Breadth-first crawling yields high-quality pages, Proceedings of the 10th international conference on World Wide Web, p.114-118, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.371965]
• 28: Steve Pavett , Nihal Samarawera , Neil M. Hamilton , Gorry Fairhurst, Video Medi-CAL: supporting MPEG-2 media based computer assisted learning on an intranet, Proceedings of the seventh international conference on World Wide Web 7, p.672-675, April 1998, Brisbane, Australia
• 29: Kaitlin Duck Sherwood. Technical and sociological aspects of developing campus-wide webs: UIUC college of engineering http://archive.ncsa.uiuc.edu/SDG/IT94/Proceedings/Campus.Infosys/sherwood/sherwood.html. In Proc. 2nd WWW, 1994.
• 30: Thijs Westerveld, Wessel Kraaij, and Djoerd Hiemstra. Retrieving web pages using content, links, URLs and anchors http://trec.nist.gov/pubs/trec10/papers/TNO-UTwente-trec10-final.pdf. In Proc. 10th TREC, pages 663--672, 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Experimentation, Measurement