Visualizing web site comparisons

ABSTRACT

The Web is increasingly becoming an important channel for conducting businesses, disseminating information, and communicating with people on a global scale. More and more companies, organizations, and individuals are publishing their information on the Web. With all this information publicly available, naturally companies and individuals want to find useful information from these Web pages. As an example, companies always want to know what their competitors are doing and what products and services they are offering. Knowing such information, the companies can learn from their competitors and/or design countermeasures to improve their own competitiveness. The ability to effectively find such business intelligence information is increasingly becoming crucial to the survival and growth of any company. Despite its importance, little work has been done in this area. In this paper, we propose a novel visualization technique to help the user find useful information from his/her competitors' Web site easily and quickly. It involves visualizing (with the help of a clustering system) the comparison of the user's Web site and the competitor's Web site to find similarities and differences between the sites. The visualization is such that with a single glance, the user is able to see the key similarities and differences of the two sites. He/she can then quickly focus on those interesting clusters and pages to browse the details. Experiment results and practical applications show that the technique is effective.

REFERENCES

• 1: Allan, J., Leouski, A. V. and Swan, R. C. "Interactive Cluster Visualization for Information Retrieval". Tech. Rep. IR-116, Uni. of Mass., Amherst, 1997.
• 2: Ashish, N. and Knoblock, C. "Wrapper Generation for Semi-structured Internet Sources". Workshop on Management of Semistructured Data, Ventana Canyon Resort, Tucson, Arizona. 1997.
• 3: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 4: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 5: Brown, M. H., Marais, H., Najork, M. A. and Weihl, W. E. "Focus+Context Displays of Web Pages: Implementation Alternatives". WWW-6. 1997.
• 6: Igor Cadez , David Heckerman , Christopher Meek , Padhraic Smyth , Steven White, Visualization of navigation patterns on a Web site using model-based clustering, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.280-284, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347151]
• 7: Carey, M., Kriwaczek, F. and Ruger, S. M. "A Visualization Interface for Document Searching and Browsing". Proc of NPIVM 2000, 2000.
• 8: Soumen Chakrabarti , Martin van den Berg , Byron Dom, Focused crawling: a new approach to topic-specific Web resource discovery, Proceeding of the eighth international conference on World Wide Web, p.1623-1640, May 1999, Toronto, Canada
• 9: Chen, Y. F. and Koutsofios, E. "WebCiao: A Website Visualization and Tracking System." WebNet97, 1997.
• 10: D. B. Crouch , C. J. Crouch , G. Andreas, The use of cluster hierarchies in hypertext information retrieval, Proceedings of the second annual ACM conference on Hypertext, p.225-237, November 1989, Pittsburgh, Pennsylvania, United States [doi>10.1145/74224.74243]
• 11: Hasan Davulcu , Juliana Freire , Michael Kifer , I. V. Ramakrishnan, A layered architecture for querying dynamic Web content, Proceedings of the 1999 ACM SIGMOD international conference on Management of data, p.491-502, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States
• 12: Jeffrey Dean , Monika R. Henzinger, Finding related pages in the World Wide Web, Proceeding of the eighth international conference on World Wide Web, p.1467-1479, May 1999, Toronto, Canada
• 13: Fred Douglis , Thomas Ball , Yih-farn Chen , Eleftherios Koutsofios, The AT&T Internet Difference Engine: Tracking and viewing changes on the web, World Wide Web, v.1 n.1, p.27-44, 1998 [doi>10.1023/A:1019243126596]
• 14: Fu, Y., Sandhu, K. and Shih, M Y. "Clustering of Web Users Based on Access Patterns." In Proceedings of the 1999 KDD Workshop on Web Mining. 1999.
• 15: Masum Z. Hasan , Alberto O. Mendelzon , Dimitra Vista, Visual web surfing with Hy⁺, Proceedings of the 1995 conference of the Centre for Advanced Studies on Collaborative research, p.28, November 07-09, 1995, Toronto, Ontario, Canada
• 16: Michael Hersovici , Michal Jacovi , Yoelle S. Maarek , Dan Pelleg , Menanchem Shtalhaim , Sigalit Ur, The shark-search algorithm. An application: tailored Web site mapping, Proceedings of the seventh international conference on World Wide Web 7, p.317-326, April 1998, Brisbane, Australia
• 17: Jason I. Hong , James A. Landay, WebQuilt: a framework for capturing and visualizing the web experience, Proceedings of the 10th international conference on World Wide Web, p.717-724, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372188]
• 18: A. K. Jain , M. N. Murty , P. J. Flynn, Data clustering: a review, ACM Computing Surveys (CSUR), v.31 n.3, p.264-323, Sept. 1999 [doi>10.1145/331499.331504]
• 19: Wen-Syan Li , Junho Shim, Faciliatating complex Web queries through visual user interfaces and query relaxation, Proceedings of the seventh international conference on World Wide Web 7, p.149-159, April 1998, Brisbane, Australia
• 20: Bing Liu , Wynne Hsu , Yiming Ma, Pruning and summarizing the discovered associations, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.125-134, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.312216]
• 21: Bing Liu , Yiming Ma , Philip S. Yu, Discovering unexpected information from your competitors' web sites, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, p.144-153, August 26-29, 2001, San Francisco, California [doi>10.1145/502512.502534]
• 22: Mendelzon, A., Mihaila, G. and Milo, T. "Querying the World Wide Web." International Journal on Digital Libraries, 1(1):54--67, 1997.
• 23: Tamara Munzner , Paul Burchard, Visualizing the structure of the World Wide Web in 3D hyperbolic space, Proceedings of the first symposium on Virtual reality modeling language, p.33-38, December 13-15, 1995, San Diego, California, United States [doi>10.1145/217306.217311]
• 24: Marc Najork , Janet L. Wiener, Breadth-first crawling yields high-quality pages, Proceedings of the 10th international conference on World Wide Web, p.114-118, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.371965]
• 25: Balaji Padmanabhan , Alexander Tuzhilin, Small is beautiful: discovering the minimal set of unexpected patterns, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.54-63, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347103]
• 26: Yannis Papakonstantinou , Ashish Gupta , Hector Garcia-Molina , Jeffrey D. Ullman, A Query Translation Scheme for Rapid Implementation of Wrappers, Proceedings of the Fourth International Conference on Deductive and Object-Oriented Databases, p.161-186, December 04-07, 1995
• 27: Piatesky-Shapiro, G. and Matheus, C. "The Interestingness of Deviations". KDD-94. 1994.
• 28: Anthony S. Ruocco , Ophir Frieder, Clustering and classification of large document bases in a parallel environment, Journal of the American Society for Information Science, v.48 n.10, p.932-943, Oct. 1997 [doi>10.1002/(SICI)1097-4571(199710)48:10<932::AID-ASI7>3.0.CO;2-2]
• 29: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 30: Marc M. Sebrechts , John V. Cugini , Sharon J. Laskowski , Joanna Vasilakis , Michael S. Miller, Visualization of search results: a comparative evaluation of text, 2D, and 3D interfaces, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.3-10, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312634]
• 31: Avi Silberschatz , Alexander Tuzhilin, What Makes Patterns Interesting in Knowledge Discovery Systems, IEEE Transactions on Knowledge and Data Engineering, v.8 n.6, p.970-974, December 1996 [doi>10.1109/69.553165]
• 32: Steinbach, M., Karypis, G. and Kumar, V. "A Comparison of Document Clustering Techniques". In KDD Workshop on Text Mining, 2000.
• 33: George M. Underwood , Paul P. Maglio , Rob Barrett, User-centered push for timely information delivery, Proceedings of the seventh international conference on World Wide Web 7, p.33-41, April 1998, Brisbane, Australia
• 34: Oren Zamir , Oren Etzioni, Grouper: a dynamic clustering interface to Web search results, Proceeding of the eighth international conference on World Wide Web, p.1361-1374, May 1999, Toronto, Canada

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Architectures

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation; User issues; Theory

General Terms:
Algorithms, Design, Human Factors

Keywords:
browsing, business intelligence, user-interface, visualization, web site comparison