A model for fast web mining prototyping

ABSTRACT

Web mining is a computation intensive task, even after the mining tool itself has been developed. Most mining software are developed ad-hoc and usually are not scalable nor reused for other mining tasks. The objective of this paper is to present a model for fast Web mining prototyping, referred to as WIM -- Web Information Mining. The underlying conceptual model of WIM provides its users with a level of abstraction appropriate for prototyping and experimentation throughout the Web data mining task. Abstracting from the idiosyncrasies of raw Web data representations facilitates the inherently iterative mining process. We present the WIM conceptual model, its associated algebra, and the WIM tool software architecture, which implements the WIM model. We also illustrate how the model can be applied to real Web data mining tasks. The experimentation of WIM in real use cases has shown to significantly facilitate Web mining prototyping.

REFERENCES

• 1: Serge Abiteboul , Richard Hull , Victor Vianu, Foundations of Databases: The Logical Level, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 2: Gustavo O. Arocena , Alberto O. Mendelzon, WebOQL: Restructuring Documents, Databases, and Webs, Proceedings of the Fourteenth International Conference on Data Engineering, p.24-33, February 23-27, 1998
• 3: Ricardo Baeza-Yates , Álvaro Pereira , Nivio Ziviani, Genealogical trees on the web: a search engine user perspective, Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China [doi>10.1145/1367497.1367548]
• 4: D. Borthakur. The hadoop distributed file system: Architecture and design, 2007. http://hadoop.apache.org/core/docs/current/hdfs_design.pdf.
• 5: Soumen Chakrabarti, Mining the Web: Discovering Knowledge from HyperText Data, Science & Technology Books, 2002
• 6: DB2 Intelligent Miner, July 2008. http://www-306.ibm.com/software/data/iminer/.
• 7: Jeffrey Dean , Sanjay Ghemawat, MapReduce: simplified data processing on large clusters, Communications of the ACM, v.51 n.1, January 2008 [doi>10.1145/1327452.1327492]
• 8: Mary Fernandez , Daniela Florescu , Alon Levy , Dan Suciu, A query language for a Web-site management system, ACM SIGMOD Record, v.26 n.3, p.4-11, Sept. 1997 [doi>10.1145/262762.262763]
• 9: Hadoop, July 2008. http://hadoop.apache.org/.
• 10: Raymond Kosala , Hendrik Blockeel, Web mining research: a survey, ACM SIGKDD Explorations Newsletter, v.2 n.1, p.1-15, June, 2000 [doi>10.1145/360402.360406]
• 11: Bing Liu, Web Data Mining: Exploring Hyperlinks, Contents, and Usage Data (Data-Centric Systems and Applications), Springer-Verlag New York, Inc., Secaucus, NJ, 2006
• 12: A. O. Mendelzon, G. A. Mihaila, and T. Milo. Querying the World Wide Web. Intl. Journal on Digital Libraries, 1(1):54--67, 1997.
• 13: Microsoft SQL Server 2005 Data Mining, July 2008. http://www.microsoft.com/sql/technologies/dm.
• 14: W.-K. Ng , E.-P. Lim , C. -T. Huang , S. Bhowmick , F. -Q. Qin, Web Warehousing: An Algebra for Web Information, Proceedings of the Advances in Digital Libraries Conference, p.228, April 22-24, 1998
• 15: Oracle Data Mining, July 2008. http://www.oracle.com/technology/products/bi/odm.
• 16: A. Pereira, R. Baeza-Yates, and N. Ziviani. A model for web mining applications -- conceptual model, architecture, implementation and use cases. Technical Report 001/2008, Federal Univ. of Minas Gerais, Feb. 2008. http://www.dcc.ufmg.br/~alvaro/pbz08b.pdf.
• 17: Sriram Raghavan , Hector Garcia-Molina, Complex queries over web repositories, Proceedings of the 29th international conference on Very large data bases, p.33-44, September 09-12, 2003, Berlin, Germany
• 18: Ian H. Witten , Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems), Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005
• 19: Charles A. Wood , Terence T. Ow, WEBVIEW: an SQL extension for joining corporate data to data derived from the web, Communications of the ACM, v.48 n.9, p.99-104, September 2005 [doi>10.1145/1081992.1081996]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.m Miscellaneous

General Terms:
Design, Management

Keywords:
model, prototyping, web mining, web mining applications