Mining multimedia data

ABSTRACT

Data Mining is a young but flourishing field. Many algorithms and applications exist to mine different types of data and extract different types of knowledge. Mining multimedia data is, however, at an experimental stage.We have implemented a prototype for mining high-level multimedia information and knowledge from large multimedia databases. MultiMedia Miner has been designed based on our years of experience in the research and development of a relational data mining system, DBMiner, in the Intelligent Database Systems Research Laboratory, and a Content-Based Image Retrieval system from Digital Libraries, C-BIRD, in the Vision and Media Laboratory.MultiMediaMiner includes the construction of multimedia data cubes which facilitate multiple dimensional analysis of multimedia data, and the mining of multiple kinds of knowledge, including summarization, classification, and association, in image and video databases. The images and video clips used in our experiments are collected by crawling the WWW. Many challenges have yet to be overcome, such as the large number of dimensions, and the existence of multi-valued dimensions.

REFERENCES

• 1: {1} R. Beckwith, C. Fellbaum, D. Gross, K. Miller, G.A. Miller, and R. Tengi. Five papers on WordNet. Special Issue of Journal of Lexicography, 3(4):235-312, 1990. Also available from ftp://ftp.cogsci.princeton.edu/pub/wordnet/5papers.ps.
• 2: Inderpal Bhandari , Edward Colet , Jennifer Parker , Zachary Pines , Rajiv Pratap , Krishnakumar Ramanujam, Advanced Scout: Data Mining and Knowledge Discovery in NBA Data, Data Mining and Knowledge Discovery, v.1 n.1, p.121-125, 1997 [doi>10.1023/A:1009782106822]
• 3: Surajit Chaudhuri , Umeshwar Dayal, An overview of data warehousing and OLAP technology, ACM SIGMOD Record, v.26 n.1, p.65-74, March 1997 [doi>10.1145/248603.248616]
• 4: Surajit Chaudhuri , Shahram Ghandeharizadeh , Cyrus Shahabi, Retrieval of Composite Multimedia Objects, Proceedings of the 21th International Conference on Very Large Data Bases, p.287-298, September 11-15, 1995
• 5: {5} S. Chien, F. Fisher, H. Mortensen, E. Lo, and R. Greeley. Using artificial intelligence planning to automate science data analysis for large image databases. In Proc. Third Int. Conf. on Knowledge Discovery and Data Mining, pages 147-150, 1997.
• 6: {6} A. Czyzewski. Mining knowledge in noisy audio data. In Proc. Second Int. Conf. on Knowledge Discovery and Data Mining, pages 220-225, 1996.
• 7: Oren Etzioni, The World-Wide Web: quagmire or gold mine?, Communications of the ACM, v.39 n.11, p.65-68, Nov. 1996 [doi>10.1145/240455.240473]
• 8: {8} U. Fayyad and P. Smyth. Image database exploration: Progress and challenges. In Proc. Knowledge Discovery in Databases Workshop, pages 14-27, Washington, D.C, 1993.
• 9: Usama M. Fayyad , S. George Djorgovski , Nicholas Weir, Automating the analysis and cataloging of sky surveys, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
• 10: Usama M. Fayyad , Gregory Piatetsky-Shapiro , Padhraic Smyth , Ramasamy Uthurusamy, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
• 11: {11} R. Feldman and I. Dagan. Knowledge discovery in textual databases (KDT). In Proc. 1st Int. Conf. Knowledge Discovery and Data Mining, pages 112-117, Montreal, Canada, Aug. 1995.
• 12: {12} R. Feldman and H. Hirsh. Mining associations in text in the presence of background knowledge. In Proc. 2st Int. Conf. Knowledge Discovery and Data Mining, pages 343-346, Portland, Oregon, Aug. 1996.
• 13: Myron Flickner , Harpreet Sawhney , Wayne Niblack , Jonathan Ashley , Qian Huang , Byron Dom , Monika Gorkani , Jim Hafner , Denis Lee , Dragutin Petkovic , David Steele , Peter Yanker, Query by Image and Video Content: The QBIC System, Computer, v.28 n.9, p.23-32, September 1995 [doi>10.1109/2.410146]
• 14: J. Han , Y. Cai , N. Cercone, Data-Driven Discovery of Quantitative Rules in Relational Databases, IEEE Transactions on Knowledge and Data Engineering, v.5 n.1, p.29-40, February 1993 [doi>10.1109/69.204089]
• 15: Jiawei Han , Jenny Y. Chiang , Sonny Chee , Jianping Chen , Qing Chen , Shan Cheng , Wan Gong , Micheline Kamber , Krzysztof Koperski , Gang Liu , Yijun Lu , Nebojsa Stefanovic , Lara Winstone , Betty B. Xia , Osmar R. Zaiane , Shuhua Zhang , Hua Zhu, DBMiner: a system for data mining in relational databases and data warehouses, Proceedings of the 1997 conference of the Centre for Advanced Studies on Collaborative research, p.8, November 10-13, 1997, Toronto, Ontario, Canada
• 16: Jiawei Han , Yongjian Fu, Discovery of Multiple-Level Association Rules from Large Databases, Proceedings of the 21th International Conference on Very Large Data Bases, p.420-431, September 11-15, 1995
• 17: Jiawei Han , Yongjian Fu, Attribute-oriented induction in data mining, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
• 18: Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman, Implementing data cubes efficiently, Proceedings of the 1996 ACM SIGMOD international conference on Management of data, p.205-216, June 04-06, 1996, Montreal, Quebec, Canada
• 19: Setrag Khoshfian , A. Brad Baker, Multimedia and Imaging Databases, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1994
• 20: David Konopnicki , Oded Shmueli, W3QS: A Query System for the World-Wide Web, Proceedings of the 21th International Conference on Very Large Data Bases, p.54-65, September 11-15, 1995
• 21: Krzysztof Koperski , Jiawei Han, Discovery of Spatial Association Rules in Geographic Information Databases, Proceedings of the 4th International Symposium on Advances in Spatial Databases, p.47-66, August 06-09, 1995
• 22: {22} Z.N. Li and B. Yan. Recognition kernel for content-based search. In Proc. IEEE Conf. on Systems, Man, and Cybernetics, pages 472-477, 1996.
• 23: {23} Z.N. Li, O. R. Zaïane, and Zinovi Tauber. Illumination invariance and object model in content-based image and video retrieval. Journal of Visual Communication and Image Representation, 1998. Submitted for review.
• 24: Ze-Nian Li , Osmar R. Zaïane , Bing Yan, C-BIRD: Content-Based Image Retrieval from Digital Libraries Using Illumination Invariance and Recognition Kernel, Proceedings of the 9th International Workshop on Database and Expert Systems Applications, p.361, August 26-28, 1998
• 25: {25} W. Lu, J. Han, and B. C. Ooi. Knowledge discovery in large spatial databases. In Proc. Far East Workshop Geographic Information Systems, pages 275-289, Singapore, June 1993.
• 26: Alberto O. Mendelzon , Tova Milo, Formal models of Web queries, Proceedings of the sixteenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.134-143, May 11-15, 1997, Tucson, Arizona, United States [doi>10.1145/263661.263677]
• 27: Raymond T. Ng , Jiawei Han, Efficient and Effective Clustering Methods for Spatial Data Mining, Proceedings of the 20th International Conference on Very Large Data Bases, p.144-155, September 12-15, 1994
• 28: Banu Özden , Alexandros Biliris , Rajeev Rastogi , Abraham Silberschatz, A Low-Cost Storage Server for Movie on Demand Databases, Proceedings of the 20th International Conference on Very Large Data Bases, p.594-605, September 12-15, 1994
• 29: Usama M. Fayyad , Gregory Piatetsky-Shapiro , Padhraic Smyth, From data mining to knowledge discovery: an overview, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
• 30: Kenneth A. Ross , Divesh Srivastava, Fast Computation of Sparse Datacubes, Proceedings of the 23rd International Conference on Very Large Data Bases, p.116-125, August 25-29, 1997
• 31: Yukinobu Taniguchi , Akihito Akutsu , Yoshinobu Tonomura, PanoramaExcerpts: extracting and packing panoramas for video browsing, Proceedings of the fifth ACM international conference on Multimedia, p.427-436, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266396]
• 32: Laura Teodosio , Walter Bender, Salient video stills: content and context preserved, Proceedings of the first ACM international conference on Multimedia, p.39-46, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.166270]
• 33: {33} V. Tucakov and R. Ng. Identifying unusual spatio-temporal trajectories from surveillance videos. In Proc. of 1998 SIGMOD Workshop on Research Issues on Data Mining and Knowledge Discovery (DMKD'98), Seattle, Washington, June 1998.
• 34: {34} W.F. Williams. Principles of Automated Information Retrieval. The Business Press, Elmhurst, Illinois, USA, 1965.
• 35: {35} WordNet - a lexical database for english. http://www.cogsci.princeton.edu/_wn/, 1998.
• 36: {36} O. R. Zaïane, A. Fall, S. Rochefort, V. Dahl, and P. Tarau. On-line resource discovery using natural language. In Proceedings, RIAO'97, Montreal, Canada, June 25-27 1997.
• 37: {37} O. R. Zaïane and J. Han. Resource and knowledge discovery in global information systems: A preliminary design and experiment. In Proc. 1st Int. Conf. Knowledge Discovery and Data Mining (KDD'95), pages 331-336, Montreal, Canada, Aug. 1995.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Multimedia databases
      H.2.8 Database applications
          Subjects: Image databases
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Algorithms, Design, Experimentation, Measurement, Performance, Theory

Keywords:
data cube, data mining, data warehousing, image analysis, information retrieval, multimedia, world-wide web