A live multimedia stream querying system

ABSTRACT

Querying live media streams captured by various sensors is becoming a challenging problem, due to the data heterogeneity and the lack of a unifying data model capable of accessing various multimedia data and providing reasonable abstractions for the query purpose. In this paper we propose a system that enables directly capturing media streams from sensors and automatically generating more meaningful feature streams that can be queried by a data stream processor. The system provides an effective combination between extendible digital processing techniques and general data stream management research.

REFERENCES

• 1: A. Arasu, S. Babu, and J. Widom. The cql continuous query language: Semantic foundations and query execution. Technical report, Stanford University, Oct. 2003.
• 2: W. G. Aref, A. C. Catlin, and et al. Vdbms: A testbed facility for research in video database benchmarking. ACM Multimedia Systems Journal, Special Issue on Multimedia Document Management Systems, 9(6):575--585, June 2004.
• 3: Myron Flickner , Harpreet Sawhney , Wayne Niblack , Jonathan Ashley , Qian Huang , Byron Dom , Monika Gorkani , Jim Hafner , Denis Lee , Dragutin Petkovic , David Steele , Peter Yanker, Query by Image and Video Content: The QBIC System, Computer, v.28 n.9, p.23-32, September 1995 [doi>10.1109/2.410146]
• 4: Lukasz Golab , M. Tamer Özsu, Issues in data stream management, ACM SIGMOD Record, v.32 n.2, p.5-14, June 2003 [doi>10.1145/776985.776986]
• 5: Amarnath Gupta , Bin Liu , Pilho Kim , Ramesh Jan, Using Stream Semantics for Continuous Queries in Media Stream Processors, Proceedings of the 20th International Conference on Data Engineering, p.854, March 30-April 02, 2004
• 6: Somboon Hongeng , Ram Nevatia , Francois Bremond, Video-based event recognition: activity representation and probabilistic recognition methods, Computer Vision and Image Understanding, v.96 n.2, p.129-162, November 2004 [doi>10.1016/j.cviu.2004.02.005]
• 7: Ramesh Jain, Experiential computing, Communications of the ACM, v.46 n.7, July 2003 [doi>10.1145/792704.792729]
• 8: U. Ramachandran, M. Modahl, I. Bagrak, M. Wolenetz, D. Lillethun, B. Liu, J. Kim, P. Hutto, and R. Jain. Media broker: A pervasive computing infrastructure for adaptive transformation and sharing of stream data. To appear in Pervasive and Mobile Computing (PMC) Journal, 2, 2005.
• 9: P. Salemier and J. R. Smith. Introduction to MEPG-7:Multimedia Content Description Interface. Wiley Europe, 2002.
• 10: Ralf Steinmetz , Klara Nahrstedt, Multimedia: computing, communications and applications, Prentice-Hall, Inc., Upper Saddle River, NJ, 1995
• 11: Peter A. Tucker , David Maier , Tim Sheard , Leonidas Fegaras, Exploiting Punctuation Semantics in Continuous Data Streams, IEEE Transactions on Knowledge and Data Engineering, v.15 n.3, p.555-568, March 2003 [doi>10.1109/TKDE.2003.1198390]
• 12: V. V. Vinod and H. Murase. Video shot analysis using efficient multiple object tracking. In ICMCS '97, Ottawa, Ontario, CANADA, June 1997.
• 13: P. Viola and M. J. Jones. Rapid object detection using a boosted cascade of simple features. In IEEE CVPR, volume 1, pages 511--518, 2001.