Organization and retrieval of continuous media

ABSTRACT

Because of the media digitization, a large amount of information such as speech, audio and video data is produced everyday. In order to retrieve data quickly and precisely from these databases, multimedia technologies for organizing and retrieving of speech, audio and video data are strongly required. In this paper, we overview the multimedia technologies such as organization and retrieval of speech, audio and video data, speaker indexing, audio summarization and cross media retrieval existing today. The main purpose of the organization is to produce tables of contents and indices from audio and video data automatically. In order to make these technologies feasible, first, processing units such as words on audio data and shots on video data are extracted. On a second step, they are meaningfully integrated into topics. Furthermore, the units extracted from different types of media are integrated for higher functions.

REFERENCES

• 1: http://www.in formedia.cs.cnm.edu/dli2/
• 2: Dharanipragada, S., Franz. M., McCarley, J.S., Roukos, S. and Ward. T., "Story Segmentation and Topic Detection for Recognized Speech," Proc. of Eurospeech99, pp.2435-2438, 1999.
• 3: Walls, F., Jim H., Sista. S. and Schwartz, R., "Topic Detection in Broadcast News." Proc. of Eurospeech99, pp.2451-2454, 1999.
• 4: Yasuo Ariki , Jun Ogata , Masafumi Nishida, News Dictation and Article Classification Using Automatically Extracted Announcer Utterance, Proceedings of the First International Conference on Advanced Multimedia Content Processing, p.75-86, November 09-11, 1998
• 5: Siegler, M.A., "Experiments in Spoken Document Retrieval at CMU." TRECT, 1998.
• 6: Gey, F.C., Jiang, H., Chen, A. and Larson, R.R., "Manual Queries and Machine Translation in Cross-Language Retrieval and Interactive Retrieval with Cheshire II at TREC-7." Proc. of TREC-7, pp527-540, 1997.
• 7: D. Roy , C. Malamud, Speaker Identification Based Text to Audio Alignment for an Audio Retrieval System, Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 2, p.1099, April 21-24, 1997
• 8: Delacourt, P., Kryze, D. and Vqellekens, J.C. "Detection of Speaker Changes in an Audio Document," Proc. Eurospeech'99, pp.1195-1198, 1999.
• 9: Linde, Y., Buzo, A. and Gray, R.M., "'An algorithm for vector quantizer design," IEEE Trans. Commun., COM-28, pp.84-95. 1980.
• 10: Kiyama. J., Itoh. Y. and Oka, R., "Automatic Detection of Topic Boundary and Keywords in Arbitrary Speech Using Incremental Reference Interval-free Continuous DP," Proc. of ICSLP96: pp. 1946-1949, 1996.
• 11: Ariki. Y. and Saito, Y., "'Extraction of TV News Articles based on Scene Cut Detection Using DCT Clustering," Proc. of ICIP96. pp. III847-III850, 1996.
• 12: Smith, M.A. and Kanade, T., "'Video skimming and characterization through the combination of image and language understanding technique, " CMU-CS-97-111, 1997.
• 13: Yasuo Ariki , Katsumi Matsuura , Seiichi Takao, Telop and Flip Frame Detection and Character Extraction from TV News Articles, Proceedings of the Fifth International Conference on Document Analysis and Recognition, p.701, September 20-22, 1999
• 14: Muller, S., Eickeler, S., Rigoll, G., "Pseudo 3-D HMMs for Image Sequence Recognition," Proc. of ICIP99. 28APl.11, 1999.
• 15: Kurokawa. M., Echigo, T., Tomita,A., Maeda, J., Miyamori. H. and Iisaku. S., "Representation and Retrieval of Video Scene by Using Object Actions and Their Spatio-Temporal Relationships," Proc. of {CIP99. 26AO2.1, 1999.
• 16: Yaginuma, Y. and Sakauchi, Y., "Content-based Retrieval and Decomposition of TV Drama based on Inter-media Synchronization," First Int. Conf. on Visual Information Systems, 1996.
• 17: Takashi Endo , Jian Xin Zhang , Masakyuki Nakazawa , Ryuichi Oka, Mutual Spotting Retrieval between Speech and Video Image Using Self-Organized Network Databases, Proceedings of the First International Conference on Advanced Multimedia Content Processing, p.103-118, November 09-11, 1998
• 18: Shin'ichi Satoh , Yuichi Nakamura , Takeo Kanade, Name-It: Naming and Detecting Faces in News Videos, IEEE MultiMedia, v.6 n.1, p.22-35, January 1999 [doi>10.1109/93.752960]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.2 Information Storage
          Subjects: File organization
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.2 Design Methodology
          Subjects: Classifier design and evaluation

General Terms:
Design, Documentation, Management, Performance, Theory