A robust audio classification and segmentation method

ABSTRACT

In this paper, we present a robust algorithm for audio classification that is capable of segmenting and classifying an audio stream into speech, music, environment sound and silence. Audio classification is processed in two steps, which makes it suitable for different applications. The first step of the classification is speech and non-speech discrimination. In this step, a novel algorithm based on KNN and LSP VQ is presented. The second step further divides non-speech class into music, environment sounds and silence with a rule based classification scheme. Some new features such as the noise frame ratio and band periodicity are introduced and discussed in detail. Our experiments in the context of video structure parsing have shown the algorithms produce very satisfactory results.

REFERENCES

• 1: J. Foote. Content-based retrieval of music and audio. In C. C. J. Kuo et al., editors, Multimedia Storage and Archiving Systems II, Proc. of SPIE, volume 3229, pages 138147, 1997.
• 2: Erling Wold , Thom Blum , Douglas Keislar , James Wheaton, Content-Based Classification, Search, and Retrieval of Audio, IEEE MultiMedia, v.3 n.3, p.27-36, September 1996 [doi>10.1109/93.556537]
• 3: Silvia Pfeiffer , Stephan Fischer , Wolfgang Effelsberg, Automatic audio content analysis, Proceedings of the fourth ACM international conference on Multimedia, p.21-30, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244139]
• 4: J. Saunders. Real-time Discrimination of Broadcast Speech/ Music. Proc. ICASSP96, vol.11, pp.993-996, Atlanta, May, 1996
• 5: E. Scheirer , M. Slaney, Construction and Evaluation of a Robust Multifeature Speech/Music Discriminator, Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 2, p.1331, April 21-24, 1997
• 6: D. Kimber and L. Wilcox. Acoustic Segmentation for Audio Browsers, Proc. Interface Conference, Sydney, Australia, July, 1996
• 7: T. Zhang and C.-C. J. Kuo. Video Content Parsing Based on Combined Audio and Visual Information. SPIE 1999, Vol. IV, pp. 78-89, 1999.
• 8: J. P. Campbell, JR. Speaker Recognition: A Tutorial. Proceedings of the IEEE, vol1.85, no.9, pp.1437-1462, 1997.
• 9: A. V. McCree and T. P. Barnwell. Mixed Excitation LPC Vocoder Model for Low Bit Rate Speech Coding. IEEE Transaction on Speech and Audio Processing, vol. 3, No. 4, pp242-250. July 1995.
• 10: K. El-Maleh, M. Klein, G. Petrucci and P. Kabal. Speech/music discrimination for multimedia application. ICASSPOO, 2000
• 11: Y. Linde, A. Buzo, and R.M. Gray. A Algorithm for Vector Quantizer Design, IEEE Trans. on Comm. Corn-28, No. 1, pp. 84-95, 1980.
• 12: Savitha Srinivasan , Dragutin Petkovic , Dulce Ponceleon, Towards robust features for classifying audio in the CueVideo system, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.393-400, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319658]
• 13: Zhu Liu , Yao Wang , Tsuhan Chen, Audio Feature Extraction and Analysis for Scene Segmentation and Classification, Journal of VLSI Signal Processing Systems, v.20 n.1-2, p.61-79, Oct. 1998 [doi>10.1023/A:1008066223044]
• 14: J. S. Boreczky and L. D. Wilcox. A Hidden Markov Model Frame Work for Video Segmentation Using Audio and Image Features. Proceedings of ICASSP'98, pp.3741- 3744, Seattle, May 1998.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

Keywords:
audio classification and segmentation, audio content analysis