iDVT: an interactive digital violin tutoring system based on audio-visual fusion

ABSTRACT

iDVT (interactive Digital Violin Tutor) is a violin learning system exploiting physical and virtual resources and interactivity. It aims at providing the user with new effective learning experience. This demonstration paper briefly describes the structure of the system and the underlying audio-visual processing techniques employed in the system.

REFERENCES

• 1: Christopher J. C. Burges, A Tutorial on Support Vector Machines for Pattern Recognition, Data Mining and Knowledge Discovery, v.2 n.2, p.121-167, June 1998 [doi>10.1023/A:1009715923555]
• 2: N. Collins. A comparison of sound onset detection algorithms with emphasis on psycho-acoustically motivated detection functions. In Proceedings of AES118 Convention, 2005.
• 3: B. Logan. Mel Frequency Cepstral Coefficients for Music Modeling. International Symposium on Music Information Retrieval, 28, 2000.
• 4: Ye Wang , Bingjun Zhang , Olaf Schleusing, Educational violin transcription by fusing multimedia streams, Proceedings of the international workshop on Educational multimedia and multimedia education, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290144.1290154]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing
          Subjects: Signal analysis, synthesis, and processing

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing
          Subjects: Systems

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking; Motion; Sensor fusion

General Terms:
Algorithms, Design, Experimentation, Human Factors

Keywords:
fingering analysis, hand tracking, multimodal fusion, music transcription, onset detection