Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

This paper describes an initial attempt on a music-driven digital violinist (MDV) system, which automatically generates animation of a violinist based on violin music. MDV first analyzes the input audio signal and transcribes it into music notes. Next it uses the notes to synthesize the animated video of a violinist. Tests on the prototype system show that it achieves adequate visual realism and near real-time performance.

REFERENCES

• 1: John J. Craig, Introduction to Robotics: Mechanics and Control, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
• 2: George ElKoura , Karan Singh, Handrix: animating the human hand, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 3: Petros Faloutsos , Michiel van de Panne , Demetri Terzopoulos, Composable controllers for physics-based character animation, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.251-260, August 2001 [doi>10.1145/383259.383287]
• 4: Junhwan Kim , Frederic Cordier , Nadia Magnenat-Thalmann, Neural Network-Based Violinist's Hand Animation, Proceedings of the International Conference on Computer Graphics, p.37, June 19-24, 2000
• 5: Jintae Lee , Tosiyasu L. Kunii, Model-Based Analysis of Hand Posture, IEEE Computer Graphics and Applications, v.15 n.5, p.77-86, September 1995 [doi>10.1109/38.403831]
• 6: W. Lytle. More Bells and Whistles. ACM SIGGRAPH 2001 Electronic Theatre, ACM SIGGRAPH Computer Animation Festival, 2001.
• 7: P. M. Martins, J. S. Ferreira. PCM to MIDI Transposition. Audio Engineering Society 112th Convention Paper, May 2002.
• 8: M. Piszczalski, B.A. Galler. Automatic Music Transcription. Computer Music Journal, 1(4):24--31, 1977.
• 9: Amazing MIDI, http://www.pluto.dti.ne.jp/~araki/amazingmidi/index.html
• 10: intelliScore, http://www.intelliscore.net/

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.3 SPECIAL-PURPOSE AND APPLICATION-BASED SYSTEMS
      Subjects: Signal processing systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing
          Subjects: Systems; Signal analysis, synthesis, and processing

General Terms:
Algorithms, Design, Experimentation

Keywords:
animation, inverse kinematics, music transcription