Emotional speech synthesis by XML file using interactive genetic algorithms

ABSTRACT

As a technique that can "let computer speak", speech synthesis is drawing more and more attention. Today, much speech synthesis software can synthesize neutral speech naturally and knowingly. However, it is hard to make computers speak with "emotion" as that in our daily life, because of the complexity of emotion model. Interactive Genetic Algorithms which can be acted self-organizingly, adaptively and self-learningly can just resolve the problem of difficulty in modeling emotional speech synthesis. As a result, this paper designs an emotional speech synthesis process, which adjusts the parameters (XML-tags) used to synthesize emotional speech dynamically, using interactive Genetic Algorithms, to optimize the quality of emotional speech. Also, the paper includes an evaluation experiment, which proves the feasibility of the algorithms.

REFERENCES

• 1: Marc Schroder,Emotional Speech Synthesis: A Review, DFKI, Saarbrucken, Germany Institute of Phonetics, University of the Saarland
• 2: Paul Ekrnan and Harriet Oster Facial Expressions Of Emotion, Department of Psychiatry, University of California, San Francisco, California 94143, Ann. Rev. Psvchol. 1979. 30:527--54
• 3: Jianhua Tao, Member, IEEE, Yongguo Kang, and Aijun Li, Prosody Conversion From Neutral Speech to Emotional Speech, IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 14, NO. 4, JULY 2006, 1558--7916/$20.00 @ 2006 IEEE
• 4: Iain R. Murray , John L. Arnott, Applying an analysis of acted vocal emotions to improve the simulation of synthetic speech, Computer Speech and Language, v.22 n.2, p.107-129, April, 2008 [doi>10.1016/j.csl.2007.06.001]
• 5: Yuji Sato. Voice quality conversion using interactive evolution of prosodic control. Faculty of Computer and Information Sciences, Hosei University. Applied Soft Computing 5 (2005) 181--192
• 6: Murtaza Bulut etc. A Statistical Approach For Modeling Prosody Features Using POS Tags For Emotional Speech Synthesis. 1-4244-0728-1/07/$20.00 @ 2007 IEEE
• 7: Shinya Mori etc. Emotional Speech Synthesis Using Subspace Constraints In Prosody. 1424403677/06/$20.00 @ 2006 IEEE
• 8: Mariet Theune etc. Generating Expressive Speech for Storytelling Applications. 1558--7916/$20.00 @ 2006 IEEE
• 9: Janet E. Cahn. Generating Expression in Synthesized Speech. Massachusetts Institute of Technology 1990
• 10: Iain R. Murray , John L. Arnott, Applying an analysis of acted vocal emotions to improve the simulation of synthetic speech, Computer Speech and Language, v.22 n.2, p.107-129, April, 2008 [doi>10.1016/j.csl.2007.06.001]
• 11: Makoto Tachibana , Junichi Yamagishi , Takashi Masuko , Takao Kobayashi, Speech Synthesis with Various Emotional Expressions and Speaking Styles by Style Interpolation and Morphing, IEICE - Transactions on Information and Systems, v.E88-D n.11, p.2484-2491, November 2005 [doi>10.1093/ietisy/e88-d.11.2484]
• 12: Marc Schroder, Expressing Degree of Activation in Synthetic Speech, IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 14, NO. 4, JULY 2006
• 13: Oudeyer Pierre-Yves, The production and recognition of emotions in speech: features and algorithms, International Journal of Human-Computer Studies, v.59 n.1-2, p.157-183, July 2003 [doi>10.1016/S1071-5819(02)00141-6]
• 14: H Scheffe, An analysis of variance for paired comparisons, Journal of the American Statistical Association, 1952 -- JSTOR
• 15: Microsoft Corporation, Microsoft Speech SDK 5.1 SAPI

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  J. Computer Applications
  J.7 COMPUTERS IN OTHER SYSTEMS

General Terms:
Algorithms, Experimentation, Verification

Keywords:
emotion, interactive genetic algorithms, speech synthesis