ISCA Archive Interspeech 2014
ISCA Archive Interspeech 2014

Hierarchical modeling of F0 contours for voice conversion

Gerard Sanchez, Hanna Silen, Jani Nurminen, Moncef Gabbouj

Voice conversion systems deal with the conversion of a speech signal to sound as if it was uttered by another speaker. The conversion of the spectral features has attracted a lot of research attention but the conversion of pitch, modeling the speaker-dependent prosody, is often achieved by just controlling the F0 level and range. However, the detailed prosody, including different linguistic units at several distinct temporal scales, can carry a significant amount of speaker identity related information. This paper introduces a new method for the conversion of the prosody, using wavelets to decompose the pitch contour into ten temporal scales ranging from microprosody to the utterance level, which allows modeling the different timings of the prosody phenomena. The prosody conversion is carried out in the wavelet domain, using regression techniques originally developed for the spectral conversion of speech. The performance of the proposed prosody conversion method is evaluated within a real voice conversion system. The results for cross-gender conversion indicate a significant improvement in naturalness when compared to the traditional approach of shifting and scaling the F0 to match the target speaker's mean and variance.


doi: 10.21437/Interspeech.2014-189

Cite as: Sanchez, G., Silen, H., Nurminen, J., Gabbouj, M. (2014) Hierarchical modeling of F0 contours for voice conversion. Proc. Interspeech 2014, 2318-2321, doi: 10.21437/Interspeech.2014-189

@inproceedings{sanchez14_interspeech,
  author={Gerard Sanchez and Hanna Silen and Jani Nurminen and Moncef Gabbouj},
  title={{Hierarchical modeling of F0 contours for voice conversion}},
  year=2014,
  booktitle={Proc. Interspeech 2014},
  pages={2318--2321},
  doi={10.21437/Interspeech.2014-189},
  issn={2308-457X}
}