ISCA Archive Interspeech 2014
ISCA Archive Interspeech 2014

A comparative study of spectral transformation techniques for singing voice synthesis

S. W. Lee, Zhizheng Wu, Minghui Dong, Xiaohai Tian, Haizhou Li

Studies show that professional singing matches well the associated melody and typically exhibits spectra different from speech in resonance tuning and singing formant. Therefore, one of the important topics in speech-to-singing conversion is to characterize the spectral transformation between speech and singing. This paper extends two types of spectral transformation techniques, namely voice conversion and model adaptation, and examines their performance. For the first time, we carry out a comparative study over four singing voice synthesis techniques. The experiments on various data sizes reveal that maximum-likelihood Gaussian mixture model (ML-GMM) of voice conversion always delivers the best performance in terms of spectral estimation accuracy; while model adaptation generates the best singing quality in all cases. When a large dataset is available, both techniques achieve the highest similarity to target singing. With a small dataset, the highest similarity is obtained by ML-GMM. It is also found that the music context-dependent modeling in adaptation, in which detailed partition of transform space is involved, leads to pleasant singing spectra.


doi: 10.21437/Interspeech.2014-536

Cite as: Lee, S.W., Wu, Z., Dong, M., Tian, X., Li, H. (2014) A comparative study of spectral transformation techniques for singing voice synthesis. Proc. Interspeech 2014, 2499-2503, doi: 10.21437/Interspeech.2014-536

@inproceedings{lee14d_interspeech,
  author={S. W. Lee and Zhizheng Wu and Minghui Dong and Xiaohai Tian and Haizhou Li},
  title={{A comparative study of spectral transformation techniques for singing voice synthesis}},
  year=2014,
  booktitle={Proc. Interspeech 2014},
  pages={2499--2503},
  doi={10.21437/Interspeech.2014-536},
  issn={2308-457X}
}