ISCA Archive Blizzard 2021
ISCA Archive Blizzard 2021

Using multi-speaker models for single speaker Spanish synthesis in the Blizzard 2021

Christian Saam, João P. Cabral

Our entry to the Blizzard 2021 builds on the training of Spanish and mixed Spanish/English models using a Conformer-based FastSpeech 2 system. The mixed Spanish/English models were used for the task of synthesising Spanish texts containing a small number of English words. We used external public multispeaker Spanish and English datasets to build our models. The main reasons were to avoid problems of data scarcity using the relatively small (around 5 hours long) single speaker Spanish dataset provided by the organisers of the Blizzard, and to be able to build a mixed Spanish/English synthesis model. Our assumption was that we could model well the target Spanish speaker voice in the multi-speaker model and obtain an high-quality Spanish voice. Unfortunately our models produced synthetic speech with quality lower than expected, both in speaker similarity and naturalness. The synthetic voices sounded particularly monotonic, which could have a strong effect on the results. The complexity of consecutively fine-tuning models obtained using multiple datasets to achieve the final voice models could have contributed to inaccurate modelling of the prosody and eventually the speech spectrum characteristics. Another possible reason is that the multi-speaker Spanish dataset we used only included 4 speakers, which may not have been sufficient. We are conducting further analysis to better understand the reasons for the output quality of the system.


doi: 10.21437/Blizzard.2021-7

Cite as: Saam, C., Cabral, J.P. (2021) Using multi-speaker models for single speaker Spanish synthesis in the Blizzard 2021. Proc. The Blizzard Challenge 2021, 42-46, doi: 10.21437/Blizzard.2021-7

@inproceedings{saam21_blizzard,
  author={Christian Saam and João P. Cabral},
  title={{Using multi-speaker models for single speaker Spanish synthesis in the Blizzard 2021}},
  year=2021,
  booktitle={Proc. The Blizzard Challenge 2021},
  pages={42--46},
  doi={10.21437/Blizzard.2021-7}
}