Over the years, language technology has become a valuable asset for foreign language learners. In this work, we introduce pronunciation feedback scoring systems for 6-12 year old children. The scoring systems were embedded in second-language (L2) English learning games that were designed to prompt children to repeat words. Speech and phone recognition models were used to validate utterances and extract phoneme-wise statistics, which were used to compute feedback scores of 0-5 stars. The scoring systems were trained to mimic the preferences of a single expert who evaluated all the training data. Our automatic scoring system reached a correlation of 0.59 to the human annotation. This system was also tested in a learning experiment, where EEG measurements indicated that children who played our learning game with our scoring engine for pronunciation feedback improved their perception of speech sounds. We release the game codes and the speech data used to train the scoring system.
Cite as: Karhila, R., Ylinen, S., Smolander, A.-R., Rouhe, A., Al-Ghezi, R., Getman, Y., Grosz, T., Uther, M., Kurimo, M. (2023) A pronunciation Scoring System Embedded into Children’s Foreign Language Learning Games with Experimental Verification of Learning Benefits. Proc. 9th Workshop on Speech and Language Technology in Education (SLaTE), 21-25, doi: 10.21437/SLaTE.2023-5
@inproceedings{karhila23_slate,
author={Reima Karhila and Sari Ylinen and Anna-Riikka Smolander and Aku Rouhe and Ragheb Al-Ghezi and Yaroslav Getman and Tamas Grosz and Maria Uther and Mikko Kurimo},
title={{A pronunciation Scoring System Embedded into Children’s Foreign Language Learning Games with Experimental Verification of Learning Benefits}},
year=2023,
booktitle={Proc. 9th Workshop on Speech and Language Technology in Education (SLaTE)},
pages={21--25},
doi={10.21437/SLaTE.2023-5}
}