ISCA Archive SLaTE 2023
ISCA Archive SLaTE 2023

Learners' Prosodic Control in the Task of Expressive Storytelling and Predicted Native Listeners' Impressions of the Learners' Speech

Chihiro Shoda, Yingxiang Gao, Yurun He, Nobuaki Minematsu, Noriko Nakanishi, Daisuke Saito

Various kinds of L1 transfer are found in L2 speech, which often influence transmission of both linguistic and para-linguistic information. In this study, we focus on how adequately Japanese learners of English can transmit para-linguistic expressions in the task of storytelling. For this aim, we analyze 1) how learners control the prosodic features to express specified emotions and 2) what kind of impressions native listeners perceive from the learners' expressions. For the first analysis, the learners' prosodic control is compared with the corresponding native control. For the second analysis, with speech emotion recognition technology, L2 speech is converted to its emotion posteriorgram. Then, the intended emotions are compared with the perceived emotions. Experiments show the learners have difficulty in imitating the native intensity control, especially when expressing sadness, and distinction among perceived emotions is remarkably reduced.