ISCA Archive Interspeech 2011
ISCA Archive Interspeech 2011

Speaking to the crowd: looking at past achievements in using crowdsourcing for speech and predicting future challenges

Gabriel Parent, Maxine Eskenazi

This paper examines the literature on the use of crowdsourcing for speech-related tasks: speech acquisition, transcription and annotation as well as the assessment of speech technology. 29 papers were found, representing, 37 different experiments, which were annotated and analyzed to find trends in the field. The paper focuses on the different techniques used for quality control and the variety of sources of "crowds". Finally, we propose several challenges for the future of crowdsourcing for speech processing.