ISCA Archive Interspeech 2014
ISCA Archive Interspeech 2014

Towards a practical silent speech recognition system

Yunbin Deng, James T. Heaton, Geoffrey S. Meltzner

Our recent efforts towards developing a practical surface electromyography (sEMG) based silent speech recognition interface have resulted in significant advances in the hardware, software and algorithmic components of the system. In this paper, we report our algorithmic progress, specifically: sEMG feature extraction parameter optimization, advances in sEMG acoustic modeling, and sEMG sensor set reduction. The key findings are: 1) the gold-standard parameters for acoustic speech feature extraction are far from optimum for sEMG parameterization, 2) advances in state-of-the-art speech modelling can be leveraged to significantly enhance the continuous sEMG silent speech recognition accuracy, and 3) the number of sEMG sensors can be reduced by half with little impact on the final recognition accuracy, and the optimum sensor subset can be selected efficiently based on basic mono-phone HMM modeling.

doi: 10.21437/Interspeech.2014-296

Cite as: Deng, Y., Heaton, J.T., Meltzner, G.S. (2014) Towards a practical silent speech recognition system. Proc. Interspeech 2014, 1164-1168, doi: 10.21437/Interspeech.2014-296

  author={Yunbin Deng and James T. Heaton and Geoffrey S. Meltzner},
  title={{Towards a practical silent speech recognition system}},
  booktitle={Proc. Interspeech 2014},