ISCA Archive Interspeech 2014
ISCA Archive Interspeech 2014

Aero-tactile integration in fricatives: converting audio to air flow information for speech perception enhancement

Donald Derrick, Greg A. O'Beirne, Tom De Rybel, Jennifer Hay

We follow up on research demonstrating that aero-tactile information can enhance or interfere with accurate auditory perception among uninformed and untrained perceivers. We computationally extract aperiodic information from auditory recordings of speech, which represents turbulent air-flow produced from the lips. This extracted signal is used to drive a piezoelectric air-pump producing air-flow to the right temple simultaneous with presentation of auditory recordings. Using forced-choice experiments, we replicate previous results with stops, finding enhanced perception of /pa/ in /pa/ vs. /ba/ pairs, and /ta/ in /ta/ vs. /da/ pairs. We also found enhanced perception of /fa/ in /ba/ vs. /fa/ pairs, and /sha/ in /da/ vs. /sha/ pairs, demonstrating that air flow during fricative production contacting the skin can also enhance speech perception. The results show that aero-tactile information can be extracted from the audio signal and used to enhance speech perception of a large class of speech sounds found in many languages of the world.


doi: 10.21437/Interspeech.2014-553

Cite as: Derrick, D., O'Beirne, G.A., Rybel, T.D., Hay, J. (2014) Aero-tactile integration in fricatives: converting audio to air flow information for speech perception enhancement. Proc. Interspeech 2014, 2580-2584, doi: 10.21437/Interspeech.2014-553

@inproceedings{derrick14b_interspeech,
  author={Donald Derrick and Greg A. O'Beirne and Tom De Rybel and Jennifer Hay},
  title={{Aero-tactile integration in fricatives: converting audio to air flow information for speech perception enhancement}},
  year=2014,
  booktitle={Proc. Interspeech 2014},
  pages={2580--2584},
  doi={10.21437/Interspeech.2014-553},
  issn={2308-457X}
}