In our previous work, we proposed a feature compensation approach using high-order vector Taylor series approximation for noisy speech recognition. In this paper, first we improve the feature compensation in both efficiency and accuracy by boosted mixture learning of GMM, applying higher order information of VTS approximation only to the noisy speech mean parameters, acoustic context expansion, and modeling the convolutional distortion as a single Gaussian. Then we design a procedure to perform irrelevant variability normalization based joint training of GMM and HMM using VTS-based feature compensation. The effectiveness of our proposed approach is confirmed by experiments on Aurora3 database.

Index Terms: irrelevant variability normalization, feature compensation, vector Taylor series.