Missing data reconstruction for robust automatic speech recognition in the framework of hybrid HMM/ANN systems

Stéphane Dupont
1998 5th International Conference on Spoken Language Processing (ICSLP 1998)   unpublished
In this paper, we propose to use the missing data theory to allow the reconstruction of missing spectro-temporal parameters in the framework of hybrid HMM/ANN systems. A simple signal-to-noise ratio estimator is used to automatically detect the components that are unavailable or corrupted by noise (missing components). A limited number of multidimensional gaussian distributions are then used to reconstruct those missing components solely on the basis of the present data. The reconstructed
more » ... s are then used as input to an artificial neural network estimating the HMM state probabilities. Continuous speech recognition experiments have been done on filtered speech. In this case, filtered components carry few or no information at all, and hence, should probably be ignored. The results presented in this paper illustrate this point of view. Complementary experiments also suggest the interest of the proposed approach in the case of noisy speech.
doi:10.21437/icslp.1998-323 fatcat:ze5bgottnzaftcxafovuhiyoi4