Method for noise adaptation in automatic speech recognition...

Details Method for noise adaptation in automatic speech recognition... Method for noise adaptation in automatic speech recognition...

2000-04-18

2003-03-04

Banks-Harold, Marsha D. (Department: 2654)

Data processing: speech signal processing, linguistics, language

Speech signal processing

Recognition

C704S256000

Reexamination Certificate

active

06529872

ABSTRACT:

BACKGROUND AND SUMMARY OF THE INVENTION
The present invention relates generally to automatic speech recognition systems. More particularly, the invention relates to techniques for adapting the recognizer to perform better in the presence of noise.
Current automatic speech recognition systems perform reasonably well in laboratory conditions, but degrade rapidly when used in real world applications. One of the important factors influencing recognizer performance in real world applications is the presence of environmental noise that corrupts the speech signal. A number of methods, such as spectral subtraction or parallel model combination, have been developed to address the noise problem. However, these solutions are either too limited or too computationally expensive.
Recently, a Jacobian adaptation method has been proposed to deal with additive noise, where the noise changes from noise A to noise B. For example, U.S. Pat. No. 6,026,359 to Yamaguchi describes such a scheme for model adaptation in pattern recognition, based on storing Jacobian matrices of a Taylor expansion that expresses model parameters. However, for this method to perform well it is necessary to have noise A and noise B close to one another in terms of character and level. For example, the Jacobian adaptation technique is likely to work well where noise A is measured within the passenger compartment of a given vehicle travelling on a smooth road at 30 miles an hour, and where Noise B is of a similar character, such as the noise measured inside the same vehicle on the same road travelling at 45 miles per hour.
The known Jacobian adaptation technique begins to fail where noise A and B lie farther apart from one another, such as where noise A is measured inside the vehicle described above at 30 miles per hour and noise B is measured in the vehicle with windows down or at 60 miles per hour.
This shortcoming of the proposed Jacobian noise adaptation method limits its usefulness in many practical applications because it is often difficult to anticipate at training time the noise that may be present at testing time (when the system is in use). Also, improvements in Jacobian noise adaptation techniques are limited in many applications because the computational expense (processing time and/or memory requirements) needed makes them impractical.
The present invention addresses the foregoing shortcoming. Instead of using Jacobian matrices, the invention uses a transformed matrices which resembles the form of a Jacobian matrix but comprises different values. The transformed matrices compensate for the fact that the respective noises at training time and at recognition time may be far apart. The presently preferred embodiment of the inventive method effects a linear or non-linear transformation of the Jacobian matrices using an &agr;-adaptation parameter to develop the transformed matrices. The transformation process can alternatively be effected through other linear or non-linear transformation means, such as using a neural network or other artificial intelligence mechanism. To speed computation, the resulting transformed matrices may be reduced through a dimensionality reduction technique such as principal component analysis.
For a more complete understanding of the invention, its objects and advantages, refer to the following specification and to the accompanying drawings.


REFERENCES:
patent: 5226092 (1993-07-01), Chen
patent: 6026359 (2000-02-01), Yamaguchi et al.
patent: 6154716 (2000-11-01), Lee
patent: 6182270 (2001-01-01), Feldmann et al.
M.J.F. Gales, “Predictive Model-Based Compensation Schemes For Robust Speech Recognition,” Elsevier, Speech Communication 25 (1998) 49-74.
Pedro J. Moreno, Bhiksha Raj and Richard M. Stern, “A Vector Taylor Series Approach For Environment-Independent Speech Recognition,” 1995 IEEE, pp. 733-736.
Afify, M. et al., “A General Joint Additive and Convolutive Bias Compensation Approach Applied To Noisy Lombard Speech Recognition”, Nov. 6, 1998, IEEE Transactions on Speech and Audio Processing, IEEE Inc. New York, US, vol. 6, No. 6, pp. 524-538.
Chang, Y. H. et al., “Improved Model Parameter Compensation Methods For Noise-Robust Speech Recognition”, May 12, 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98, Seattle, WA, May 12-15, 1998, vol. 1, Conf. 23, pp. 561-564.
Gales, M.J. F. et al., “Robust Speech Recognition in Additive and Convolutional Noise Using Parallel Model Combinaton”, Oct. 1, 1995, vol. 9, No. 4, pp. 289-307, Computer Speech and Language, Academic Press, London, GB.
Sagayama S. et al., “Jacobian Approach To Fast Acoustic Model Adaptation”, 1997, vol. 1, Apr. 21, 1997, pp. 835-838, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing. Speech Processing, Munich, Apr. 21-24, 1997, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Los Alamitos, IEEE Comp. Soc. Press, US.
Cerisara et al.; “Environmental Adaptation Based on First Order Approximation”; Panasonic Speech Technology Laboratory; Santa Barbara, California.
Sagayama et al.; “Jacobian Approach to Fast Acoustic Model Adaptation”; NTT Human Interface Laboratories; IEEE, 1997; pp. 835-838.
Leggetter et al.; “Flexible Speaker Adaptation Using Maximum Likelihood Linear Regression”; Cambridge University Engineering Department; Cambridge, United Kingdom.

Affiliated with

Also associated with

Rating

Method for noise adaptation in automatic speech recognition... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method for noise adaptation in automatic speech recognition..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for noise adaptation in automatic speech recognition... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3007302