Data processing: speech signal processing – linguistics – language – Speech signal processing – Recognition
Patent
1997-07-30
1999-09-07
Hudspeth, David R.
Data processing: speech signal processing, linguistics, language
Speech signal processing
Recognition
704240, 704256, G10L 500
Patent
active
059501588
ABSTRACT:
Methods and apparatus for producing efficiently sized models suitable for pattern recognition purposes are described. Various embodiments are directed to the automated generation, evaluation, and selection of reduced size models from an initial model having a relatively large number of components, e.g., more components than can be stored for a particular intended application. To achieve model size reduction in an automated iterative manner, expectation maximization (EM) model training techniques are combined, in accordance with the present invention, with model size constraints. In one embodiment, a plurality of reduced size models are generated using a LaGrange multiplier from an input model and input size constraints. The plurality of reduced size models are stored in a buffer and scored using a likelihood scoring technique. The one of the reduced size models receiving the highest score may be selected as the reduced size model to be output or used as an input model during future iterations of the model size reduction process. The reduced size model to be used, e.g., for speech, image or other pattern recognition purposes, may be selected from the buffered models produced during multiple iterations of the model size reduction process.
REFERENCES:
patent: 4783804 (1988-11-01), Juang et al.
patent: 5606644 (1997-02-01), Chou et al.
patent: 5677988 (1997-10-01), Takami et al.
patent: 5765125 (1998-06-01), Daugherty et al.
patent: 5799277 (1998-08-01), Takami
Y. Normandin, Optimal Splitting of HMM Gaussian Mixture Components with MMIE Training, IEEE, Centre de Recherche Informatique de Montreal, pp. 449-452 (1995).
L. Rabiner and B.H. Juang, Fundamentals of Speech Recognition, Prentice Hall pp.ix to xi and 242-389, (1993).
B.H. Juang and S. Katagiri, Discriminative Learning for Minimum Error Classification, IEEE Transactions on Signal Processing, vol.40, No.12. pp.3043-3054 (Dec., 1992).
R.A. Redner and H.F. Walker, Mixture Densities, Maximum Likelihood the and EM Algorithm, Society for Industrial and Applied Mathematics, vol.26, No.2, pp.195-239 (Apr., 1984).
P.H. Winston, Artificial Intelligence, Addison-Wesley Publishing Company, pp.87-136 (1984).
J.C. Amazigo and L.A. Rubenfeld, Advanced Calculus and its Applications to the Engineering and Physical Sciences, John Wiley and Sons, pp. 145-282 (1980).
Stephen H. Friedberg, Arnold J. Insel, and Lawrence E. Spence, Linear Algebra, Prentice-Hall, Inc., pp.358-364, 1979.
Hudspeth David R.
Michaelson Peter L.
Nynex Science and Technology Inc.
Storm Donald L.
Straub Michael P.
LandOfFree
Methods and apparatus for decreasing the size of pattern recogni does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Methods and apparatus for decreasing the size of pattern recogni, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Methods and apparatus for decreasing the size of pattern recogni will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-1815224