Data processing: speech signal processing – linguistics – language – Speech signal processing – Recognition
Patent
1997-07-30
1999-10-05
Hudspeth, David R.
Data processing: speech signal processing, linguistics, language
Speech signal processing
Recognition
704240, 704256, G10L 914
Patent
active
059639024
ABSTRACT:
Methods and apparatus for producing efficiently sized models suitable for pattern recognition purposes are described. Various embodiments are directed to the automated generation, evaluation, and selection of reduced size models from an initial model having a relatively large number of components, e.g., more components than can be stored for a particular intended application. To achieve model size reduction in an automated iterative manner, expectation maximization (EM) model training techniques are combined, in accordance with the present invention, with model size constraints. In one embodiment, a new reduced size model is generated using a LaGrange multiplier from an input model and input size constraints during each iteration of the size reducing model training process. The reduced size model generated during one iteration of the process serves as the input to the next iteration. Scoring, e.g., maximum likelihood scoring, and evaluation steps, in conjunction with stop criteria, are used to determine the number of model size reducing iterations performed, and which reduced size model is selected as the output of the size reduction model training process.
REFERENCES:
patent: 4783804 (1988-11-01), Juang et al.
patent: 5606644 (1997-02-01), Chou et al.
patent: 5677988 (1997-10-01), Takami et al.
patent: 5715367 (1998-02-01), Gillick et al.
patent: 5765125 (1998-06-01), Daugherty et al.
patent: 5799277 (1998-08-01), Takami
Y. Normandin, Optimal Splitting of HMM Gaussian Mixture Components with MMIE Training, IEEE, Centre de Recherche Informatique de Montreal, pp. 449-452 (1995).
L. Rabiner and B.H. Juang, Fundamentals of Speech Recognition, Prentice Hall pp.ix to xi and 242-389, (1993).
B.H. Juang and S. Katagiri, Discriminative Learning for Minimum Error Classification, IEEE Transactions on Signal Processing, vol.40, No.12. pp. 3043-3054 (Dec., 1992).
R.A. Redner and H. F. Walker, Mixture Densities, Maximum Likelihood and the EM Algorithm, Society for Industrial and Applied Mathematics, vol. 26, No. 2, pp. 195-239 (Apr., 1984).
P.H. Winston, Artificial Intelligence, Addison-Wesley Publishing Company, pp. 87-136 (1984).
J.C. Amazigo and L.A. Rubenfeld, Advanced Calculus and its Applications to the Engineering and Physical Sciences, John Wiley and Sons, pp. 130-302 (1980).
Stephen H. Friedberg, Arnold J. Insel, and Lawrence E. Spence, Linear Algebra Prentice-Hall, Inc., pp. 358-364, 1979.
Hudspeth David R.
Michaelson Peter L.
NYNEX Science & Technology, Inc.
Storm Donald L.
Straub Michael P.
LandOfFree
Methods and apparatus for decreasing the size of generated model does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Methods and apparatus for decreasing the size of generated model, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Methods and apparatus for decreasing the size of generated model will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-1183258