Data processing: speech signal processing – linguistics – language – Linguistics – Natural language
Reexamination Certificate
2004-09-15
2009-11-24
Hudspeth, David R (Department: 2626)
Data processing: speech signal processing, linguistics, language
Linguistics
Natural language
C704S001000, C707S793000
Reexamination Certificate
active
07624006
ABSTRACT:
A statistical classifier is constructed by estimating Naïve Bayes classifiers such that the conditional likelihood of class given word sequence is maximized. The classifier is constructed using a rational function growth transform implemented for Naïve Bayes classifiers. The estimation method tunes the model parameters jointly for all classes such that the classifier discriminates between the correct class and the incorrect ones for a given training sentence or utterance. Optional parameter smoothing and/or convergence speedup can be used to improve model performance. The classifier can be integrated into a speech utterance classification system or other natural language processing system.
REFERENCES:
patent: 2004/0148154 (2004-07-01), Acero et al.
patent: 2004/0260677 (2004-12-01), Malpani et al.
J. Chu-Carroll and B. Carpenter, “Vector-based natural language call routing,”Computational Linguistics,vol. 25, No. 3, pp. 361-388, 1999.
A. L. Berger, S. A. Della Pietra, and V. J. Della Pietra, “A maximum entropy approach to natural language processing,”Computational Linguistics,vol. 22, No. 1, pp. 39-72, Mar. 1996.
P.S. Gopalakrishnan et al., “An inequality for rational functions with applications to some statistical estimation problems,”IEEE Transactions on Information Theory,vol. 37, No. 1, pp. 107-113, Jan. 1991.
F. Jelinek and R. Mercer, “Interpolated estimation of Markov souce parameters from sparse data,” inPattern Recognition in Practice,E. Gelsema nad L. Kanal, Eds., pp. 381-397, 1980.
S.F. Chen and R. Rosenfeld, “A Gaussian Prior for Smoothing Maximum Entropy Models,”IEEE Transactions on Speech and Audio Processing,vol. 8, No. 1, pp. 37-50, 2000.
D. Pallet et al., “1993 benchmark tests fro the ARPA spoken language program,” inProceedings of the Human Language Technology Workshop,C.J. Weinstein, Ed. Morgan Kaufmann, Plainsboro, NJ, Mar. 1994.
S. Young, “The HTK hidden Markov model toolkit: design and philosophy,” Tech. Rep. TR. 153, Department of Engineering, Cambridge University, UK, 1993.
Speech utterance classification, Chelba, C. Mahajan, M. Acero, A., Microsoft Corp., Redmond, WA, USA; This paper appears in:Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). 2003 IEEE International Conference onPublication Date: Apr. 6-10 2003, vol. 1, On pp. I-280-I-283 vol. 1.
Conditional Maximum Likelihood Estimation using Rational Function Growth Transform: abstract submitted to the Snowbird Learning Workshop (Utah, Apr. 6-9, 2004).
Conditional Maximum Likelihood Estimation of Naï{umlaut over ( )}ve Bayes Probability Models Using Rational Function Growth Transform Ciprian Chelba and Alex Acero, Apr. 5, 2004, Technical Report MSR-TR-2004-33, Microsoft Corporation.
A.L. Gorin, G. Ricardi, and J.H. Wright, “How may I help you?, ”Speech Communication,vol. 23, No. 1/2, pp. 113-127, 1997.
Christopher D. Manning and Hinrich Schutze,Foundations of Statistical Natural Language Processing, The MIT Press, Cambridge, Massachusetts, 2001.
Richard O. Duda, Peter E. Hart, and David G. Stork,Pattern Classification, John Wiley and Sons, Inc., second edition, 2001.
A.L. Gorin, G. Ricardi, and J.H. Wright,“How may I help you?,”Speech Communication, vol. 23, No. 1/2, pp. 113-127, 1997.
Acero Alejandro
Chelba Ciprian
Hudspeth David R
Koehler Steven M.
Microsoft Corporation
Neway Samuel G
Westman Champlin & Kelly P.A.
LandOfFree
Conditional maximum likelihood estimation of naïve... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Conditional maximum likelihood estimation of naïve..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Conditional maximum likelihood estimation of naïve... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4096506