Adaptation of exponential models

Details Adaptation of exponential models Adaptation of exponential models

2004-10-29

2010-12-28

Ahmed, Samir A (Department: 2624)

Image analysis

Pattern recognition

C382S155000, C382S160000, C382S190000, C382S220000, C704S256000

Reexamination Certificate

active

07860314

ABSTRACT:
A method and apparatus are provided for adapting an exponential probability model. In a first stage, a general-purpose background model is built from background data by determining a set of model parameters for the probability model based on a set of background data. The background model parameters are then used to define a prior model for the parameters of an adapted probability model that is adapted and more specific to an adaptation data set of interest. The adaptation data set is generally of much smaller size than the background data set. A second set of model parameters are then determined for the adapted probability model based on the set of adaptation data and the prior model.

REFERENCES:
patent: 5778397 (1998-07-01), Kupiec et al.
patent: 5794177 (1998-08-01), Carus et al.
patent: 5805771 (1998-09-01), Muthusamy et al.
patent: 5890103 (1999-03-01), Carus
patent: 6167369 (2000-12-01), Schulze
patent: 6490549 (2002-12-01), Ulicny et al.
patent: 6760695 (2004-07-01), Kuno et al.
patent: 6901399 (2005-05-01), Corston et al.
patent: 2002/0022956 (2002-02-01), Ukrainczyk et al.
patent: 2002/0188421 (2002-12-01), Tanigaki et al.
patent: 2006/0020448 (2006-01-01), Chelba et al.
Lafferty et al., “Conditional Random Fields: Probabilistic Models for Sementing and Labeling Sequence Data,” 2001, In Proc. 18thInternational conference on Machine Learning, pp. 281-289.
Goodman, “Exponential Priors for Maximum Entropy Models,” May 2-7, 2004, HLT-NAACL 2004, pp. 305-312.
Lafferty et al., “Conditional Random Fields: Probabilisitic Models for Segmenting and Labeling Sequence Data.” 2001, Morgan Kauffman, pp. 282-289.
Lafferty et al., “Conditional Random Fields: Probabilistic Models for Sementing and Labeling Sequence Data,” 2001, in Proc. 18th International conference on Machine Learning, pp. 281-289.
Doug Beeferman, “Text Segmentation Using Exponential Models,” 1997, Proceedings of the Second Conference on Empirical Models in Natural Language Processing.
A.L. Berger et al., 1996, “A Maximum Entropy Approach to Natural Language Processing,” Computational Linguistics, 22(1):39-72, March.
Eric Brill, 1994, “Some Advances in Transformation-Based Part of Speech Tagging,” In National Conference on Artificial Intelligence, pp. 722-727.
Stanley F. Chen and Ronald Rosenfeld, 2000, “A Survey of Smoothing Techniques for Maximum Entropy Models,” IEEE Transactions on Speech and Audio Processing, 8(1):37-50.
Michael Collins, 2002, “Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms,” In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 1-8, University of Pennsylvania, Philadelphia, PA, July, ACL.
Joshua Goodman, 2004, “Exponential Priors for Maximum Entropy Models,” In Daniel Marcu Susan Dumais and Salim Roukos, editors, HLT-NAACL 2004: Main Proceedings, pp. 305-312, Boston, Massachusetts, USA, May 2-7, Association for Computational Linguistics.
Ji-Hwan Kim et al., 2004, “Automatic Capitalization Generation for Speech Input,” Computer Speech and Language, 18(1): 67-90, January.
John Lafferty et al., 2001, “Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data,” In Proc. 18thInternational Conf. on Machine Learning; pp. 282-289, Morgan Kauffman, San Francisco, CA.
L. Lita, A. Ittycheriah, S. Roukos, and N. Kambhatla, 2003, “tRuEcasIng,” In Proceedings of ACL, pp. 152-159, Sapporo, Japan.
Doug B. Paul et al., 1992, “The Design for the Wall Street Journal-Based CSR Corpus,” In Proceedings of the DARPA SLS Workshop, February.
S. Della et al., 1995, “Inducing Features of Random Fields,” Technical Report SMU-CS-95-144, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA.
Adwait Ratnaparkhi, 1996, “A Maximum Entropy Model for Part-of-Speech Tagging,” In Eric Brill and Kenneth Church, editors, Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 133-142, Association for Computational Linguistics, Somerset, New Jersey.
Notice of First Office Action for Application No. 200510082351.2 filed Jun. 21, 2005.
Notice of a Second Office Action for related Chinese Patent Application 200510082351.2 dated Mar. 1, 2010.
Notice of a Third Office Action for related Chinese Patent Application 200510082351.2, dated Jun. 2, 2010.
Notice of a First Official Communication for related European Patent Application 05 106 512.6-2221, dated Aug. 30, 2006.

Affiliated with

Also associated with

Rating

Adaptation of exponential models does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Adaptation of exponential models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Adaptation of exponential models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4219760