Name entity extraction using language models

Details Name entity extraction using language models Name entity extraction using language models

2007-11-20

2007-11-20

Hudspeth, David (Department: 2626)

Data processing: speech signal processing, linguistics, language

Speech signal processing

Recognition

C704S255000

Reexamination Certificate

active

10315400

ABSTRACT:
A name entity extraction technique using language models is provided. A general language model is provided for the natural language understanding domain. A language model is also provided for each name entity. The name entity language models are added to the general language model. Each language model is considered a state. Probabilities are applied for each transition within a state and between each state. For each word in an utterance, the name extraction process determines a best current state and a best previous state. When the end of the utterance is reached, the process traces back to find the best path. Each series of words in a state other than the general language model state is identified as a name entity. A technique is provided to iteratively extract names and retrain the general language model until the probabilities do not change. The name entity extraction technique of the present invention may also use a general language model with uniform probabilities to save the time and expense of training the general language model.

REFERENCES:
patent: 5644680 (1997-07-01), Bielby et al.
patent: 6052682 (2000-04-01), Miller et al.
patent: 6076054 (2000-06-01), Vysotsky et al.
patent: 6311152 (2001-10-01), Bai et al.
patent: 2003/0208354 (2003-11-01), Lin et al.
patent: 2004/0162729 (2004-08-01), Strong
Bikel, D. Schwartz, R. Weischedel, R. “An algorithm that learns what's in a name” Machine Learning pp. 211-213, 1999.
Gotoh, Y. Renals, S. Williams, G. “Named entity tagged language models” Acoustics, Speech and Signal Processing pp. 513-516, Mar. 1999.
Bikel, D. Miller, S. Schwartz, R. Weischedel, R. “Nymble: a high-performance learning name-finder” Proceedings in the 5th conference on applied natural language processing, pp. 194-201, 1997.
Brill, E. “Transformation-based error-driven learning and natural language processing: A case study in part of speech tagging”, Computational Linguistics, 1995.□□.
Collins, M. Singer, Y. “Unsupervised models for named entity classification”, Conference on Empiracal Methods in NLP and Very Large Corpora, 1999, pp. 100-110.

Affiliated with

Also associated with

Rating

Name entity extraction using language models does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Name entity extraction using language models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Name entity extraction using language models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3811969