Data processing: speech signal processing – linguistics – language – Linguistics – Natural language
Reexamination Certificate
2000-03-10
2002-11-05
Edouard, Patrick N. (Department: 2654)
Data processing: speech signal processing, linguistics, language
Linguistics
Natural language
C704S001000, C704S255000
Reexamination Certificate
active
06477488
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates to language modeling systems and more particularly to dynamic selection of context scope in latent semantic analysis (LSA) language modeling.
BACKGROUND OF THE INVENTION
In general, speech recognition is the process of converting acoustic signal into a linguistic message. In certain applications, for example where a speech recognition processor serves as a user interface to a database query system, the resulting message may need to contain enough information to reliably communicate a speaker's goal in accessing the database. However, in an application such as automated dictation or computer data entry, it may be necessary that the resulting message represents a verbatim transcription of a sequence of spoken words. In either case, an accurate statistical, or stochastic, language model is desirable for successful recognition.
Stochiastic language modeling places such a role in large vocabulary speech recognition in which it is typically used to constrain the acoustic analysis, guide the search through various (partial) text hypothesis, and/or contribute to the determination of the final transcription. Statistical language models using both syntactic and semantic information have been developed. This approach embeds latent semantic analysis (LSA), which is used to capture meaningful word associations in the available context of a document, into standard n-gram paradigm, which relies on the probability of occurrence in the language of all possible strings of N words.
This new class of language models, referred to as (multi-span) hybrid N-gram plus LSA models have shown a substantial reduction in perplexity. In addition, multi-span models have also been shown to significantly reduce word error rate. However, their overall performance tends to be sensitive to a number of factors. One such factor is the training data used to derive the statistical parameters, in particular those associated with the LSA component. This problem is common in statistical language modeling and can be solved by careful matching or training and test conditions. In addition, a dynamic selection of the LSA context scope during recognition affects the overall effectiveness of the hybrid models.
SUMMARY OF THE INVENTION
A method and system for dynamic language modeling of a document are described. In one embodiment, a number of local probabilities of a current document are computed and a vector representation of the current document in a latent semantic analysis (LSA) space is determined. In addition, a number of global probabilities based upon the vector representation of the current document in an LSA space is computed. Further, the local probabilities and the global probabilities are combined to produce the language modeling.
REFERENCES:
patent: 5301109 (1994-04-01), Landauer et al.
patent: 5317507 (1994-05-01), Gallant
patent: 5325298 (1994-06-01), Gallant
patent: 5621859 (1997-04-01), Schwartz et al.
patent: 5675819 (1997-10-01), Schuetze
patent: 5712957 (1998-01-01), Waibel et al.
patent: 5839106 (1998-11-01), Bellegarda
patent: 5867799 (1999-02-01), Lang et al.
Bellegarda, J., “A Latent Semantic Analysis Framework For Large-Span Language Modeling,” Proc. EuroSpeech '97 Rhodes, Greece, Sep. 1997, pp. 1451-1454.
Bellegarda, J., “A Multispan Language Modeling Framework for Large Vocabulary Speech Recognition,” IEEE Transaction on Speech and Audio Processing, vol. 6, No. 5, Sep. 1998, pp. 456-467.
Apple Computer Inc.
Blakely , Sokoloff, Taylor & Zafman LLP
Edouard Patrick N.
LandOfFree
Method for dynamic context scope selection in hybrid... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for dynamic context scope selection in hybrid..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for dynamic context scope selection in hybrid... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2940551