Data processing: speech signal processing – linguistics – language – Linguistics – Natural language
Reexamination Certificate
2007-10-23
2007-10-23
Hudspeth, David (Department: 2626)
Data processing: speech signal processing, linguistics, language
Linguistics
Natural language
Reexamination Certificate
active
11401507
ABSTRACT:
A method for creating a language model from a task-independent corpus is provided. In one embodiment, a task dependent unified language model is created. The unified language model includes a plurality of context-free grammars having non-terminals and a hybrid N-gram model having at least some of the same non-terminals embedded therein.
REFERENCES:
patent: 4831550 (1989-05-01), Katz
patent: 4945566 (1990-07-01), Mergel et al.
patent: 4947438 (1990-08-01), Paeseler
patent: 4984178 (1991-01-01), Hemphill et al.
patent: 5263117 (1993-11-01), Nadas et al.
patent: 5384892 (1995-01-01), Strong
patent: 5477451 (1995-12-01), Brown et al.
patent: 5502774 (1996-03-01), Bellegarda et al.
patent: 5594641 (1997-01-01), Kaplan et al.
patent: 5615296 (1997-03-01), Stanford et al.
patent: 5621809 (1997-04-01), Bellegarda et al.
patent: 5625554 (1997-04-01), Cutting et al.
patent: 5680511 (1997-10-01), Baker et al.
patent: 5689617 (1997-11-01), Pallakoff et al.
patent: 5710866 (1998-01-01), Alleva et al.
patent: 5752052 (1998-05-01), Richardson et al.
patent: 5765133 (1998-06-01), Antoniol et al.
patent: 5819220 (1998-10-01), Sarukkai et al.
patent: 5829000 (1998-10-01), Huang et al.
patent: 5835888 (1998-11-01), Kanevsky et al.
patent: 5878390 (1999-03-01), Kawai et al.
patent: 5899973 (1999-05-01), Bandara et al.
patent: 5905972 (1999-05-01), Huang et al.
patent: 5913193 (1999-06-01), Huang et al.
patent: 5937384 (1999-08-01), Huang et al.
patent: 5963903 (1999-10-01), Hon et al.
patent: 6032111 (2000-02-01), Mohri
patent: 6073091 (2000-06-01), Kanevsky et al.
patent: 6081799 (2000-06-01), Beavin et al.
patent: 6141641 (2000-10-01), Hwang et al.
patent: 6154722 (2000-11-01), Bellegarda
patent: 6157912 (2000-12-01), Kneser et al.
patent: 6167398 (2000-12-01), Wyard et al.
patent: 6182039 (2001-01-01), Rigazio et al.
patent: 6188976 (2001-02-01), Ramaswamy
patent: 6418431 (2002-07-01), Mahajan et al.
patent: 0 645 757 (1995-03-01), None
patent: 0 687 987 (1995-12-01), None
patent: WO 96/41333 (1996-12-01), None
patent: WO 98/34180 (1998-08-01), None
Galescu, L., E.K. Ringger, and J. Allen, “Rapid Language Model Development for New Task Domains”, in Proceedings for the ELRA First International Conference on Language Resources and Evaluation (LREC), 1998, Granada, Spain.
Nasr, A., et al., “A Language Model Combining N-grams and Stochastic Finite State Automata”, in Eurospeech, 1999.
Wang, Y.-Y, “A Robust Parser for Spoken Language Understanding”, in Eurospeech, 1999, Hungary.
Mahajan, M., D. Beeferman, and X.D. Huang, “Improved Topic-Dependent Language Modeling Using Information Retrieval Techniques”, in ICASSP, 1999, Phoenix, AZ., USA.
Goodman, J.T., “Putting It All Together: Language Model Combination,” Acoustics, Speech, and Signal Processing, 2000. ICASSP '00 Inern'l Conf. On, v. 3, pp. 1647-1650.
Wang, Ye-Yi et al., “A Unified Context-Free Grammar and N-gram Model for Spoken Language Processing,” Acoustics, Speech, and Signal Processing, 2000 IEEE Intern'l Conf. On, v. 3, pp. 1639-1642.
Tsukada, H. et al., “Reliable Utterance Segment Recognition by Integrating a Grammar with Statistical Language Constraints,” Speech Communications, Elsevier Science Publishers, Dec. 1998, vol. 26, No. 4, pp. 299-309.
Moore, R., “Using Natural-Language Knowledge Sources in Speech Recognition,” Computational Models of Speech Pattern Processing, Proceedings of Computational Models of Speech Pattern Processing, Jul. 1997, pp. 304-327.
Tawezawa, T. et al., “Dialogue Speech Recognition Using Syntactic Rules Based on Subtrees and Preterminal Bigrams,” Systems & Computers in Japan, Scripta Technica Journals, May 1, 1997, vol. 28, No. 5, pp. 22-32.
Hwang, M.Y., et al. “Predicting unseen Triphones with Senones,” IEEE Transactions on Speech and Audio Processing, Nov. 6, 1996, pp. 412-419.
Kawabata, T., et al., “Back-Off Method for N-gram Smoothing Based on Binomial Posterior Distribution,” Acoustics, Speech, and Signal Processing, 1996. ICASSP-96, v. 1, pp. 192-195.
Database Inspec ′Online!, Institute of Electrical Engineers, “Improvement of a Probabilistic CFG Using a Cluster-based language Modeling Technique,” & “Methodologies for the Conception, Design, and Application of Intelligent Systems,” Abstract, 1993.
Huang, X, et al., “Microsoft Windows Highly Intelligent Speech Recognizer: Whisper,” 1195, IEEE, pp. 93-96.
Lloyd-Thomas, H., et al., “An Integrated Grammar/Bigram Language Model Using Path Scores,” Proceedings of the International Conference on Acoustics, Sppech and Signal Processing, May 9, 1995, vol. 1 pp. 173-176.
Meteer, M., et al., “Statistical Language Modeling Combining N-gram and Context-Free Grammars,” Speech Proceesing, Mpls., Apr. 27-30, 1993, ICASSP, New York, IEEE, Apr. 27, 1993, vol. 2, pp. II-37-40.
Lippmann, E.A., et al., “Multi-Style Training for Robust Isolated-Word Speech Recognition,” Proceedings of DARPA Speech Recognition Workshop, Mar. 24-26, 1987, pp. 96-99.
U.S. Appl. No. 09/585,298, Office Action, Aug. 12, 2004.
U.S. Appl. No. 09/585,298, Amendment, Dec. 13, 2004.
Mergel, A. et al., “Construction of Language Models for Spoken Database Queries”, IEEE, 1987, pp. 844-847.
Ward, W., “Understanding Spontaneous Speech: The Phoenix System”, Proceedings ICASSP, 1991, pp. 365-367.
Matsunaga et al., “Task Adaptation in Stochastic Language Models for Continuous Speech Recognition”, IEEE Mar. 23, 1992, pp. I-165-I-168.
Moore, R., et al., “Combining Linguistic and Statistical Knowledge Sources in Natural-Language Processing for ATIS”, in Proceedings for the ARPA Spoken Language Systems Technology Workshop, 1995, Morgan Kaufmann, Los Altos, CA; Austin, Texas.
PJ Wyard et al., “Spoken Language Systems-Beyond Prompt and Response”, BT Technology Journal, Jan. 1996, No. 1, pp. 187-205.
Huang, X., et al., “From Sphinx II to Whisper: Making Speech Recognition Usable, in Automatic Speech and Speaker Recognition”, C.H. Lee, F.K. Soong, and K.K. Paliwal, Editors, 1996, Klewer Academic Publishers: Norwell, MA., pp. 481-508.
“Implications of the Perplexity Definition”, Eagles Handbook of Standards and Resources for Spoken Language Systems, Online!, May 1997.
Kneser et al., “Semantic Clustering for Adaptive Language Modeling”, IEEE, 1997, pp. 770-782.
Mastaki et al., “Task Adaptation Using Map Estimation in N-gram Language Modeling”, IEEE, 1997, pp. 783-786.
Niesler et al., “Modeling Word-Pair Relations in a Category-Based Language Model”, IEEE, 1997, pp. 795-798.
Bellegarda, J., “A Statistical Language Modeling Approach Integrating Local and Global Constraints”, IEEE, 1997, pp. 262-269.
Seneff, S., “The Use of Linguistic hierarchies in Speech Understanding”, in ICSLP, 1998, Sydney, Australia.
Gillett, J. and W. Ward, “A Language Model Combining Trigrams and Stochastic Context-Free Grammars”, in ICSLP, 1998, Sydney, Australia.
Huang Xuedong D.
Mahajan Milind V.
Mou Xiaolong
Wang Ye-Yi
Fronek Todd R.
Hudspeth David
Ng Eunice
Westman Champlin & Kelly P.A.
LandOfFree
Creating a language model for a language processing system does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Creating a language model for a language processing system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Creating a language model for a language processing system will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3894738