Data processing: artificial intelligence – Neural network – Learning task
Reexamination Certificate
2006-02-28
2006-02-28
Knight, Anthony (Department: 2121)
Data processing: artificial intelligence
Neural network
Learning task
Reexamination Certificate
active
07007001
ABSTRACT:
The present invention relates to a system and methodology to facilitate machine learning and predictive capabilities in a processing environment. In one aspect of the present invention, a Mutual Information Model is provided to facilitate predictive state determinations in accordance with signal or data analysis, and to mitigate classification error. The model parameters are computed by maximizing a convex combination of the mutual information between hidden states and the observations and the joint likelihood of states and observations in training data. Once the model parameters have been learned, new data can be accurately classified.
REFERENCES:
patent: 6581048 (2003-06-01), Werbos
Nuria Oliver and Ashutosh Garg, MIHMM: Mutual Information Hidden Markov Models, Proceedings of Int. Conf. on Machine Learning (ICML'02), Sidney, Australia, Jul. 2002, 8 pages.
Jeff A. Blimes, “Maximum Mutual Information Based Reduction Strategies For Cross-Correlation Based Joint Distributional Modeling”, IEEE, International Conference on Acoustics, Speech, and Signal Processing, Seattle, Washington, 1998, 4 pages.
“Maximum Mutual Information Estimation of Hidden Markov Model Parameters for Speech Recognition”; Lalit R. Bahl, et al.; ICASSP 86, Tokyo; pp. 1-4.
“An Input Output HMM Architecture”; Yoshua Bengio, et al..
“Dynamic Bayestian Multinets”; Jeff A. Bilmes; Department of Electrical Enginnering, Univ. of Washington.
Discovery and Segmentation of Activities in Video; Matthew Brand, et al.; IEEE Transactions on Pattern Analysis and Machine Intelligence; vol. 22; No. 8; Aug. 2000.
“Coupled Hidden Markov Models for Complex Action Recognition”; Matthew Brand, et al.; MIT Media Lab Perceptual Computing/Learning and Common Sense Technical Report 407; Nov. 10, 1996.
“Emotiion Recognition From Facial Expressions Using Multilevel HMM”; Ira Cohen, et al.; Beckman Institute for Advanced Science and Technology; pp. 1-7.
“Learning Variable Length Markov Models of Behaviour”; Aphrodite Galata, et al.; School of Computing; The University of Leeds, pp. 1-33.
“Audio-Visual Speaker Detection Using Dynamic Bayesian Networks”; Submission No. 182; pp. 1-6.
“Understanding Probabilistic Classifiers”; Ashutosh Garg, et al.; Department of Computer Science and the Beckman Institute; University of Illinois; pp. 1-12.
“Factorial Hidden Markov Models”; Zoubin Ghahramani, et al.; Computational Cognitive Science Technical Report 9502; May 16, 1995; pp. 1-13.
“Action-Reaction Learning: Analysis and Synthesis of Human Behaviour”; Tony Jebara; Massachusetts Institute of Technology; May 1998; pp. 1-100.
“Hidden Markov Decision Trees”; Michael I. Jordan, et al.; MIT Computational Cognitive Science Technical Report 9605.
“Towards Perceptual Intelligence; Statistical Modeling of Human Individual and Interactive Behaviors”; Submitted to the Program in Media Arts and Sciences on Apr. 28, 2000; pp. 1-297.
“Vision for a Smart Kiosk”; James M. Rehg; Computer Vision and Pattern Recognition; Jun. 1997, pp. 690-696.
Facial Emotion Recognition Using Multi-Model Information; Liyanage C. DeSilva; International Conference on Information, Communications and Signal Processing ICICS '97; Sep. 1997; pp. 397-401.
“The Information Bottleneck Method”; Naftali Tishby, et al.; The Hebrew University; pp 1-11.
“Recognition and Interpretation of Parametric Gesture”; Andew D. Wilson, et al.; Submitted to: International Conference on Computer Vision, 1998; pp. 1-9.
Garg Ashutosh
Oliver Nuria M.
Amin & Turocy LLP
Holmes Michael B.
Knight Anthony
Microsoft Corporation
LandOfFree
Maximizing mutual information between observations and... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Maximizing mutual information between observations and..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Maximizing mutual information between observations and... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3701782