Controller for partially observable systems

Data processing: artificial intelligence – Knowledge processing system – Knowledge representation and reasoning technique

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

C706S014000, C706S025000, C700S047000, C700S049000, C700S104000, C714S026000, C703S002000

Reexamination Certificate

active

07966276

ABSTRACT:
A controller is provided, operable to control a system on the basis of measurement data received from a plurality of sensors indicative of a state of the system, with at least partial autonomy, but in environments in which it is not possible to fully determine the state of the system on the basis of such sensor measurement data. The controller, includes: a system model, defining at least a set of probabilities for the dynamical evolution of the system and corresponding measurement models for the plurality of sensors of the system; a stochastic estimator operable to receive measurement data from the sensors and, with reference to the system model, to generate a plurality of samples each representative of the state of the system; a rule set corresponding to the system model, defining, for each of a plurality of possible samples representing possible states of the system, information defining an action to be carried out in the system; and an action selector, operable to receive an output of the stochastic estimator and to select, with reference to the rule set, information defining one or more corresponding actions to be performed in the system.

REFERENCES:
patent: 5608843 (1997-03-01), Baird, III
patent: 5864773 (1999-01-01), Barna et al.
patent: 6353815 (2002-03-01), Vilim
patent: 6564176 (2003-05-01), Kadtke et al.
patent: 6738682 (2004-05-01), Pasadyn
patent: 6823675 (2004-11-01), Brunell et al.
patent: 6868310 (2005-03-01), Nasman et al.
patent: 6917925 (2005-07-01), Berenji et al.
patent: 7085615 (2006-08-01), Persson et al.
patent: 7296007 (2007-11-01), Funge et al.
patent: 7363515 (2008-04-01), Frazier et al.
patent: 7536595 (2009-05-01), Hiltunen et al.
patent: 7539597 (2009-05-01), Wegerich et al.
patent: 2004/0124012 (2004-07-01), Dunlop
Andrieu C. et al., “Particle Methods for Change Detection, System Identification, and Control” Proceedings of the IEEE, New York, US, vol. 92:3, Mar. 2004, pp. 423-438.
Greenfield et al., “Adaptive Control of Nonlinear Stochastic Systems by Particle Filtering” Control and Automation, 2003. ICCA. Final Program and Book of Abstracts. The Forth International Conference on Jun. 10-12, 2003, Piscataway, N J, USA, IEEE, Jun. 10, 2003, pp. 887-890.
K. R. Joshi et al., “Automatic Recovery Using Bounded Partially Observable Markov Decision Processes”, International Conference on Dependable Systems and Networks, Jun. 25-28, 2006, pp. 445-456.
Xi-Ren Cao et al., “Partially observable Markov decision processes with reward information”, 43rd IEEE Conference on Decision and Control, 2004, vol: 4, pp. 4393-4398.
P. Laroche et al., “Mobile Robotics Planning using Abstract Markov Decision Processes”, 11th IEEE International Conference on Tools with Artificial Intelligence Proceedings, Nov. 9, 1999-Nov. 11, 1999, pp. 299-306.
International Search Report, Oct. 22, 2007, from International Patent Application No. PCT/GB2007/050391.
Andrieu C. et al., “Particle Methods for Change Detection, System Identification, and Control” Proceedings of the IEEE, New York, US, vol. 92:3, Mar. 2004, pp. 423-438.*
Greenfield et al., “Adaptive Control of Nonlinear Stochastic Systems by Particle Filtering” Control and Automation, 2003. ICCA. Final Program and Book of Abstracts. The Forth International Conference on Jun. 10-12, 2003, Piscataway, NJ, USA, IEEE, Jun. 10, 2003, pp. 887-890.*
European Patent Office, International Preliminary Report on Patentability and Written Opinion, Jan. 13, 2009, from International Patent Application No. PCT/GB2007/050391, filed on Jul. 10, 2007.
U.K. Patent Office, Search Report, Mar. 20, 2007, from related UK Patent Application No. GB0613955.4, filed Jul. 13, 2006.

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Controller for partially observable systems does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Controller for partially observable systems, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Controller for partially observable systems will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-2619455

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.