Data processing: structural design – modeling – simulation – and em – Modeling by mathematical expression
Reexamination Certificate
2006-10-03
2006-10-03
Rodriguez, Paul (Department: 2123)
Data processing: structural design, modeling, simulation, and em
Modeling by mathematical expression
C700S029000, C700S102000, C700S044000, C706S012000, C706S013000
Reexamination Certificate
active
07117130
ABSTRACT:
Stochastic control problems of linear systems in high dimensions are solved by modeling a structured Markov Decision Process (MDP). A state space for the MDP is a polyhedron in a Euclidean space and one or more actions that are feasible in a state of the state space are linearly constrained with respect to the state. One or more approximations are built from above and from below to a value function for the state using representations that facilitate the computation of approximately optimal actions at any given state by linear programming.
REFERENCES:
patent: 5971585 (1999-10-01), Dangat et al.
patent: 6041267 (2000-03-01), Dangat et al.
patent: 6064819 (2000-05-01), Franssen et al.
patent: 6151582 (2000-11-01), Huang et al.
patent: 6189132 (2001-02-01), Heng et al.
patent: 6341266 (2002-01-01), Braun
patent: 6671673 (2003-12-01), Baseman et al.
Viniotis et al., “Linear Programming as a technique for optimization of queueing systems”, IEEE 1988.
Schneider et al., “Stochastic production scheduling to meet demand forecasts”, IEEE 1998.
Hedlund, et al., “Optimal control of hybrid systems”, IEEE 1997.
Lasserre, “Average optimal stationary policies and linear programming in countable space Markov decision processes”, IEEE 1992.
J. Filar and K. Vrieze, “Competitive Markov Decision Process,” Springer-Verlag, pp. 1-6 (1996).
R. Bellman, “Dynamic Programming,” Princeton University Press, pp. 3-5, 317-318 (1957).
M.L. Puterman, “Markov Decision Processes: Discrete Stochastic Dynamic Programming,” John Wiley and Sons, Inc., pp. 142-143 (1994).
G.J. Gordon, “Approximate Solutions to Markov Decision Processes,” Doctoral dissertation, School of Computer Science, Carnegie Mellon University, pp. 1-140 (1999).
Gates & Cooper LLP
International Business Machines - Corporation
Rodriguez Paul
Thangavelu Kandasamy
LandOfFree
Method for solving stochastic control problems of linear... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for solving stochastic control problems of linear..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for solving stochastic control problems of linear... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3644543