Data processing: artificial intelligence – Machine learning – Genetic algorithm and genetic programming system
Patent
1996-07-12
1999-08-31
Downs, Robert W.
Data processing: artificial intelligence
Machine learning
Genetic algorithm and genetic programming system
395 81, 701301, G06F 1518
Patent
active
059466731
ABSTRACT:
In a computer implemented learning and/or process control system, a computer model is constituted by the most currently fit entity in a population of computer program entities. The computer model defines fitness as a function of inputs and outputs. A computing unit accesses the model with a set of inputs, and determines a set of outputs for which the fitness is highest. This associates a sensory-motor (input-output) state with a fitness in a manner that might be termed "feeling". The learning and/or control system preferably utilizes a compiling Genetic Programming system (CGPS) in which one or more machine code entities such as functions are created which represent solutions to a problem and are directly executable by a computer. The programs are created and altered by a program in a higher level language such as "C" which is not directly executable, but requires translation into executable machine code through compilation, interpretation, translation, etc. The entities are initially created as an integer array that can be altered by the program as data, and are executed by the program by recasting a pointer to the array as a function type. The entities are evaluated by executing them with training data as inputs, and calculating fitnesses based on a predetermined criterion. The entities are then altered based on their fitnesses using a genetic machine learning algorithm by recasting the pointer to the array as a data (e.g. integer) type. This process is iteratively repeated until an end criterion is reached.
REFERENCES:
patent: 4697242 (1987-09-01), Holland et al.
patent: 4821333 (1989-04-01), Gillies
patent: 4881178 (1989-11-01), Holland et al.
patent: 4935877 (1990-06-01), Koza
patent: 4961152 (1990-10-01), Davis
patent: 5048095 (1991-09-01), Bhanu et al.
patent: 5111531 (1992-05-01), Grayson et al.
patent: 5113482 (1992-05-01), Lynne
patent: 5136686 (1992-08-01), Koza
patent: 5140530 (1992-08-01), Guha et al.
patent: 5148513 (1992-09-01), Koza et al.
patent: 5150289 (1992-09-01), Badavas
patent: 5159660 (1992-10-01), Lu et al.
patent: 5172253 (1992-12-01), Lynne
patent: 5182793 (1993-01-01), Alexander et al.
patent: 5222192 (1993-06-01), Shaefer
patent: 5224176 (1993-06-01), Crain
patent: 5245696 (1993-09-01), Stork et al.
patent: 5249259 (1993-09-01), Harvey
patent: 5255345 (1993-10-01), Shaefer
patent: 5257343 (1993-10-01), Kyuma et al.
patent: 5274744 (1993-12-01), Yu et al.
patent: 5301256 (1994-04-01), Nakamura
patent: 5343554 (1994-08-01), Koza et al.
patent: 5367612 (1994-11-01), Bozich et al.
patent: 5390282 (1995-02-01), Koza et al.
patent: 5390283 (1995-02-01), Eshelman et al.
patent: 5394509 (1995-02-01), Winston
patent: 5400436 (1995-03-01), Nara et al.
patent: 5410634 (1995-04-01), Li
patent: 5414865 (1995-05-01), Beran
patent: 5428709 (1995-06-01), Banzhaf
patent: 5434796 (1995-07-01), Weininger
patent: 5440723 (1995-08-01), Arnold et al.
patent: 5448681 (1995-09-01), Khan
patent: 5455938 (1995-10-01), Ahmed et al.
patent: 5471593 (1995-11-01), Branigan
patent: 5493631 (1996-02-01), Huang et al.
patent: 5504841 (1996-04-01), Tani
patent: 5566275 (1996-10-01), Kano
patent: 5608843 (1997-03-01), Baird, III
Andrew Schulman, David Maxey, Matt Pietrek, "Undocumented Windows", 1992, pp. 189-398, Addison-Wesley Publishing Company.
Chris Gatercole & Peter Ross, "Dynamic Training Subset Selection for Supervised Learning in Genetic Programming", Feb. 25, 1994, pp. 1-10, Department of Artificial Intelligence University of Edinburgh, Edinburgh EH1 1HN U.K.
R. Huang and T.C. Fogarty, "Adaptive Classification and Control-Rule Optimisation via a Learning Algorithm for Controlling a Dynamic System," Proc. 30th Conf. on Decision and Control, pp. 867-868, Dec. 1991.
L.E. Lansberry and L. Wozniak, "Adaptive Hydrogenerator Governor Tuning with a Genetic Algorithm," IEEE Trans. on Energy Conversion, vol. 9, No. 1, pp. 179-185, Mar. 1994.
L. Moyne, et al., "Genetic Model Reference Adaptive Control," 1994 IEEE Int'l Symp. on Intelligent Control, pp. 219-224, Aug. 1994.
K.-T. Lee, et al., "Genetic-Based Reinforcement Learning for Fuzzy Logic Control Systems," 1995 IEEE Int'l Conf. on Systems, Man and Cybernetics, vol. 2, pp. 1057-1060, Oct. 1995.
W.-P. Lee, et al., "A Hybrid GP/GA Approach for Co-evolving Controllers and Robot Bodies to Achieve Fitness-Specified Tasks," Proc. 1996 IEEE Int'l. Conf. on Evolutionary Computation, pp. 384-389, May 1996.
Q. Wang and A.M.S. Zalzala, "Transputer Based GA Motion Control for PUMA Robot," Mechatronics, vol. 6(3), pp. 349-365, Apr. 1996.
Ray, T.S., "Is It Alive Or Is It GA?", School of Life & Health Sciences, University of Delaware, Jul., 1991, XP 002047764, pp. 527-534.
R. Huang and T.C. Fogarty, "Adaptive Classification and Control-Rule Optimisation via a Learning Algorithm for Controlling a Dynamic System," Proc. 30th Conf. on Decision and Control, vol. 1, pp. 867-868, Dec. 1991.
E.-G. Talbi and T. Muntean, "Designing Embedded Parallel Systems with Parallel Genetic Algorithms," IEE Colloquium on `Genetic Algorithms for Control Systems Engineering`,pp. 7/1-2, May 1993.
I. Ashiru and C. Czarnecki, "Optimal Motion Planning for Mobile Robots using Genetic Algorithms," IEEEE/IAS Int'l. Conf. on Industrial Automation and Control, pp. 297-300, Jan. 1995.
Q. Wang and A.M.S. Zalzala, "Genetic Control of Near Time-optimal Motion for an Industrial Robot Arm," Proc. Int'l. Conf. on Robotics and Automation, vol. 3, pp. 2592-2597, Apr. 1996.
W.L. Baker and J.A. Farrell, "An Introduction to Connectionist Learning Control Systems", Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches; Ch. 2, pp. 35-63, Van Nostrand Reinhold, New York, 1992.
P.J. Werbos, "Neurocontrol and Supervised Learning: An Overview and Evaluation", Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches; Ch. 3, pp. 65-89, Van Nostrand Reinhold, New York, 1992.
R. Langari and H.R. Berenji, "Fuzzy Logic in Control Engineering", Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches; Ch. 4, pp. 93-137, Van Nostrand Reinhold, New York, 1992.
J.A. Franklin and D.A. White, "Artificial Neural Networks in Manufacturing and Process Control", Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches; Ch. 8, pp. 235-258, Van Nostrand Reinhold, New York, 1992.
D.A. Sofge and T.C. White, "Applied Learning: Optimal Control of Manufacturing", Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches; Ch. 9, pp. 259-Van Nostrand Reinhold, New York, 1992.
P.J. Werbos, T. McAvoy and T. Su, "Neural Networks, System Identification, and Control in the Chemical Process Industries", Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approachesl Ch. 10, pp. 283-356, Van Nostrand Reinhold, New York, 1992.
A.G. Barto, "Reinforcement Learning and Adaptvie Critic Methods", Handbook of Intelligent Control: Neural, Fuzzy, and Adapative Approaches; Ch. 12, pp. 469-491, Van Nostrand Reinhold, New York, 1992.
P.J. Werbos, "Approximate Dynamic Programming for Real-Time Control and Neural Modeling", Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches; Ch. 13, pp. 493-525, Van Nostrand Reinhold New York, 1992.
S.B. Thrun, "The Role of Exploration in Learning Control", Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches; CH. 14, pp. 527-559, Van Nostrand Reinhold, New York, 1992.
S.P. Singh and R.S. Sutton,"Reinforcement Learning with Replacing Eligibility Traces", Machine Learning, 1, pp. 1036, Jan.-Mar. 1996, pp. 123-158.
T. Jaakkola, S.P. Singh and M.I. Jordan, "Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems," Dept. of Brain & Cognitive Sciences, Cambridge, Ma, Dec. 1994.
S.P. Singh, "An (almost) Tutorial on Reinforcement Learning", Learning to SOlve Markovian Decision Tasks, Chapters 2,3 and 4, Ph.D. Thesis, pp. 1-75, 1993.
P.J. Werbos, "Optimization Methods for Brain-Like Intelligent Control", National Science Foundation, Arlington, VA, Dec. 1995, IEEE.
P.J. Werbos, "Optimal Neurocontrol: Practical Benefits, New Results and Biological Evidence", Nat'l
Banzhaf Wolfgang
Francone Frank D.
Nordin Peter
Alexander David G.
Downs Robert W.
LandOfFree
Computer implemented machine learning and control system does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Computer implemented machine learning and control system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Computer implemented machine learning and control system will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2428849