Residual activation neural network

Details Residual activation neural network Residual activation neural network

1994-09-16

1996-09-24

Envall, Jr., Roy N.

Boots, shoes, and leggings

364148, 364149, 395 23, G05B 1302, G06F 1518

Patent

active

055596908

ABSTRACT:
A plant (72) is operable to receive control inputs c(t) and provide an output y(t). The plant (72) has associated therewith state variables s(t) that are not variable. A control network (74) is provided that accurately models the plant (72). The output of the control network (74) provides a predicted output which is combined with a desired output to generate an error. This error is back propagated through an inverse control network (76), which is the inverse of the control network (74) to generate a control error signal that is input to a distributed control system (73) to vary the control inputs to the plant (72) in order to change the output y(t) to meet the desired output. The control network (74) is comprised of a first network NET 1 that is operable to store a representation of the dependency of the control variables on the state variables. The predicted result is subtracted from the actual state variable input and stored as a residual in a residual layer (102). The output of the residual layer (102) is input to a hidden layer (108) which also receives the control inputs to generate a predicted output in an output layer (106). During back propagation of error, the residual values in the residual layer (102) are latched and only the control inputs allowed to vary.

REFERENCES:
patent: 4912753 (1990-03-01), Evans, Jr.
patent: 4928484 (1990-05-01), Peczkowski
patent: 4972363 (1990-11-01), Nguyen et al.
patent: 4979126 (1990-12-01), Pao et al.
patent: 5111531 (1992-05-01), Grayson et al.
patent: 5113483 (1992-05-01), Keeler et al.
patent: 5353207 (1994-10-01), Keeler et al.
John Moody, "Fast Learning in Multi-Resolution Hierarchies", Yale Computer Science, pp. 1-11.
Yann Le Cun, John S. Denker and Sara A. Solla, "Optimal Brain Damage" in Advances in Neural Information Processing Systems 2, edited by David S. Touretzky, 1990, pp. 598-605.
Andreas S. Weigend, David E. Rumelhart and Barnardo A. Huberman, "Generalization by Weight-Elimination with Application to Forcasting" in Advances in Neural Information Processing Systems 3, edited by Richard p. Lippmann, John E. Moody and David S. Touretzky, 1991, pp. 875-882.
Demetri Psaltis, Athanasios Sideris and Alan Yamamura, "Neural Controllers", IEEE First International Conference on Neural Networks, Jun. 21-24, 1987, IV-551-558.
Julio Tanomaur and Cigar Aimed, "Towards Effective Neuomorphic Controllers", ICON '91, pp. 1395-1400.
K. J. Hunt and D. Sbarbaro "Neural networks for nonlinear internal model control", IEEE Proceedings-D, vol. 138, No. 5, Sep. 1991, pp. 431-438.
D. Sbarbaro and K. J. Hunt, "A Nonlinear Receding Controller Based on Connectionist Models", Proceedings of the 30th IEEE Conference on Decision and Control, 1991, vol. 1, pp. 172-173.
K. J. Hunt and D. Sbarbaro, "Connectionist Approach to Non-linear Internal Model Control Using Gaussian Approximation", Proceedings of the 1991 American Control Conference, vol. 2, Jun. 27, 1991, pp. 1826-1827.
S. Kirkpatrick, C. D. Gelatt, M. P. Vecchi, "Optimization by Simulated Annealing", Science, vol. 220, pp. 671-678, (1983).
W. T. Miller, III, R. S. Sutton and Paul J. Werbos, "Neural Networks for Control, " Chapters 1 (pp. 115-142) and 5 (pp. 5-58), The MIT Press. 1990.

Affiliated with

Also associated with

Rating

Residual activation neural network does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Residual activation neural network, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Residual activation neural network will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-1933846