Method for operating an optimal weight pruning apparatus for des

Details Method for operating an optimal weight pruning apparatus for des Method for operating an optimal weight pruning apparatus for des

1995-07-07

1997-06-03

Downs, Robert W.

395 23, G06F 1518

Patent

active

056363265

ABSTRACT:
A method and apparatus for designing a multilayer feed forward neural network that produces a design having a minimum number of connecting weights is based on a novel iterative procedure for inverting the full Hessian matrix of the neural network. The inversion of the full Hessian matrix results in a practical strategy for pruning weights of a trained neural network. The error caused by pruning is minimized by a correction that is applied to remaining (un-pruned) weights thus reducing the need for retraining. However, retraining may be applied to the network possibly leading to further the simplification of the network design.

REFERENCES:
patent: 5046020 (1991-09-01), Filkin
patent: 5129039 (1992-07-01), Hiraiwa
patent: 5228113 (1993-07-01), Shelton
Chiselli-Crippa et al., "A Fast Neural Net Training Algorithm and its Application to voiced-Unvoiced-Silence Classification of Speech," Int'l. Conf. on Acoustics, Speech, and Signal Processing, pp.441-444.
Yuan et al., "Towards Constructing Optimal Feedforward neural networks with Learning and Generalization Capabilities," Int'l. Forum on Applications of Neural Nets to Power Systems, pp. 227-231.
E.D. Karnin, "A Simple Procedure for Pruning Back-Propagation Trained Neural Networks," IEEE Trans. on Neural Networks, V. 1 (2), pp. 239-242.
Hirose et al., "Back-Propagation Algorithm which Varies the Number of Hidden Units," Neural Networks, V. 4 (1), pp. 61-66.
LeCun et al., "Optimal Brain Damage," Neural Information Processing Systems, V. 2, pp. 598-605.
C. Bishop, "Exact Calculation of the Hessian Matrix for the Multilayer Perceptron," Neural Computation, V. 4 (4), pp. 494-501.

Affiliated with

Also associated with

Rating

Method for operating an optimal weight pruning apparatus for des does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method for operating an optimal weight pruning apparatus for des, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for operating an optimal weight pruning apparatus for des will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-398396