Neural network and method for training the neural network

Details Neural network and method for training the neural network Neural network and method for training the neural network

1991-11-21

1994-02-01

MacDonald, Allen R.

395 23, 395, 395, 395

Patent

active

052838552

ABSTRACT:
A method and apparatus are disclosed that modify [ies] and generalize [s] the use in artificial neural networks of the error backpropagation algorithm. Each neuron unit first divides a plurality of weighted inputs into more than one group, then sums up weighted inputs in each group to provide each group's intermediate outputs, and finally processes the intermediate outputs to produce an output of the neuron unit. Since the method uses, when modifying each weight, a partial differential coefficient generated by partially-differentiating the output of the neuron unit by each weighted input, the weight can be properly modified even if the output of a neuron unit as a function of intermediate outputs has a plurality of variables corresponding to the number of groups. Since the conventional method uses only one differential coefficient, that is, the differential coefficient of the output of a neuron unit differentiated by the sum of all weighted inputs in a neuron unit, for all weights in a neuron unit, it may be said that the method according to the present invention generalizes the conventional method. The present invention is especially useful for pulse density neural networks which express data as an ON-bit density of a bit string.

REFERENCES:
patent: 4893255 (1990-01-01), Tomlinson, Jr., et al.
patent: 5101361 (1992-03-01), Eberhardt
patent: 5129039 (1992-07-01), Hiraiwa
patent: 5131073 (1992-07-01), Furuta et al.
patent: 5167006 (1992-11-01), Furuta et al.
Murry et al "Asynchronous VLSI Neural Networks Using Pulse-Stream Arithmetic", 1988 IEEE.
McCluskey "Logic Design Principles," Prentice-Hall, 1986, Front Inside Cover.
1990 Spring National Convention Record, The Institute of Electronics, Information and Communication Engineers, vol. D-56, pp. 6-56, T. Furuta, et al. "Neuron Model Using Pulse Density And Its Self-Learning Circuit".
The Institute of Electronics, Information and Communication Engineers, Oct. 15, 1990, T. Furuta, et al., "Pulse Density Neuron Model Having Learning Function and How To Construct It By Hardwares".
1990 Autumn National Convention Record, The Institute of Electronics, Information and Communication Engineers, vol. D-41, pp. 6-41, T. Furuta, et al. "Development Of Neuro LSI Wuth Self-Learning Function Utilizing Pulse Density".
D. E. Rumelhart, et al., "Leraning Internal Representations By Error Propagation".
K. Katsuhiro et al., "Digital Neuron Model", pp. 415-422.

Affiliated with

Also associated with

Rating

Neural network and method for training the neural network does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Neural network and method for training the neural network, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Neural network and method for training the neural network will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-585253