Stochastic artifical neuron with multilayer training capability

Details Stochastic artifical neuron with multilayer training capability Stochastic artifical neuron with multilayer training capability

1991-06-17

1992-12-08

Hudspeth, David

Electrical transmission or interconnection systems

Plural load circuit systems

Plural sources of supply

395 27, G06F 1518

Patent

active

051700719

ABSTRACT:
A probabilistic or stochastic artificial neuron in which the inputs and synaptic weights are represented as probabilistic or stochastic functions of time, thus providing efficient implementations of the synapses. Stochastic processing removes both the time criticality and the discrete symbol nature of traditional digital processing, while retaining the basic digital processing technology. This provides large gains in relaxed timing design constraints and fault tolerance, while the simplicity of stochastic arithmetic allows for the fabrication of very high densities of neurons. The synaptic weights are individually controlled by a backward error propagation which provides the capability to train multiple layers of neurons in a neural network.

REFERENCES:
patent: 3341823 (1967-09-01), Connelly
patent: 3691400 (1972-09-01), Askew
patent: 3950733 (1976-04-01), Cooper et al.
patent: 4518866 (1985-05-01), Clymer
patent: 4591980 (1986-05-01), Huberman et al.
patent: 4773024 (1988-09-01), Faggin et al.
patent: 4807168 (1989-02-01), Moopenn et al.
patent: 4809193 (1989-02-01), Jourjine
patent: 4893255 (1990-01-01), Tomlinson
patent: 4918618 (1990-04-01), Tomlinson
patent: 4989256 (1991-01-01), Buckley
Tomlinson, Jr., Walker and Sivilotti, "A Digital Neural Network Architecture for VLSI", IJCNN 1990, Jun. 1990, San Diego, Calif.
Walker and Tomlinson, Jr., "DNNA: A Digital Neural Network Architecture", INNC, Jul. 9-13, 1990.
P. C. Patton, "The Neural Semiconductor NU32/SU3232 Chip Set," the Superperformance Computing Service Brief No. 36, Feb. 1990.
R. Colin Johnson, "Digital Neurons Mimic Analog," Electronic Engineering Times, Feb. 12, 1990.
Nguyen, Dziem and Holt, Fred, "Stochastic Processing in a Neural Network Application," IEEE First International Conference on Neural Networks, San Diego Calif., Jun. 21-24, 1987, pp. 281-291.
Gaines, Brian R., "Uncertainty as a Foundation of Computational Power in Neural Neworks," IEEE First International Conference on Neural Networks, San Diego Calif., Jun. 21-24, 1987, pp. 51-57.
Van den Bout, David E. and Miller, T. K., "A Stochastic Architecture for Neural Nets," pp. 481-488.
Rumelhart, David E. et al., "Learning Representations by Back-Propagating Errors," Nature, vol. 323, Oct. 9, 1986, pp. 533-536.
Rumelhart, David E. et al., "Learning Internal Representations by Error Propagation," Institute for Cognitive Science (ICS) Report 8506, Sep. 1985.

Affiliated with

Also associated with

Rating

Stochastic artifical neuron with multilayer training capability does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Stochastic artifical neuron with multilayer training capability, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Stochastic artifical neuron with multilayer training capability will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-962506