Miscellaneous active electrical nonlinear devices – circuits – and – Signal converting – shaping – or generating – Converting input voltage to output current or vice versa
Reexamination Certificate
2000-12-19
2002-08-06
Ton, My-Trang Nu (Department: 2816)
Miscellaneous active electrical nonlinear devices, circuits, and
Signal converting, shaping, or generating
Converting input voltage to output current or vice versa
C706S033000, C327S089000
Reexamination Certificate
active
06429699
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates to an artificial neural network (ANN), particularly to a neuron component and its activation function including the derivative.
2. Description of the Related Art
One of the artificial neural networks' most important components is the neuron, whose performance and complexity greatly affect the whole net. In many literatures, its activation function is found to be the sigmoid. Most of the analog implementations have used differential pair for generating the required function. In some cases, such as on-chip back-propagation learning, both a non-linear function and its derivative are required. Neurons that can meet the requirement have been presented. Most of these have voltage inputs and the current outputs. Since most of the applications employ current output synapses and voltage output neurons in order to enable the summation of those currents by simply connecting them together at the input of the neuron and to diverge signals from a neuron to a large quantity of synapses, these circuits a little bit inconvenient. In addition, some circuits are biased in the subthreshold region, so its driving capability is quite limited.
SUMMARY OF THE INVENTION
Therefore, an object of the invention is to provide a novel neuron circuit, which has current input and voltage outputs and is built with strong-inversion biased transistors, thereby realizing both a neuron activation function and its derivative.
Another object of the invention is to provide a novel neuron circuit, which enables threshold and gain factor adjustability and has high noise immunity.
Another object of the invention is to provide novel neuron circuit, which is very beneficial to on-chip learning neural networks.
To realize the above and other objects, the invention provides a novel neuron circuit, which is very beneficial to on-chip learning neural networks. The neuron circuit comprises: a pair of transistors having a first common terminal connected to a first input voltage, a second common terminal connected to a first output, a first gate connected to a second input voltage, and a second gate connected to a third input voltage; a surface field-effect transistor having a first terminal and a third gate connected together to the first output, which is connected to a first current source, and a second terminal connected to a second current source; and a first differential pair of transistors, having a third common terminal connected to a third current source, a first gate connected to the first output, a second gate connected to a fourth input voltage, a first terminal connected to a first load to form a connecting point as a second output, and a second terminal connected to a second load; a second differential pair of transistors, having a fourth common terminal connected to the third current source, a third gate connected to the first gate of the first differential pair of transistors output, a fourth gate connected to a fifth input voltage, a third terminal connected to a third load to form a connecting point as a third output, and a fourth terminal connected to a fourth load.
In the neural network, a neuron circuit design is the key point for the performance. In the invention with simple neuron circuit design, it can easily reach a requirement of errorless effect and decrease the time delay to within 1 ns. The circuit also has a large dynamic range and a high noise immunity using the adjustable threshold and gain factor. Therefore, these features make it quite fit for hardware realization besides its programmability.
REFERENCES:
patent: 5648926 (1997-07-01), Douglas et al.
patent: 5990709 (1999-11-01), Thewes et al.
patent: 6229376 (2001-05-01), Geysen
patent: 6242988 (2001-06-01), Sarpeshkar
Lu Chun
Shi Bingxue
Ladas & Parry
Nu Ton My-Trang
Winbond Electronics Corp.
LandOfFree
Generator of neuron transfer function and its derivative does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Generator of neuron transfer function and its derivative, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Generator of neuron transfer function and its derivative will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2898341