Learning method for multilayer perceptron neural network with N-

Details Learning method for multilayer perceptron neural network with N- Learning method for multilayer perceptron neural network with N-

1996-09-11

1998-12-01

Hafiz, Tariq R.

395 21, G06F 100, G06F 1518

Patent

active

058450513

ABSTRACT:
A multilayer perceptron neural network with N-bit (8-bit) data representation generates weighted sums in forward and backward calculations having 2N-bit data precision. During N-bit digital learning of a multilayer perceptron, the maximum value represented with N-bits is set to a value corresponding to the sigmoidal saturated region when the result of the weighted sum having 2N-bit data precision in the forward calculation of the multilayer perceptron is represented with N-bit data for a sigmoidal nonlinear transformation. The maximum value of N-bit presentation is set to a value comparatively smaller than that represented in 2N bits when the result of the weighted sum having the 2N-bit data precision in the backward calculation of the multilayer perceptron is represented with N-bit data. With the representation range of the weights being small, if a predetermined ratio of the weights approaches a maximum value according to the learning progress, the weight range is expanded. The efficiency of 8-bit digital learning can be enhanced to approach that of 16-bit digital learning.

REFERENCES:
patent: 5253330 (1993-10-01), Ramacher et al.
patent: 5278945 (1994-01-01), Basehore et al.
patent: 5479579 (1995-12-01), Duong et al.
patent: 5524175 (1996-06-01), Sato et al.
Holt et al, "Finite Precision Error Analysis of Neural Network Hardware Implementations", IEEE Trans. Comp., vol. 42, pp. 281-290, Mar. 1993.
Sakaue et al, "Reduction of Required Precision Bits for Back-Propagation Applied to Pattern Recognition", IEEE Trans. Neural Networks, vol. 4, pp. 270-275, Mar. 1993.

Affiliated with

Also associated with

Rating

Learning method for multilayer perceptron neural network with N- does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Learning method for multilayer perceptron neural network with N-, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Learning method for multilayer perceptron neural network with N- will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2401882