Memory capacity neural network

Details Memory capacity neural network Memory capacity neural network

1994-06-06

1995-11-14

Moore, David K.

Image analysis

Histogram processing

For setting a threshold

382156, 395 20, 395 21, G06F 1518

Patent

active

054674271

ABSTRACT:
Hopfield and BAM neural network training or learning rules allowing memorization of a greater number of patterns. Successive over-relaxation is used in the learning rules based on the training patterns and the output vectors. Neural networks trained in this manner can better serve as the neural networks in a variety of pattern recognition and element correlation systems.

REFERENCES:
patent: 4897811 (1990-01-01), Scofield
patent: 4918618 (1990-04-01), Tomlinson, Jr.
patent: 5010512 (1991-04-01), Hartstein et al.
patent: 5014219 (1991-05-01), White
patent: 5058034 (1991-10-01), Murphy et al.
patent: 5058180 (1991-10-01), Khan
patent: 5063531 (1991-11-01), Kawai et al.
patent: 5087826 (1992-02-01), Holler et al.
patent: 5091864 (1992-02-01), Baji et al.
patent: 5093803 (1992-03-01), Howard et al.
patent: 5161014 (1992-11-01), Pearson et al.
patent: 5170463 (1992-12-01), Fuyimoto et al.
patent: 5214746 (1993-05-01), Fogel et al.
patent: 5239594 (1993-08-01), Yoda
patent: 5247584 (1993-09-01), Krogmann
Yeou-Fang Wang, J. Cruz & J. Mulligan, Jr., Guaranteed Recall of All Training Pairs for Bidirectional Associative Memory, IEEE Transactions on Neural Networks, vol. 2, No. 6, Nov. 1991, pp. 559-567.
S. Fahlman, Faster Learning Variations on Back-Propagation: An Empirical Study, Proceedings of 1988 Connectionist Models Summer School, pp. 38-51.
B. Kosko, Constructing an Associative Memory, Byte, Sep. 1987, pp. 137-144.
B. Kosko, Adaptive Bidirectional Associative Memories, Applied Optics, vol. 26, No. 23, Dec. 1, 1987, pp. 4947-4952.
K. Haines & R. Hecht-Nielson, A. BAM with Increased Information Storage Capacity, Second Int'l. Joint Conf. on Neural Networks, 1988, pp. I-181-I-190.
B. Kosko, Feedback Stability and Unsupervised Learning, Second Int'l. Joint Conf. on Neural Networks, 1988, I-141-I-152.
F. Crick & G. Mitchison, The Function of Dream Sleep, Nature, Jul. 1983, pp. 111-114.
G. Weisbuch & F. Fogelman-Soulie, Scaling Laws for the Attractors of Hopfield Networks, Le Journal de Physique-Lettres 46, Jul. 15, 1985, pp. L-623-L-630.
J. Hopfield, D. Feinstein & R. Palmer, "Unlearning" Has a Stabilizing Effect in Collective Memories, Nature, vol. 304, Jul. 14, 1983, pp. 158-159.
A. Wong, Recognition of General Patterns Using Neural Networks, Biological Cybernetics 58, 1988, pp. 361-372.
L. Personnaz, I. Guyon & G. Dreyfus, Information Storage and Retrievel in Spin-Glass Like Neural Networks, Le Jounral de Physique-Lettres 46, Apr. 15, 1985, pp. L-359-L-365.
S. Agmon, The Relaxation Method for Linear Inequalaities, Canadian Journal of Mathematics, vol. 6, No. 3, 1954, pp. 382-392.
T. Motzkin & I. Schoenberg, The Relaxation Method for Linear Inequalities, Canadian Journal of Mathematics, vol. 6, No. 3, 1954, pp. 393-404.
B. Kosko, Bidirectional Associative Memories, IEEE Transactions on Systems, Man and Cybernetics, vol. 18, No. 1, Jan./Feb./ 1988, pp. 49-60.
M. Hassoun, Dynamic Heteroassociative Neural Memories, Neural Networks, vol. 2, 1989, pp. 275-287.
S. Fahlman & C. Lebiere, The Cascade-Correlation Learning Architecture, Carnegie Mellon University, CMU-CS-90-100, Feb. 14, 1990, pp. 1-11.
Yeou-Fang Wang, J. Cruz & J. Mulligan, Jr., Two Coding Strategies for Bidirectional Associative Memory, IEEE Transactions on Neural Networks, vol. 1, No. 1, Mar. 1990, pp. 81-92.
S. Venkatesh, Epsilon Capacity of Neural Networks, Amer. Inst. of Physics, 0094-243X/86/1510440-6, 1986, pp. 440-445.
D. Kleinfeld & D. Pendergraft, "Unlearning" Increases the Storage Capacity of Content Addressable Memories, Biophysical Journal, vol. 51, Jan. 1987, pp. 47-53.
D. Amit, H. Gutfreund, & H. Sompolinsky, Storing Infinite Numbers of Patterns in a Spin-Glass Model of Neural Networks, Physical Review Letters, Sep. 30, 1985, pp. 1530-1533.
I. Kanter & H. Sompolinsky, Associative Recall of Memory without Errors, Physical Review, Jan. 1, 1987, pp. 380-392.
E. Garnder, Maximum Storage Capacity in Neural Networks, Europhysics Letter, Aug. 15, 1987, pp. 481-485.
T. Cover, Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition, IEEE Transactions on Electronic Computers, vol. EC-14, 1965, pp. 326-334.
D. Wallace, Memory and Learning in a Class of Neural Network Models, Lattice Gauge Theory, Plenum Press, pp. 313-330.
A. Bruce, et al, Learning and Memory Properties in Fully Connected Networks, AIP Conference Proceedings, Neural Networks for Computing, 1986, pp. 65-70.
B. Forrest, Content-Addressability and Learning in Neural Networks, J. Physics A.: Math. Gen. 21, 1988, pp. 245-255.
E. Gardner, The Space of Interactions in Neural Network Models, J. Physics A: Math. Gen. 21, 1988, pp. 257-270.
R. McEliece, et al., The Capacity of the Hopfield Associative Memory, IEEE Transactions on Information Theory, vol. IT-33 No. 4, Jul., 1987, pp. 461-482.

Affiliated with

Also associated with

Rating

Memory capacity neural network does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Memory capacity neural network, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Memory capacity neural network will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-1226954