Patent
1994-11-29
1998-01-06
Davis, George B.
395 20, G06F 1531
Patent
active
057064024
ABSTRACT:
A neural network system and unsupervised learning process for separating unknown source signals from their received mixtures by solving the Independent Components Analysis (ICA) problem. The unsupervised learning procedure solves the general blind signal processing problem by maximizing joint output entropy through gradient ascent to minimize mutual information in the outputs. The neural network system can separate a multiplicity of unknown source signals from measured mixture signals where the mixture characteristics and the original source signals are both unknown. The system can be easily adapted to solve the related blind deconvolution problem that extracts an unknown source signal from the output of an unknown reverberating channel.
REFERENCES:
patent: 4965732 (1990-10-01), Roy, III et al.
patent: 5272656 (1993-12-01), Genereux
patent: 5383164 (1995-01-01), Sejnowski et al.
patent: 5539832 (1996-07-01), Weinstein et al.
Sklar, Bernard,Digital Communications; 1988 PTR Prentice-Hall, Inc., Englewood Cliffs, NJ 07632 Section 2.11 Intersymbol Interference, pp. 105 and 106.
Joseph J. Atick, "Could information theory provide an ecological theory of sensory processing?", Network 3 (1992), pp. 213-251.
H. B. Barlow, "Unsupervised Learning", Neural Computation 1 (1989), pp. 295-311.
H. B. Barlow et al., "Adaption and Decorrelation in the Cortex", The Computing Neuron, pp. 54-72.
Suzanna Becker et al., "Self-organizing neural network that discovers surfaces in random-dot stereograms", Nature, vol. 355 (Jan. 9, 1992), pp. 161-163.
Gilles Burel, "Blind Separation of Sources: A Nonlinear Neural Algorithm", Neural Networks, vol. 5 (1992), pp. 937-947.
P. Comon et al., "Blind separation of sources, Part II: Problems statement", Signal Processing 24 (1991), pp. 11-20.
Pierre Comon, "Independent component analysis, A new concept?", Signal Processing 36 (1994), pp. 287-314.
D. Hatzinakos et al., "Ch. 5, Blind Equalization Based On Higher-Order Statistics (H.O.S.)", Blind Deconvolution, pp. 181-258.
Simon Haykin, "Ch. 20, Blind Deconvolution", Adaptive Filter Theory, Second Edition, Prentice Hall (1991), pp. 722-756.
Simon Haykin, "Ch. 1, The Blind Deconvolution Problem", Blind Deconvolution, (ed.) Prentice Hall (1994), pp. 1-7.
Sandro Bellini, "Ch. 2, Bussgang Techniques for Blind Deconvolution and Equalization", Blind Deconvolution, S. Haykin (ed.) Prentice Hall (1994), pp. 8-57.
Simon Haykin, "Ch. 11, Self-Organizing Systems III: Information-Theoretic Models", Neural Networks: A Comprehensive Foundation, S. Haykin (ed.) MacMillan (1994), pp. 444-472.
J. J. Hopfield, "Olfactory computation and object perception", Proc. Natl. Acad. USA, vol. 88 (Aug. 1991), pp. 6462-6466.
C. Jutten and J. Herault, "Blind separation of sources, Part I: An adaptive algorithm based on neuromimetic architecture", Signal Processing 24 (1991), pp. 1-10.
S. Laughlin "A Simple Coding Procedure Enhances a Neuron's Information Capacity", Z. Naturforsch 36 (1981), pp. 910-912.
Ralph Linsker, "An Application of the Principles of Maximum Information Preservation to Linear Systems", Advances in Neural Information Processing Systems 1, pp. 186-194.
Ralph Linsker, "Local Synaptic Learning Rules Suffice to Maximize Mutual Information in a Linear Network", Neural Computation 4 (1992), pp. 691-702.
L. Molgedey and H. G. Schuster, "Separation of a Mixture of Independent Signals Using Time Delayed Correlations", Physical Review Letters, vol. 72, No. 23, (Jun. 6, 1994), pp. 3634-3637.
John C. Platt, "Networks for the Separation of Sources that are Superimposed and Delayed", Advances in Neural Information Processing Systems 4, Morgan-Kaufmann (1992), pp. 730-737.
N. Schraudolph et al., "Competitive Anti-Hebbian Learning of Invariants", Advances in Neural Processing Information Systems 4, pp. 1017-1024.
E. Sorouchyari, "Blind separation of sources, Part III: Stability analysis", Signal Processing 24 (1991), pp. 21-29.
D. Yellin et al., "Criteria for Multichannel Signal Separation", IEEE Transaction on Signal Processing, vol. 42, No. 8, (Aug. 1994), pp. 2158-2168.
J. Maddox, "Cocktail party effect made tolerable", Nature, vol. 369 (Jun. 16, 1994), p. 517.
Davis George B.
The Salk Institute for Biological Studies
LandOfFree
Blind signal processing system employing information maximizatio does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Blind signal processing system employing information maximizatio, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Blind signal processing system employing information maximizatio will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2336766