Data processing: artificial intelligence – Neural network – Learning task
Reexamination Certificate
2005-06-14
2005-06-14
Starks, Jr., Wilbert L. (Department: 2121)
Data processing: artificial intelligence
Neural network
Learning task
C706S025000, C706S018000
Reexamination Certificate
active
06907412
ABSTRACT:
The subject system provides reduced-dimension mapping of pattern data. Mapping is applied through conventional single-hidden-layer feed-forward neural network with non-linear neurons. According to one aspect of the present invention, the system functions to equalize and orthogonalize lower dimensional output signals by reducing the covariance matrix of the output signals to the form of a diagonal matrix or constant times the identity matrix. The present invention allows for visualization of large bodies of complex multidimensional data in a relatively “topologically correct” low-dimension approximation, to reduce randomness associated with other methods of similar purposes, and to keep the mapping computationally efficient at the same time.
REFERENCES:
patent: 5003490 (1991-03-01), Castelaz et al.
patent: 5113483 (1992-05-01), Keeler et al.
patent: 5200816 (1993-04-01), Rose
patent: 5218529 (1993-06-01), Meyer et al.
patent: 5255342 (1993-10-01), Nitta
patent: 5263120 (1993-11-01), Bickel
patent: 5293456 (1994-03-01), Guez et al.
patent: 5311600 (1994-05-01), Aghajan et al.
patent: 5335291 (1994-08-01), Kramer et al.
patent: 5337372 (1994-08-01), LeCun et al.
patent: 5379352 (1995-01-01), Sirat et al.
patent: 5432864 (1995-07-01), Lu et al.
patent: 5546503 (1996-08-01), Abe et al.
patent: 5619709 (1997-04-01), Caid et al.
patent: 5634087 (1997-05-01), Mammone et al.
patent: 5642431 (1997-06-01), Poggio et al.
patent: 5649065 (1997-07-01), Lo et al.
patent: 5687082 (1997-11-01), Rizzoni
patent: 5734796 (1998-03-01), Pao
patent: 5748508 (1998-05-01), Baleneau
patent: 5754681 (1998-05-01), Watanabe et al.
patent: 5774357 (1998-06-01), Hoffberg et al.
patent: 5794178 (1998-08-01), Caid et al.
patent: 5812992 (1998-09-01), de Vries
patent: 5963929 (1999-10-01), Lo
patent: 5967995 (1999-10-01), Shusterman et al.
patent: 6092045 (2000-07-01), Stubley et al.
patent: 6134537 (2000-10-01), Pao et al.
patent: 6212509 (2001-04-01), Pao et al.
patent: 6400996 (2002-06-01), Hoffberg et al.
patent: 2001/0032198 (2001-10-01), Pao et al.
patent: 0510632 (1992-04-01), None
patent: WO9320530 (1993-03-01), None
Chen, S.; Grant, P.M.; Cowan, C.F.N.; Orthogonal least squares algorithm for training multi-output radial basis function network, Artificial Neural Networks, 1991., Second International Conference on , Nov. 18-20, 1991, pp. 336-339.
Kantsila, A.; Lehtokangas, M.; Saarinen, J.; On equalization with maximum covariance initialized cascade-correlation learning, Circuits and Systems, 2000. Proceedings. ISCAS 2000 Geneva. The 2000 IEEE International Symposium on , vol.: 1 , 2000, Page(s).
Yasuo Miyamoto, Shigeki Nakauchi and Shiro Usui (1992) “Functional Role of Decorrelation For Color Constancy”, Inst. Electronics Info. Commun. Eng., vol. 91, No. 529, pp. 51-58 (Japanese language document and English language translation thereof).
Official Action dated Sep. 10, 2002 in connection with corresponding Japanese Patent Application No. 2000-539447 (Japanese language document and English language translation thereof).
Official Action dated Apr. 15, 2003 in connection with corresponding Japanese Patent Application No. 2000-539447 (Japanese language document and English language translation thereof).
Seiichi Nakagawa, Yoshimitsu Hirata and Yoshiyuki Ono (1992) “Syllable Recognition By Hidden Markov Model Using Fixed-Length Segmental Statistics”, Trans. Inst. Electronics Info. Commun. Eng., vol. J75-D-11, No. 5, pp. 843-851.
Fukunaga, K. and Koontz, W.L.G., (1970) “Application of the Karhunen-Loeve expansion to feature selection and ordering”, IEEE Transactions on Computers, vol. 19:311-318.
Kohonen, T., (1982) “Self-organized formation of topologically correct feature maps”, Biological Cybernetics, vol. 43:59-69.
Oja, E., (1982) “A simplified neuron model as a principal component analyzer”, Journal of Mathematics and Biology, vol. 15:267-273.
Linsker, R., (1986) “From basic network principles to neural architecture”, Proceedings of the National Academy of Science, USA, vol. 83:7508-7512, 8390-8394, 8779-8783.
Carpenter, G.A. and Grossberg, S., (1987), “ART2: Self-organization of stable category recognition codes for analog input patterns”, Applied Optics., vol. 26:4919-4930.
Bourland, H. and Kamp Y., (1988) “Auto-association by multilayer perceptrons and singular value decomposition”, Biological Cybernetics, vol. 59:291-294.
Baldi P. and Hornik, K., (1989) “Neural networks and principal component analysis: learning from examples without local minima”, Neural Networks, vol. 2:53-58.
Sanger, T.D., (1989) “Optimal Unsupervised learning in a single-layer linear feedforward neural network”, Neural Networks, vol. 2:459-465.
Kramer, M., (1991) “Nonlinear principal component analysis using autoassociative feedforward neural networks”, AICHE, vol. 37:233-243.
Malki, H.A. and Moghaddamjoo, A., (1991) “Using the Karhunen-Loeve transformation in the back-propagation training algorithm Neural Networks”, IEEE Transactions, vol. 21:162-165.
Oja, E., (1991) “Data compression, feature extraction and autoassociation feedforward neural networks”, In Artificial Neural Networks, eds. T. Kohonen, O. Simula, and J. Kangas, Elsevier Science Amsterdam, 737-745.
Abbas, H.M. and Fahmy, M.M., (1992) “A neural model for adaptive Karhunen Loeve transformation (KLT)”, Neural Networks, IJCNN, vol. 2:975-980.
Abbas, H.M. and Fahmy, M.M., (1993) “Neural model for Karhunen-Loeve transform with application to adaptive image compression”, Communications, Speech and Vision, IEE Proceedings I, vol. 140 (2).
Jianchang Mao and Anil K. Jain, (1995) “Artificial Neural Networks for Feature Extraction and Multivariate Data Projection”, IEEE Transactions on Neural Networks, vol. 6(2).
Kohonen, T., (1995) “Self-Organizing Maps”, Springer-Verlag, Berlin.
Chatterjee, C. and Roychowdhury, V., (1996) “Self-organizing neural networks for class-separability features Neural Networks”, IEEE International Conference, vol. 3(3-6):1445-1450.
Tayel, M., Shalaby, H. and Saleh, H., (1996) “Winner-take-all neural network for visual handwritten character recognition”, NRSC, 239-249.
Chatterjee, C. and Roychowdhury, V.P., (1997) “On self-organizing algorithms and networks for class-separability features Neural Networks”, IEEE International Transactions, vol. 83:663-678.
Yoh-Han Pao and Chan-Yun Shen, (1997) “Visualization of Pattern Data Through Learning of Non-Linear Variance-Conserving Dimension-Reduction Mapping”, Pattern Recognition, vol. 30(10):1705-1717.
Meng Zhuo
Pao Yoh-Han
Computer Associates Think Inc.
Cooper & Dunham LLP
Starks, Jr. Wilbert L.
LandOfFree
Visualization and self-organization of multidimensional data... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Visualization and self-organization of multidimensional data..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Visualization and self-organization of multidimensional data... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3477646