Optimal filtering by neural networks with range extenders and/or

Details Optimal filtering by neural networks with range extenders and/or Optimal filtering by neural networks with range extenders and/or

1993-08-09

1997-07-15

Davis, George B.

Boots, shoes, and leggings

395 22, 395 24, 395 27, 36472404, G06F 1518

Patent

active

056490658

ABSTRACT:
A method and apparatus is provided for processing a measurement process to estimate a signal process, even if the signal and/or measurement processes have large and/or expanding ranges. The method synthesizes training data comprising realizations of the signal and measurement processes into a primary filter for estimating the signal process and, if required, an ancillary filter for providing the primary filter's estimation error statistics. The primary and ancillary filters each comprise an artificial recurrent neural network (RNN) and at least one range extender or reducer. Their implementation results in the filtering apparatus. Many types of range extender and reducer are disclosed, which have different degrees of effectiveness and computational cost. For a neural filter under design, range extenders and/or reducers are selected from those types jointly with the architecture of the RNN in consideration of the filtering accuracy, the RNN size and the computational cost of each selected range extender and reducer so as to maximize the cost effectiveness of the neural filter. The aforementioned synthesis is performed through training RNNs together with range extenders and/or reducers.

REFERENCES:
patent: 5003490 (1991-03-01), Castelaz et al.
patent: 5150323 (1992-09-01), Castelaz
patent: 5253329 (1993-10-01), Villarreal et al.
patent: 5408414 (1995-04-01), Nomoto et al.
patent: 5490505 (1996-02-01), Diab et al.
Ruck et al, "Comparative Analysis of Backpropagation and the Extended Kalman Filter for Training Multilayer perceptions", IEEE Transactions on Pattern Analysis & Machine Intelligence, 1992.
Palmieri et al, "Sound Localization with a Neural Network Trained with the Multiple Extended Kalman Algorithm", IEEE Inter. Conf. on Neural Networks, 1991.
Rao et al, "A Recurent Neural Network for Nonlinear Time Series Prediction", IEEE Neural Networks for Signal Processing II, 1992.
R. S. Bucy and K. D. Senne, "Digital Synthesis of Non-linear Filters," Automatica, vol. 7, pp. 287-298 (1971).
R. S. Bucy and K. D. Senne, "Non-linear Filtering Algorithms for Vector Processing Machines," Comp. & Maths. with Apps., vol. 6, pp. 317-338 (1980).
J. T.-H. Lo, "Optimal Estimation for the Satellite Attitude Using Star Tracker Measurements," Automatica, vol. 22, pp. 477-482 (1986).
J. T.-H. Lo and S.-K. Ng, "Optimal Fourirer-Hermite Expansion for Estimation," Stochastic Processes and their Applications, vol. 21, pp. 291-304 (1986).
S. I. Sudharsanan and M. K. Sundareshan, "Maximum A posteriori State Estimation: A Neural Processing Algorithm," in Procs. of the 28th Conf. on Decision and Control, Tampa, Florida, pp. 1805-1806 (1989).
Q. Sun et al, "A Neural Network Computation Algorithm for Discrete-Time Linear System State Estimation," in Procs. of IJCNN, Jun. 1992, Baltimore, Maryland, pp. 1-443 (1992).
J. L. Elman, "Finding Structure in Time," Cognitive Science, vol. 14, pp. 179-211 (1990).
D. L. Elliott, "A Better Activation Function for Artificial Neural Networks," ISR Technical Report TR 93-8, Institute for Systems Research, University of Maryland, College Park, MD 20742 (1993).
M. I. Jordan, "Attractor Dynamics and Parallelism in a Connectionist Sequential Machine," in Procs. of the 8th Annual Conf. of the Cognitive Science Society, pp. 531-546, Erlbaum (1986).
J. T.-H. Lo, "Finite-dimensional Sensor Orbits and Optimal Nonlinear Filtering," IEEE Transactions on Information Theory, vol. IT-18, pp. 583-588 (1972).
K. Hornik et al, "Multilayer Fedeforward Networks are Universal Approximators," Neural Networks, vol. 2, pp. 359-366 (1989).
P. Poddar and K. P. Unnikrishnan, "Non-linear Prediction of Speech Signals Using Memory Neuron Networks," in Neural Networks for Signal Processing, ed. J. H. Juang et al, pp. 395-404 (1991).
A. J. Robinson and F. Fallside, "A Dynamic Connectionist Model for Phoneme Recognition," in Neural Networks from Models to Applications, ed. L. Personnaz and G. Dreyfus, pp. 541-550, IDEST, Paris (1989).
O. Nerrand et al, "Neural Network Training Schemes for Non-linear Adaptive Filtering and Modelling," in Procs. of IJCNN, Jun. 1991, Seattle, Washington, pp. I-61-66 (1991).
J. P. DeCruyenaere and H. M. Hafez, "A Comparison between Kalman Filters and Recurrent Neural Networks," in Procs. of IJCNN, Jun. 1992, Baltimore, Maryland, pp. IV-247-251 (1992).
J. T.-H. Lo, "Optimal Filtering by Recurrent Neural Networks," in Procs. of the 30th Annual Allerton Conf. on Comm., Contr., and Comput., Monticello, IL, Oct. 1992, ed. P. Van Dooren and M. Spong, pp. 903-912 (1992).
J. T.-H. Lo, "Synthetic Approach to Optimal Filtering," Procs. of the 1992 Intl. Simul. Tech. Conf. and 1992 Workshop on Neural Networks, Clear Lake, Texas, Nov. 1992, pp. 475-481 (1992).
O. Nerrand et al, "Neural Networks and Nonlinear Adaptive Filtering: Unifying Concepts and New Algorithms," Neural Computation, vol. 5, pp. 165-199 (1993).
L. Yin et al, "A New Class of Nonlinear Filters--Neural Filters," IEEE Transaction on Signal Procesing, vol. 41, pp. 1201-1222 (1993).

Affiliated with

Also associated with

Rating

Optimal filtering by neural networks with range extenders and/or does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Optimal filtering by neural networks with range extenders and/or, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Optimal filtering by neural networks with range extenders and/or will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-1498066