Fusion of sensor data and synthetic data to form an...

Image analysis – Image transformation or preprocessing – Changing the image coordinates

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

C701S014000

Reexamination Certificate

active

07925117

ABSTRACT:
A system and method for fusing sensor data and synthetic data to form an integrated image are described. An image registration process is used to fuse the images. The image registration process is performed on gradients of a landmark image. The gradients are extracted from both sensor and synthetic datasets for the landmark image. Using the image gradient, a center of mass for each of the gradient's curves is calculated. By solving a minimization problem to reduce error, a desired transformation operator can be obtained to match the sensor image to the synthetic image.

REFERENCES:
patent: 3216263 (1965-11-01), Culver et al.
patent: 4695959 (1987-09-01), Lees et al.
patent: 5649032 (1997-07-01), Burt et al.
patent: 6078701 (2000-06-01), Hsu et al.
patent: 6289277 (2001-09-01), Feyereisen et al.
patent: 6445832 (2002-09-01), Lee et al.
patent: 6456731 (2002-09-01), Chiba et al.
patent: 6512857 (2003-01-01), Hsu et al.
patent: 6749432 (2004-06-01), French et al.
patent: 6765726 (2004-07-01), French et al.
patent: 6841780 (2005-01-01), Cofer et al.
patent: 6892118 (2005-05-01), Feyereisen
patent: 6934422 (2005-08-01), Hamza
patent: 7196329 (2007-03-01), Wood et al.
patent: 2001/0038718 (2001-11-01), Kumar et al.
patent: 2003/0078754 (2003-04-01), Hamza
patent: 2003/0118251 (2003-06-01), Hamza
patent: 2003/0132946 (2003-07-01), Gold
patent: 2003/0185450 (2003-10-01), Garakani et al.
patent: 2003/0218674 (2003-11-01), Zhao et al.
patent: 2003/0225513 (2003-12-01), Gagvani et al.
patent: 2005/0078747 (2005-04-01), Hamza et al.
patent: 2005/0197981 (2005-09-01), Bingham
patent: 2005/0232512 (2005-10-01), Luk et al.
patent: 2006/0004275 (2006-01-01), Vija et al.
patent: 2006/0186881 (2006-08-01), Tilbrook
patent: 2008/0080737 (2008-04-01), Rhoads et al.
patent: 0599345 (1994-01-01), None
patent: WO 2005/038718 (2005-04-01), None
Goshtasby, A., “Registration of images with geometric distortions”, IEEE Transactions on Geosciences and Remote Sensing, vol. 26, No. 1, Jan. 1988.
Srinivas, et al., “A stochastic model-based approach for simultaneous restoration of multiple misregistered images”, SPIE vol. 1360 Visual Communication and Image Processing '90, 1416-1427.
Zitova et al., “Image registration methods: a survey”, Image and Vision Computing 21 (2003) 977-1000.
Besl et al., “A method for registration of 3-D shapes”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, No. 2, Feb. 1992.
Piella, Gemma, “A general framework for multiresolution image fusion: from pixels to regions”, Information Fusion 4, 2003, 259-280.
Habib et al., Linear Features for Semi-Automatic Registration and Change Detection of Multi-Source Imagery, 0-7803-9050-4/05, 2005 IEEE, pp. 2117-2120.
Daneshvar et al., A Hybrid Algorithm for Medical Image Registration, Proceedings of the 2005 IEEE, Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China, Sep. 1-4, 2005, pp. 3272-3275.
Bentoutou et al., An Automatic Image Registration for Applications in Remote Sensing, IEEE Transactions on Geoscience and Remote Sensing, vol. 43, No. 9, Sep. 2005, pp. 2127-2137.
Dai X., A Feature-Based Image Registration Algorithm Using Improved Chain-Code Representation Combined With Invariant Moments, IEEE Transactions on Geoscience and Remote Sensing, vol. 37, No. 5, Sep. 1999, pp. 2351-2362.
Goshtasby et al., A Region-Based Approach to Digital Image Registration With Subpixel Accuracy, IEEE Transactions on Geoscience and Remote Sensing, vol. GE-24, No. 3, May 1986, pp. 390-399.
Flusser et al., A Moment-Based Approach to Registration of Images with Affine Geometric Distortion, 8110 IEEE Transactions on Geoscience and Remote Sensing, 32 No. 2, New York, US, No. 2, Mar. 1994, pp. 382-387.
EP Search Report, 07111109.0 dated Feb. 18, 2008.
Adelson et al., “Pyramid Methods in Image Processing,” RCA Engineer, vol. 29(6), Nov./Dec. 1984, pp. 33-41.
DeCastro et al., “Registration of Translated and Rotated Images Using Finite Fourier Transforms,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 9, No. 5, pp. 700-703. Sep. 1987.
Eddy et al., “Improved Image Registration by Using Fourier Interpolation,” Magnetic Resonance in Medicine, vol. 36, No. 6, pp. 923-931, Dec. 1996.
Kostelec et al., “Multiresolution Elastic Image Registration,” Medical Physics, vol. 25, No. 9, pp. 1593-1604, Sep. 1998.
Negahdaripour et al., “A Generalized Brightness Change Model for Computing Optical Flow,” Fourth International Conference on Computer Vision, pp. 2-11, Berlin, Germany, May, 1993.
Periaswamy et al., “Medical Image Registration with Partial Data,” Preprint Submitted to Elsevier Science, Mar. 11, 2005.
Periaswamy et al., “Automated Multiscale Elastic Image Registration Using Correlation,” Proceedings of SPIE, The International Society for Optical Engineering, vol. 3661, pp. 828-838, Feb. 1999.
Shih et al, “Contour-Model-Guided Nonlinear Deformation Model for Inter-subject Image Registration,” Proceedings of SPIE, The International Society for Optical Engineering, vol. 3034, pp. 611-620, Apr. 1997.
Shi et al., “Good Features to Track,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 593-600, Jun. 1994.
West et al., “Comparison and Evaluation of Retrospective Intermodality Image Registration Techniques,” Proceedings of SPIE, vol. 2710, pp. 332-347.
Viola et al., “Alignment by Maximization of Mutual Information,” IEEE Fifth International Conference on Computer Vision, pp. 16-23, Cambridge, MA, USA, Jun. 1995.
Watson et al., “A Look at Motion in the Frequency Domain,” pp. 1-10, ACM, Apr. 1983.
F. Samadzadegan, “Fusion Techniques in Remote Sensing,” Univ of Tehran, http://www.igf.uni-osnabrueck.de/mitarbeiter/schiewe/papers/43.pdf.
Yang, et al, “Image Fusion Using the Expectation-Maximization Algorithm and a Hidden Markov Model,”Lehigh University.
Jennings et al., “Synthetic Vision as an Integrated Element of an Enhanced Vision System,” Proceedings of SPIE, vol. 4713, pp. 10-17, Apr. 2002.
Judge et al, “Solutions that Permit Safer Flight in Degraded Visual Environments (DVE),” AHS, 60thAnnual Forum Proceedings, pp. 2174-2180, Jun. 2004.
Foyle et al, “Enhanced/Synthetic Vision Systems: Human Factors Research and Implications for Future Systems,” SAE Transactions: Journal of Aerospace, 101, pp. 1734-1741, 1992.
Burt, et al, “Enhanced Image Capture Through Fusion,” David Sarnoff Research Center, Princeton, NJ, published in 1993 IEEE transactions. Feb. 1993 MMWAVE.
Takács, et al, “Real-time Visualization Using a 2D/3D Imaging MMWAVE Radar,”Real-Time Imaging VIII(E113),SPIE Electronic Imaging, Jan. 18-22, 2004, San Jose, CA.
Rockwell Collins, “Total Precision. For Every Mission,” http://www.rockwellcollins.com/products/gov/prn—flight2safety.html printed Mar. 26, 2006.
Rockwell Collins, “Technology Solutions to Enable Safe, Efficient and Effective Flight Operations Under All Conditions,” http://www.rockwellcollins.com/about/innovation/atc/prn—page4332.html printed Mar. 26, 2006.
Pope, Steven, “NASA Partners Show EVS, SVS Concepts,” Nov. 2005, http://www.ainonline.com/Issues/11—05/11—05—nasa—96.htm.
Bad Visibility Not a Problem with Synthetic Vision System, http://www.honeywell.com/sites/portal?smap=aero&page=aerotechmagazine3&theme-T4 printed Mar. 9, 2006.
“Advanced Vision Cueing and Control (AVC2)” http://www.honeywell.com/sites/aero/technology/avionics3—CA0A2F626-AEE9-48de-12E printed Mar. 9, 2006.
AeroTech Magazine, Synthetic Vision System, vol. 1; Issue 1, 2006. www.honeywell.com.
Gulfstream G350, G450, G500 and G550, Gulfstream PlaneView Advanced Cockpit, Sep. 2004.
“Rockwell Collins Completes Successful SE-Vision Test Fl

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Fusion of sensor data and synthetic data to form an... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Fusion of sensor data and synthetic data to form an..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Fusion of sensor data and synthetic data to form an... will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-2711245

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.