Method of super-resolving images

Image analysis – Image transformation or preprocessing – Changing the image coordinates

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

C382S280000

Reexamination Certificate

active

07602997

ABSTRACT:
This invention presents a super-resolution image reconstruction from a sequence of aliased imagery. The sub-pixel shifts (displacement) among the images are unknown due to uncontrolled natural jitter of the imager. A correlation method is utilized to estimate sub-pixel shifts between each low resolution aliased image with respect to a reference image. An error-energy reduction algorithm is derived to reconstruct the high-resolution alias-free output image. The main feature of this proposed error-energy reduction algorithm is that we treat the spatial samples from low-resolution images that possess unknown and irregular (uncontrolled) sub-pixel shifts as a set of constraints to populate an over-sampled (sampled above the desired output bandwidth) processing array. The estimated sub-pixel locations of these samples and their values constitute a spatial domain constraint. Furthermore, the bandwidth of the alias-free image (or the sensor imposed bandwidth) is the criterion used as a spatial frequency domain constraint on the over-sampled processing array.

REFERENCES:
patent: 5767987 (1998-06-01), Wolff et al.
patent: 6023535 (2000-02-01), Aoki
patent: 6157732 (2000-12-01), Drisko et al.
patent: 6208765 (2001-03-01), Bergen
patent: 6285804 (2001-09-01), Crinon et al.
patent: 6344893 (2002-02-01), Mendlovic et al.
patent: 6349154 (2002-02-01), Kleihorst
patent: 6424749 (2002-07-01), Zhu et al.
patent: 6483952 (2002-11-01), Gregory et al.
patent: 6628845 (2003-09-01), Stone et al.
patent: 6642497 (2003-11-01), Apostolopoulos et al.
patent: 6650704 (2003-11-01), Carlson et al.
patent: 7106914 (2006-09-01), Tipping et al.
patent: 2004/0239885 (2004-12-01), Jaynes et al.
patent: 2006/0053455 (2006-03-01), Mani et al.
patent: 2006/0279585 (2006-12-01), Milanfar et al.
patent: 2007/0130095 (2007-06-01), Peot et al.
patent: 2007/0206678 (2007-09-01), Kondo
S.S. Young, “Alias-free Image Subsampling Using Fourier-based Windowing Method,” Optical Engineering, 43(4), 843-855, Apr. 2004.
M. Irani and S. Peleg, “Improving Resolution by Image Registration,” CVGIP: Graphical Models and Image Processing, vol. 53, pp. 231-239, May 1991.
R. C. Hardie, K.J. Barnard, and E. E. Armstrong, “Joint MAP registration and high-resolution image estimation using a sequence of undersampled images,” IEEE Trans. Image Processing, vol. 6, pp. 1621-1633, Dec. 1997.
A. Papoulis, Chapter 14, Probability Random Variables, and Stochastic Processes, McGraw-Hill Book Company Inc., New York, 1984.
H. Stark and P. Oskoui, “High-resolution image recovery from image-plane arrays, using convex projections,” J. Opt. Soc. Am. A, vol. 6, No. 11, pp. 1715-1726, Nov. 1989.
R. W. Gerchberg, “Super-resolution through error energy reduction,” Optica Acta, vol. 21, 1974.
S. Foucher, G. B. Benie, and J. M. Boucher, “Multiscale MAP filtering of SAR images,” IEEE Trans. Image Process. 10 (1), 49-60 (Jan. 2001).
B. J. Geiman, L. N. Bohs, M. E. Anderson, S. M. Breit, and G. E. Trahey, “A novel interpolation startegy for estimating subsample speckle motion,” Phys. Med. Biol. 45(6), 1541-1552 (Jun. 2000).
R. Leptoukh, S. Ahmad, P. Eaton, M. Hegde, S. Kempler, J. Koziana, D. Ostrenga, D. Ouzounov, A. Savtchenko, G. Serafina, A. K. Sharma, and B. Zhou, “GES DAAC tools for accessing and visualizing MODIS data,” Proc. Geosci. Remote Sens. Symp. IGARSS '02 6, 3202-3204 (2002).
B. E. Schmitz and R. L. Stevenson, “The enhancement of images containing subsampled chrominance information,” IEEE Trans. Image Process. 6(7), 1052-1056 (1997).
A. Dumitras and F. Kossentini, “High-order image subsampling using feedforward artificial neural networks,” IEEE Trans. Image Process. 10(3), 427-435 (2001).
A. Landmark, N. Wadstromer, and H. Li, “Hierarchical subsampling giving fractal regions,” IEEE Trans. Image Process. 10(1), 167-173 (2001).
R. A. F. Belfor, M. P. A. Hesp, R. L. Lagendijk, and J. Biemond, “Spatially adaptive subsampling of image sequences,” IEEE Trans. Image Process. 3(5), 492-500 (1994).
R.Y. Tsai and T.S. Huang, “Mulitple Frame Image Restoration and Registration,” Advances in Computer Vision and Image Processing, Greenwich CT: JAI Press, Inc. 1984, pp. 317-339.
B.C. Tom and A.K. Katsaggelos, “Reconstruction of a High-resolution Image by Simultaneous Registration, Restoration, and Interpolation of Low-resolution Images,” Proceedings of 1995 IEEE Int. Conf. Image Processing, col. 2, Washington, DC, Oct. 1995, pp. 539-542.
R.R. Schulz and R. L. Stevenson, “Extraction of high-resolution frames from video sequences,” IEEE Trans. Image Processing, vol. 5, pp. 996-1011, Jun. 1996.
A. M. Guamieri, C. Prati, and F. Rocca, “SAR interferometric quick-look,” Proc. Geosci. Remote Sens. Symp. IGARSS '93 3, 988-990 (1993).
J. O. Kim, B. T. Choi, A. Morales, and S. J. Ko, “Neural concurrent subsampling and interpolation for images,” Proc. IEEE 2, 1327-1330 (1999).
J. R. Casas and L. Torres, “Morphological filter for lossless image subsampling,” Proc. Int. Conf. Image Process. ICIP-94 2, 903-907 (1994).

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Method of super-resolving images does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method of super-resolving images, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method of super-resolving images will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-4101671

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.