Photography – Plural image recording – Simultaneous recording of plural distinct subjects
Reexamination Certificate
2011-06-14
2011-06-14
Perkey, W. B. (Department: 2862)
Photography
Plural image recording
Simultaneous recording of plural distinct subjects
Reexamination Certificate
active
07962033
ABSTRACT:
Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to light-fields captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.
REFERENCES:
patent: 725567 (1903-04-01), Ives
patent: 2039648 (1936-05-01), Ives
patent: 3985419 (1976-10-01), Matsumoto et al.
patent: 4180313 (1979-12-01), Inuiya
patent: 4193093 (1980-03-01), St. Clair
patent: 4732453 (1988-03-01), de Montebello et al.
patent: 4849782 (1989-07-01), Koyama et al.
patent: 5076687 (1991-12-01), Adelson
patent: 5361127 (1994-11-01), Daily
patent: 5400093 (1995-03-01), Timmers
patent: 5659420 (1997-08-01), Wakai et al.
patent: 5729011 (1998-03-01), Sekiguchi
patent: 5946077 (1999-08-01), Nemirovskiy
patent: 6097541 (2000-08-01), Davies et al.
patent: 6137937 (2000-10-01), Okano et al.
patent: 6268846 (2001-07-01), Georgiev
patent: 6301416 (2001-10-01), Okano et al.
patent: 6339506 (2002-01-01), Wakelin et al.
patent: 6351269 (2002-02-01), Georgiev
patent: 6476805 (2002-11-01), Shum et al.
patent: 6738533 (2004-05-01), Shum et al.
patent: 6838650 (2005-01-01), Toh
patent: 7054067 (2006-05-01), Okano et al.
patent: 7620309 (2009-11-01), Georgiev
patent: 7732744 (2010-06-01), Utagawa
patent: 2001/0012149 (2001-08-01), Lin et al.
patent: 2001/0050813 (2001-12-01), Allio
patent: 2002/0140835 (2002-10-01), Silverstein
patent: 2003/0231255 (2003-12-01), Szajewski et al.
patent: 2004/0114807 (2004-06-01), Lelescu et al.
patent: 2004/0223214 (2004-11-01), Atkinson
patent: 2005/0088714 (2005-04-01), Kremen
patent: 2005/0122418 (2005-06-01), Okita et al.
patent: 2008/0152215 (2008-06-01), Horie et al.
patent: 2008/0165270 (2008-07-01), Watanabe et al.
patent: 2008/0193026 (2008-08-01), Horie et al.
patent: 2009/0041381 (2009-02-01), Georgiev
patent: 2009/0041448 (2009-02-01), Georgiev
patent: 2009/0140131 (2009-06-01), Utagawa
patent: 2009/0185801 (2009-07-01), Georgiev et al.
patent: 2010/0026852 (2010-02-01), Ng et al.
patent: 2010/0085468 (2010-04-01), Park et al.
patent: 1548481 (2005-06-01), None
patent: 01/37025 (2001-05-01), None
patent: 2006/057838 (2006-06-01), None
patent: 2007/115281 (2007-10-01), None
U.S. Appl. No. 12/503,803, filed Jul. 15, 2009.
U.S. Appl. No. 12/474,112, filed May 28, 2009.
Adelson, T., and Wang, J., “Single lens stereo with a plenoptic camera,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, issue 2, 99-106, 1992.
Borman, S., and Stevenson, R., “Super-resolution from image sequences—a review”, Proceedings of the 1998 Midwest Symposium on Circuits and Systems, Publication Date: Aug. 9-12, 1998, On pp. 374-378.
Elad, M., and Feuer, A., “Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images,” IEEE Transactions on Image Processing Dec. 1997.
Farsiu, S., Robinson, D., Elad, M., and Milanfar, P., “Advances and challenges in super-resolution,” International Journal of Imaging Systems and Technology, 2004.
Georgiev, T., Zheng, K., Curless, B., Salesin, D., and et al., “Spatio-angular resolution tradeoff in integral photography,” Proc. Eurographics Symposium on Rendering, 2006.
Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F., “The lumigraph,” ACM Trans. Graph., 43-54, 1996.
Isaksen, A., McMillan, L., and Gortler, S. J., “Dynamically reparameterized light fields,” ACM Trans. Graph., 297-306, 2000.
Levoy, M., and Hanrahan, P., Light field rendering, ACM Trans. Graph., 31-42, 1996.
Ng, R., Levoy, M., Brdif, M., Duval, G., Horowitz, M., and Hanrahan, P., “Light field photography with a hand-held plenoptic camera,” 2005.
Ng, R., “Fourier slice photography,” International Conference on Computer Graphics and Interactive Techniques Proceedings of ACM SIGGRAPH 2005.
Park, S., Park, M., and Kang, M., “Super-resolution image reconstruction: a technical overview,” Signal Processing Magazine, 2003.
Veeraraghavan, A., Mohan, A., Agrawal, A., Raskar, R., and Tumbline, J., “Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing,” ACM Trans. Graph. 26, 3, 69, 2007.
Levoy, Mark, “Optical Recipes for Light Microscopes,” Stanford Computer Grpahics Laboratory Technical Memo 2006-001, Jun. 20, 2006, 10 pages.
Levoy, Mark et al., “Light Field Microscopy,” Stanford University, Submitted to Siggraph 2006, 5 pages.
David E. Roberts, History of Lenticular and Related Autostereoscopic Methods, 2003, 17 pages.
Georgiev T., Wainer M.: “Morphing Between Multiple Images,” Tech. Rep. (1997).
Fife K., Gamal A. E., Wong H.-S. P.: A 3mpixel multi-aperture image sensor with 0.7um pixels in 0.11um cmos. In IEEE ISSCC Digest of Technical Papers (Feb. 2008), pp. 48-49.
Xiao J., Shah M.: “Tri-view Morphing,” Computer Vision and Image Understanding 96, 3 (2004), 345-366.
Lippmann G.: “Epreuves reversible donnant la sensation du relief (“Reversible Prints Providing the Sensation of Depth”)”, Journal of Physics 7 (1908), pp. 821-825.
Lippmann G.: “Epreuves Reversibles Photographies Integrales,” Academie des sciences (Mar. 1908), pp. 446-451.
Lee S., Wolberg G., Shin S.: “Polymorph: Morphing Among Multiple Images,” IEEE Computer Graphics and Applications (1998).
Zaharia, R., et al., “Adaptive 3D-DCT Compression Algorithm for Continuous Parallax 3D Integral Imaging,” Signal Processing, Image Communication, Elsevier Scient Publishers, Amsterdam, NL, vol. 17, No. 3, Mar. 1, 2002, 12 pages.
Lumsdaine A., Georgiev T.: Full Resolution Lightfield Rendering. Tech. rep., Adobe Systems, Jan. 2008, 12 pages.
Naemura T., Yoshida T., Harashima H.: “3d Computer Graphics Based on Integral Photography,” Optics Express, vol. 2 (2001).
Zitnick C. L., Jojic N., Kang S.: “Consistent Segmentation for Optical Flow Estimation” in Proceedings of IEEE International Conference on Computer Vision (ICCV) (2005).
Seitz S. M., Dyer C. R.: “View Morphing,” ACM Trans. Graph. (1996), 21-30.
Stevens R., Harvey T.: “Lens Arrays for a Three-dimensional Imaging System,” Journal of Optics A, vol. 4 (2002).
Stewart J., Yu J., Gortler S. J., McMillan L.: “A New Reconstruction Filter for Undersampled Light Field,” Eurographics Symposium on Rendering (2003), 150-156.
Vaish V., Wilburn B., Joshi N., Levoy M.: “Using Plane + Parallax to Calibrate Dense Camera Arrays,” In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2004).
Wilburn B., Joshi N., Vaish V., Talvala E., Antunez E., Barth A., Adams A., Levoy M., Horowitz M.: “High Performance Imaging Using Large Camera Arrays,” in ACM Trans. Graph. (2005).
U.S. Appl. No. 11/874,611 filed Oct. 18, 2007.
U.S. Appl. No. 12/144,411 filed Jun. 23, 2008.
U.S. Appl. No. 12/186,396, filed Jun. 23, 2008.
Shree K. Nayar, Vlad Branzoi, Terry E. Boult, “Programmable Imaging using a Digital Micromirror Array”, Shree K. Nayar, Vlad Branzoi, Terry E. Boult, in Conf. on Computer Vision and Pattern Recognition, pp. I: 436-443, 2004.
Dana Dudley, Walter Duncan, John Slaughter, “Emerging Digital Micromirror Device (DMD) Applications”, DLPTM Products New App
Georgiev Todor G.
Lumsdaine Andrew
Adobe Systems Incorporated
Kowert Robert C.
Meyertons Hood Kivlin Kowert & Goetzel P.C.
Perkey W. B.
LandOfFree
Methods and apparatus for full-resolution light-field... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Methods and apparatus for full-resolution light-field..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Methods and apparatus for full-resolution light-field... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2673033