Image analysis – Applications – 3-d or stereo imaging analysis
Reexamination Certificate
1998-10-06
2001-11-20
Boudreau, Leo (Department: 2621)
Image analysis
Applications
3-d or stereo imaging analysis
C382S255000, C382S275000
Reexamination Certificate
active
06320979
ABSTRACT:
FIELD OF INVENTION
This invention pertains to the field of image focus enhancement. More specifically, this invention pertains to using information from multiple images to construct an image with an apparently enhanced depth of field. The invention is preferably implemented in a digital computer.
BACKGROUND OF THE INVENTION
Depth of field is a measurement of the range of depth along a view axis corresponding to the in-focus portion of a three dimensional scene being imaged to an image plane by a lens system. Several parameters of a lens system influence the depth of field of that lens system. In general, optical systems with high magnification, such as microscopes, have small depths of field. Also, optical systems which use large aperture lens systems to capture more light generally have small depths of field.
In some situations it is desirable to have the benefits of a larger depth of field without giving up those optical qualities which generally result in small depths of field. For example, some analyses of microscopic specimens would be aided by the availability of a high magnification microscope with a relatively large depth of field. Such a microscope could be used to more clearly image the full structure of a microscopic object which is three dimensional in nature. Ordinary microscopes generally allow the clear viewing of a thin section of such a three dimensional specimen, due to the small depth of field of those microscopes. Portions of the specimen which are on either side of the in-focus section will be out of focus, and will appear blurry. The ability to clearly see the full three dimensional structure of a specimen would aid in the understanding of the structure of that specimen. This would be especially useful when used in conjunction with biojective microscopes which allow a user to view a specimen stereoscopically.
Another situation in which a small depth of field can pose problems is the low light photography of a scene with large depth variations. An example of this is a landscape scene including foreground objects photographed at night. In order to get sufficient light onto the film at the image plane of the camera, a large aperture lens must generally be used. A large aperture lens, however, will result in a relatively small depth of field. Because of the small depth of field, only a portion of the scene being photographed will be in focus.
A conventional method of imaging the depth information of a three dimensional microscopic scene is confocal microscopy. In confocal microscopy a single photodetector is situated behind a pinhole in an opaque screen. An objective lens focuses light from an illuminated point onto the pinhole, and the screen masks out any non-focused light. The illuminated point is generally illuminated by an intense, focused light source, such as a laser. The illuminating light source and the pinhole must be scanned over a microscopic specimen, either one point at a time or in a series of lines, in order to build up information for the whole region of interest. Depth information can be extracted from the data recorded by the photodetector. The information obtained from a confocal microscope can be used to image the three dimensional structure of microscopic specimens, but such a system is too complex and expensive for typical microscopy. Also, confocal microscopy is limited to situations in which microscopic specimens are being imaged, and is not practical for imaging macroscopic scenes.
What is needed is a system capable of producing an image of a three dimensional scene with enhanced focus over a large depth of field, without sacrificing optical qualities which ordinarily require a small depth of field.
SUMMARY OF THE INVENTION
A lens system (
100
) and image plane (
104
) are used to capture a number of sample images (
400
) of a three dimensional scene, each sample image (
400
) having a is depth of field which is smaller than desired. Each sample image (
400
) corresponds to a different object distance (
106
), which is the distance from the objective lens of the lens system (
100
) to the plane in the scene that is focused on the image plane (
104
). The in-focus portions of each of the sample images (
400
) are merged into a composite image (
620
) that appears to have a depth of field greater than any of the sample images (
400
). Because the sample images (
400
) can each have an arbitrarily small depth of field, the lens system (
100
) can have a large aperture, and the scene can be highly magnified by the lens system (
100
). The optical qualities which ordinarily result in a small depth of field are retained in an image (
620
) having apparently deep focus.
In one embodiment, the lens system (
100
) is movably attached to a camera housing (
302
) such that a motor (
304
) can move the lens system (
100
) in the direction of the central axis of the lens system (
100
). A two dimensional array (
300
) of photo-sensors is mounted in the camera (
308
) along the central axis of the lens system (
100
). As the lens system (
100
) is traversed along the central axis, points at various distances in front of the lens system (
100
) pass in and out of focus on the array (
300
) of photo-sensors. Image information is captured from the array (
300
) as it is traversed, producing a series of depth-differentiated sample images (
400
).
The in-focus portion of each sample image (
400
) is identified through contrast analysis. The in-focus portions thus identified are combined to produce a composite image (
620
) of the scene exhibiting an apparently large depth of field.
REFERENCES:
patent: 3623811 (1971-11-01), Lederer et al.
patent: 3682071 (1972-08-01), Hosoe
patent: 3769889 (1973-11-01), Wechsler
patent: 3875401 (1975-04-01), Stauffer
patent: 3883251 (1975-05-01), Helava
patent: 3896304 (1975-07-01), Aoki et al.
patent: 3953863 (1976-04-01), Lang
patent: 4650282 (1987-03-01), Lo
patent: 4661986 (1987-04-01), Adelson et al.
patent: 5249035 (1993-09-01), Yamanaka
patent: 5347363 (1994-09-01), Yamanaka
patent: 5390024 (1995-02-01), Wright
patent: 5432712 (1995-07-01), Chan
patent: 5448322 (1995-09-01), Bacs, Jr.
patent: 5455689 (1995-10-01), Taylor et al.
patent: 5475422 (1995-12-01), Mori et al.
patent: 5495576 (1996-02-01), Ritchey
patent: 5506654 (1996-04-01), Kim
patent: 5510831 (1996-04-01), Mayhew
patent: 5539572 (1996-07-01), Greenberg et al.
patent: 5557323 (1996-09-01), Kajiwara
patent: 5644651 (1997-07-01), Cox et al.
patent: 5655033 (1997-08-01), Inoguchi et al.
patent: 5680474 (1997-10-01), Iijima et al.
patent: 5856844 (1999-01-01), Batterman et al.
patent: 6201899 (2001-03-01), Bergen
patent: WO 96/24875 (1996-08-01), None
Kazufumi Kanada et al., Image Processing and Systhesis for Extended Depth of Field of Optical Microscopes, The Visual Computer, Springer-Verlag, 1992, pp. 351-360.*
Byron Willis et al., Developments in Three-Dimensional Stereo Brightfield Microscopy, Microscopy Research and Technique, 24:437, 1993, pp. 437-451.*
R. J. Pieper et al., Image Processing for Extended Depth of Field, Applied Optics, vol. 22, No. 10, 1983, pp. 1449-1453.*
Shinya Inoue et al., Video Microscopy, ISBN 0-306-42120-8, 1986, pp. 232 418-422.*
Dale E. Newbury et al., Advanced Scanning Electron Microscopy and X-Ray Microanalysis, ISBN 0-306-42140-2, 1986, pp. 236.*
H. N. Southworth, Introduction to Modern Microscopy, ISBN 0-85109-470-8, 1975, pp. 28-29.*
Zhizhuo, W., “From Photogrammetry to Geomatics—a Commemoration of the Accomplishment that is VirtuoZo”, The VirtuoZo Manuscript, http://www.squirrel.com.au/virtuozo/Manuscript/wang.html, Dec. 18, 1997, Australia.
Roux, M., “Cartography Updating”, http://www-ima.enst.fr/active-96/en
ode42.html, Mar. 24, 1998, France.
Dupéret. A., “Automatic Derivation of a DTM to Produce Countour Lines”, http://dgrwww.epfl.ch/PHOT/publicat/wks96/Art-3-2.htmn, Mar. 24, 1998, France.
What is Confocal Microscopy? http://gonzo.sci.man.ac.uk/Confocal/whatis/whatis.html, pp. 1-3, Mar. 24, 1998, United Kingdom.
Huxley, I., “3D View v1.01”, A Quick and Easy Way to Visualize Confocal Reflection Datasets on
Boudreau Leo
Canon Kabushiki Kaisha
Fenwick & West LLP
Werner Brian P.
LandOfFree
Depth of field enhancement does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Depth of field enhancement, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Depth of field enhancement will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2595484