Image analysis – Applications – Personnel identification
Reexamination Certificate
2000-11-07
2004-09-14
Mehta, Bhavesh M. (Department: 2625)
Image analysis
Applications
Personnel identification
C382S162000, C382S173000, C382S181000, C348S029000, C348S033000, C348S152000, C250S330000
Reexamination Certificate
active
06792136
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Technical Field
The present invention generally relates to photographic and video imaging techniques and, more particularly, to a method of producing true color infrared photographic and video images.
2. Discussion
Photographic and video equipment are widely used by law enforcement personnel for surveillance purposes. During the daytime, or under similar bright-light conditions, such photographic and video surveillance is used not only to track subjects, but also for subject identification purposes. This is possible due to the clarity of the image produced by the photographic and/or video equipment.
Surveillance during nighttime or other low-light conditions is more challenging. Due to the low level of ambient light, conventional visible photographic and video imaging is impossible. Such equipment is simply not sensitive enough to capture images during such low light conditions. Recently, however, a new nighttime surveillance technique has been employed by law enforcement officials with success.
To track subjects under low light conditions, law enforcement personnel are now widely employing infrared sensitive equipment. Infrared imaging is based on sensing thermal radiation from a scene and imaging involves recording the heat patterns from the scene. While such infrared sensitive equipment has enabled law enforcement personnel to track subjects during low light conditions, it has not been very useful for subject identification purposes. That is, the image produced by the infrared sensitive equipment is not detailed enough to permit recognition of the facial features of a subject under surveillance. As such, positive identification of a subject is still not possible.
A prior art technique for attempting to overcome the limitations of prior art infrared surveillance techniques is known as false color imaging. Images captured during false color imaging are created from a wider range spectrum than the human visual system can sense. The resulting image is remapped into the visual spectrum to create a pseudo-colored image.
Unfortunately, false color imaging equipment is highly sensitive to blue radiation. This requires the use of a yellow filter to filter out the blue radiation. Such yellow filters distort the color in the image finally produced. Further, the illumination wavelength used for creating red images in such false color imaging equipment is extended into the near infrared spectrum. As such, non-red items that have a high infrared reflectance, such as leaves, are reproduced as red images. Due to these drawbacks, false color imaging has not had great acceptance or success when applied to subjects for identification purposes. Other applications include stealthy surveillance, MPEG-4 object segmentation algorithms, lighting options for the film recording and camcorder industries, and the medical industry.
In view of the foregoing, it would be desirable to provide a technique for producing images during low-light conditions which enables not only tracking of a subject but also sufficient detail to enable subject recognition and identification.
SUMMARY OF THE INVENTION
The above and other objects are provided by a method for creating a true color representation of an infrared image. The methodology begins by capturing an infrared image of a scene under surveillance. The captured image of the same scene taken from different infrared spectral bands are then analyzed to determine if an object, such as a face, is identifiable within the image. If an object is identifiable within the image, the methodology compares the object characteristics with a plurality of stored object images. If a match is made, the methodology looks up characteristics of the object in a database and colors the object according to the database information. If no match is made and the true color cannot be identified, or if no object is identifiable within the image, the methodology determines whether a pattern, such as clothing, is identifiable within the image. If a pattern is identifiable within the image, the methodology looks up information regarding the characteristics of the pattern in the database. The pattern is then colored using infrared reflectance characterization from multispectral imaging as guided by the database pattern information. The non-pattern
on-object containing portions of the image are colored using infrared reflectance characterization from multispectral imaging. Though images are measured in the infrared, the multispectral characterization database allows true visible color images to be produced from infrared images. As such, a true color image is produced enabling subject recognition and identification.
REFERENCES:
patent: 4366381 (1982-12-01), Fischer et al.
patent: 5001558 (1991-03-01), Burley et al.
patent: 5497430 (1996-03-01), Sadovnik et al.
patent: H1599 (1996-10-01), Task et al.
patent: 5999650 (1999-12-01), Ligon
patent: 6035074 (2000-03-01), Fujimoto et al.
patent: 6292575 (2001-09-01), Bortolussi et al.
patent: 6301050 (2001-10-01), DeLeon
patent: 6417797 (2002-07-01), Cousins et al.
patent: 6476391 (2002-11-01), Zhang
patent: 6496594 (2002-12-01), Prokoski
patent: 2002/0015536 (2002-02-01), Warren et al.
Pentland et al, View-based and modular eigenspaces for face recognition, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Jun. 21-23, 1994, p. 84-91.*
Gutta et al, Face surveillance, Sixth International Conference on Computer Vision, Jan. 4-7, 1998, p 646-651.*
Abstract of Lisa Gottesfeld Brown, A survey of image registration techniques, ACM Computing Surveys, Dec. 1992, vol. 24, iss 4, p 325-376.*
Abstract of Strong et al, A region coloring technique for scene analysis, Communications of the ACM, Apr. 1973, vol. 16, iss 4, p 237-246.*
Wilder et al, Comparison of Visible and Infra-Red Imagery for Face Recognition, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Oct. 14-16 1996, p 182-187.*
John Hartung, et al. “Object-Oriented H.263 Compatible Video Coding Platform for Conferencing Applications”, Jan. 1998, IEEE Journal, vol. 16, No. 1.
Brian Dipert, “C'mon, baby, do theAnimotion”, Dec. 23, 1999, pp. 59-665.
Brochure, “Facelt”—Advanced Vision for Face Recognition, Visionics Corporation.
Frances Zelazny, “Visionics Facelt is First Face Recognition Software to be used in a CCTV Control Room Application”, Visionics Corporation.
Frances Zelazny, “Visionics Corporation and Symbol Technologies Enable New Class of 2D Bar Code Applications”, Visionics Corporation.
Polaroid, “Polaroid and Visionics Deliver Real-Time On-Line Face Recognition to DMV Systems”, Press Release.
Frances Zelazny, “Visionics to Unveil Third Generation Facelt Engine”, Visionics Corporation wesite.
“Artificial Retina—A Conceptual Overview”, Mitsubishi Electronic Device Group.
U.S. Patent & Trademark Office, Patent 5,983,147 “Video Occupant detection and classification”; Nov. 9, 1999 (website http://164.195.100.11).
Shaogang Gong, “Face Recognition in Dynamic”, website www.dcs.qmw.ac.uk, Fri. Jul. 11, 1997.
Qing Jiang, “Principal Component Analysis and Neural Network Based Face Recognition”, Nov. 30, 1998, website www.cs.uchicago.edu.
Daniel P. Huttenlocher, et al., “Object Recognition Using Subspace Methods”, Proc. of the European Conference on Computer Vision, pp. 536-545, 1996.
“Image Segmentation”, Image Segmentation by Automatic Contour Tracing, printed Sep. 25, 1999, website www.pixeldata.com.
J. Cai, et al., “Detecting Human Faces in Color Images”, 1998, website www.cs.wright.edu.
“False Color of Jupiter's Great Red Spot”, printed May 22, 1999, website www.jpl.nasa.gov.
Chris Chovit, “ATREM ATmosphere REMoval Program” Earth Remote Sensing Group, Jun. 2, 1997, website http://cires.colorado.edu.
“Imaging Spectroscopy: Concept, Approach, Calibration, Atmospheric Compensation, Research and Applications” printed May 22, 1999, website http://makalu.jpl.nasa.gov.
Ed Scott, “Spectral Sensitivity of the Infrared Color Film” C1997 website http://euro.webtravel.org.
“Infrared P
Mehta Bhavesh M.
Sukhaphadhana Christopher
TRW Inc.
LandOfFree
True color infrared photography and video does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with True color infrared photography and video, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and True color infrared photography and video will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3204998