Image analysis – Pattern recognition – Template matching
Reexamination Certificate
2002-02-27
2003-01-07
Couso, Jose L. (Department: 2621)
Image analysis
Pattern recognition
Template matching
C382S141000, C382S209000, C382S218000, C382S219000, C345S215000, C345S215000, C348S036000, C348S087000, C356S394000
Reexamination Certificate
active
06504957
ABSTRACT:
BACKGROUND OF THE INVENTION
This invention relates to machine vision systems, and more particularly to an image registration method and apparatus for accurately registering an object to be inspected to reference data in order to detect flaws in the object.
Machine vision technology addresses the problem of detecting flaws in objects by analyzing flaws in images obtained from the objects. An image is deemed to be flawed when it does not accurately represent the object it was intended to represent. If the object is flawed, such as might result from wear and tear on the object, or an error in manufacturing the object, a flawed image results. In this case, the flawed image may accurately represent the flawed object, but nevertheless deviates from the image of what an unflawed object would be.
Most of the existing optical defect and flaw detection tools in the electronics manufacturing industry and many in other industries are based on an image-to-reference comparison scheme whereby a digitized product image is compared to some kind of reference data to detect abnormalities. Golden Template Comparison (GTC) is one such machine vision technique commonly employed to detect flaws and defects in images of 2-dimensional scenes that do not suffer from geometric distortion. According to this technique, an image of an object to be tested for flaws is compared to a “golden template”, or reference image. A golden template image is the mean of a plurality of good sample images. To perform the comparison, the input image and the golden template image must be registered with each other, and then subtracted. The resulting difference image is then analyzed for features that indicate flaws or defects in the test object.
In practice, it is found that the quality of the reference image and the accuracy of the registration step are major determinants of the performance of image-to-reference comparison systems. There exist conventional registration devices which register 3 dimensional reference images with images obtained from 3 dimensional test objects. These devices operate by obtaining and analyzing the input image to find identifying features of the imaged object. Identifying features of an object are high-curvature areas of the object such as corners, edges, and holes. The high curvature areas are then matched to the reference image, or vice versa, usually by techniques which calculate normals to the high curvature surfaces.
Alternatively, the object may be scanned to locate high-curvature areas and an input image of the high curvature areas created. The input image is then compared to the reference image to match structures on the reference image with identifying features of the object. Differences in location and orientation the reference image and corresponding identifying features of the input image are identified. Once these differences are found, a rotation matrix is used to update the orientation, or pose, of the reference image, the input image, or both. This process is repeated until there is less than an acceptable amount of misregistration. This approach is also typically implemented by determining normals to high curvature surface areas.
Determination of surface normals has a high degree of error for high curvature surfaces since methods of creating an input image of the object's surface have a large degree of error at high curvature locations. Also, determination of the location and normal vectors for a large number of structures can become computationally burdensome.
Currently, there is a need for a system which efficiently and accurately registers an object's input image to a corresponding reference image of the object.
BRIEF SUMMARY OF THE INVENTION
A system for registering an input image to a reference image includes one or more imaging devices for obtaining an input image and a processor for comparing the image to the reference image. The processor includes a patch determining device for identifying low curvature portions of the reference image, and for matching the low curvature portions of the reference image to corresponding low curvature portions of the input image.
A transformation estimator provides a transformation matrix which maps points on the reference image
11
to corresponding points on the input image for registration.
REFERENCES:
patent: 5081689 (1992-01-01), Meyer et al.
patent: 5282143 (1994-01-01), Shirai et al.
patent: 5546475 (1996-08-01), Bolle et al.
patent: 5640200 (1997-06-01), Michael
patent: 5668631 (1997-09-01), Norita et al.
patent: 5822742 (1998-10-01), Alkon et al.
patent: 5850466 (1998-12-01), Schott
patent: 5850469 (1998-12-01), Martin et al.
patent: 5859698 (1999-01-01), Chau et al.
patent: 5970166 (1999-10-01), Nichani
patent: 5990901 (1999-11-01), Lawton et al.
patent: 6018349 (2000-01-01), Szeliski et al.
patent: 6041138 (2000-03-01), Nishida
patent: 6064749 (2000-05-01), Hirota et al.
patent: 6072903 (2000-06-01), Maki et al.
patent: 6100894 (2000-08-01), Goel
patent: 6118893 (2000-09-01), Li
patent: 6128046 (2000-10-01), Totsuka et al.
patent: 6134340 (2000-10-01), Hsu et al.
patent: 6157747 (2000-12-01), Szeliski et al.
patent: 6269194 (2001-07-01), Nichani
patent: 6295374 (2001-09-01), Robinson et al.
patent: 6400828 (2002-06-01), Covell et al.
“Closed-Form Solution of Absolute Orientation Using Unit Quaternions” by B. Horn, Journ. of Opt. Soc. Amer., 4(4); 629-642, 1987, [15].
“Computational Geometry for Design and Manufacture” by I.D. Faux and M.J. Pratt, (Ellis Hornwood, Ltd., p. 79 (1979), Chichester [8, p. 72]).
Nguyen Van-Duc
Nzomigni Victor
Stewart Charles Vernon
Couso Jose L.
Desire Gregory
General Electric Company
Patnode Patrick K.
Testa Jean K.
LandOfFree
Method and apparatus for image registration does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for image registration, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for image registration will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3072611