Image analysis – Image transformation or preprocessing – Measuring image properties
Reexamination Certificate
2000-12-22
2004-06-15
Johns, Andrew W. (Department: 2621)
Image analysis
Image transformation or preprocessing
Measuring image properties
C382S151000, C382S306000, C382S103000
Reexamination Certificate
active
06751361
ABSTRACT:
FIELD OF THE INVENTION
This invention relates to machine vision systems for object location and inspection and, more particularly, to techniques for fixturing targets.
BACKGROUND OF THE INVENTION
In many applications, it is necessary to determine the two-dimensional location or translation and angular orientation of an object of interest. Depending on the application, a determination of one or more of these properties is called determining the “alignment” of an object. In some applications, alignment also may include additional degrees of freedom, such as scale, aspect, shear or even various types of non-linear deformations. For example, in a robotic assembly system, it may be necessary to determine the alignment of a printed circuit board so that a robotic arm can place an integrated circuit onto the board at a precise location. One way to perform this alignment is to mechanically constrain the board at a predetermined location and angular orientation. Guides, brackets and many other well-known mechanical arrangements can be used to accomplish this alignment. However, in other applications, it is not feasible to mechanically constrain each object. In these latter systems, machine vision systems are often used to determine the alignment of objects.
Machine vision systems acquire images of an environment, process the images to detect objects and features in the images and then analyze the processed images to determine characteristics of objects and other features detected in the images. The system generally includes a camera/frame grabber system that generates an image that consists of a plurality of digitized image pixels. The image pixels are then processed with an algorithm implemented in software and/or hardware typically called a vision “tool.” These systems can be used to determine the alignment of objects, such as printed circuit boards.
One way to perform this alignment is to acquire an image of the entire object and then use the vision system to determine the alignment of the object. However, since some objects can be quite large, the image acquisition apparatus may not be able to acquire an image of the entire object. Thus, the image may be constrained to only a portion of the object at any one time. Further, even if the entire image can be acquired at once, the processing time required to process the large image might be prohibitive. Also, examining only a portion of the entire image allows the alignment procedure to ignore substantial variations in the object in regions outside the selected portion; for example, circuit boards with different circuit trace patterns could be treated equivalently so long as the selected portions were similar or had similar identifying marks.
Consequently, in many applications, the alignment of an object is determined by examining only selected areas of the object. In order to facilitate this examination “fiducial” marks are placed on the object in the selected areas. These marks might comprise one or more small circles, squares or other shaped marks, where the shape is selected so that it would not occur on the object for any reason other than a fiducial mark. Then, the machine vision system can be instructed to examine the selected areas of the object and to locate the fiducial marks within these areas. The marks assist in determining the alignment of the object because they are in predetermined location is on the object.
Although fiducial marks work well, the alignment problem is complicated because the fiducial marks are generally placed on the object during the manufacture of the object. For example, fiducial marks can be placed on a printed circuit board by etching the marks into the board during the circuit board manufacturing process. However, manufacturing tolerances can distort or degrade the marks. In the case of etching, the etching process can change the original size of the mark if the edges of the mark are over etched or the mark can be distorted during the etching process, which distortion might, for example, distort a circular mark into an oval-shaped mark. Also, the angular orientation of the object, and thus of the fiducial mark on the object, with respect to the camera may not be precisely known. Therefore, the vision tool used to locate the marks must be capable of tolerating some variations in size, shape and angular orientation and still locate the mark.
The manner of determining the alignment of the object depends on the type of vision tool used to locate the marks. Some tools can tolerate variations in size, shape and angular orientation during the location procedure, but have other deficiencies. For example, the earliest vision tool widely used for object location and inspection in industry was blob analysis. In this type of tool, image pixels are classified as object or background pixels by some means, the object pixels are joined to make discrete sub-objects using neighborhood connectivity rules, and various moments of the connected sub-objects are computed to determine object position, size, and orientation. Blob analysis tools can tolerate and measure variations in orientation and size.
However, such tools cannot tolerate the presence of various forms of image degradation. A more serious problem was that the only generally reliable method ever found for separating object pixels from background pixels was to arrange for the objects to be entirely brighter or entirely darker than the background. This requirement is difficult to achieve in other than the most controlled conditions.
In order to overcome the limitations of blob analysis tools, techniques called “template matching” tools were developed to locate objects based on their pattern rather than grayscale intensities. A template matching tool typically starts with a training step. In this step, a software representation called a pattern, or template, of an image or synthetic description of an ideal object is created and stored. At run-time, the template is moved in various positions over the digitized image and compared to like-sized pixel subsets of the image. The position where the best match between the template and image sub-set pixels occurs is taken to be the position of the object. Because a “search” is performed for the best match, this type of tool is often called a search tool. The degree of match (a numerical value) can be used for inspection, as can comparisons of individual pixels between the template and image at the position of best match.
The first template matching tools used a brightness threshold to reduce the pixels of the template and image to two states: “bright” and “dark.” This reduced the computation necessary for the comparison operation to a reasonable level for the available computation facilities. Unfortunately, the thresholding step made sub-pixel accuracy impractical and made the results highly susceptible to the selection of the threshold and variations in illumination and object reflectivity.
Later tools overcame the thresholding problem by using a normalized correlation operation for the template and image comparison step, albeit at the cost of considerable additional computation. Normalized correlation template matching tools also overcame many of the limitations of blob analysis tools—they can tolerate touching or overlapping objects, they perform well in the presence of various forms of image degradation, and the normalized correlation match value is useful in some inspection applications. Most significantly, perhaps, in order for the tool to operate properly, objects need not be separated from background by brightness, enabling a much wider range of applications.
Unfortunately, while normalized correlation template matching tools work well in determining the location of objects that are translated, they will tolerate only small variations in angular orientation and size: typically a few degrees and a few percent (depending on the specific template). Even within this small range of orientation and size variation, the accuracy of the results falls off rapidly when the objects deviate from fixed sizes and orientations
Alavi Amir
Cognex Corporation
Johns Andrew W.
Kudirka Paul
LandOfFree
Method and apparatus for performing fixturing in a machine... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for performing fixturing in a machine..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for performing fixturing in a machine... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3359130