Image analysis – Applications – 3-d or stereo imaging analysis
Reexamination Certificate
2000-01-10
2003-02-04
Ahmed, Samir (Department: 2723)
Image analysis
Applications
3-d or stereo imaging analysis
C345S419000
Reexamination Certificate
active
06516087
ABSTRACT:
FIELD OF INVENTION
The invention relates to a method of comparing two stereo images to determine a location of an object or point in a field of view.
BACKGROUND OF THE INVENTION
It is well-known that the position of an object in a volume can be determined using two spaced apart cameras. Both cameras take an image of the object at the same time or nearly the same time. Then the images are compared to determine the location in each image of a point or series of points on the object. From that information one can calculate the location of the object in the volume such that each point on the object has a known and different x, y, z coordinate.
Today there are algorithms which allow computers to perform image matching of two stereo images. Typical images from a video camera contain a 640×480 array of pixels. In a “black and white” image each pixel will have a gray scale value of from 0 to 255. Current algorithms use the gray scale values to perform pixel comparisons to identify the position of an object in one image with respect to the other image. Although this method is quite accurate, substantial computer capacity is needed to perform the image matching and the process is relatively slow. As a result more expensive computer hardware is needed to do stereo image processing. Thus, one must either use expensive image processing hardware to achieve near real time processing or be satisfied with the slow processing speeds that occur with off the shelf computing components such as a personal computer (PC). Consequently, there is a need for a method of determining the position of an object from stereo images which is fast and can be performed on a low cost computer.
For many years the art has used the Laplacian pyramid to process and compress images as part of stereo processing. Compressed images are easier to store and transmit. When an image is subjected to a series of Laplacian transforms via pyramid processing the image becomes successively smaller dimensionally; however, the gray scale information remains at 8 bits. Each higher level array is half the dimensions of its predecessor. Prior to the present invention the art used these full gray scale Laplacian images for stereo image correlation which requires much computational complexity. Yet, I have found that by reducing the gray scale dimensionality of the Laplacian images I can correlate stereo images significantly faster using a simple processor.
SUMMARY OF THE INVENTION
I provide a method for correlating two stereo images in which the images are subjected to a Laplacian operator to produce reduced grayscale Laplacian images in which the pixels have a value of +1, 0 or −1. Then, I overlap the two images to produce pairs of overlapping pixels. The values of the two overlapping pixels are summed in a manner so that if both pixels are +1 or both are −1 the summed value is +1, if one pixel is +1 and the other pixel is −1, the resulting sum is −1 and if one or both pixels are zero the resulting sum is zero. All of the correlation values for the regions about the two overlapping pixels are combined to get a correlation value for the pair of pixels that overlap generating a correlation image. Then, the two Laplacian images are shifted relative to one another and correlation values are computed for each pair of pixels for this particular overlap. This process is repeated several times resulting in correlation images for each overlap. The overlap which has the highest correlation value is the best match for that pixel. Having determined the best match for each pixel, one can then determine the location of an object or point in the field of view using standard stereo processing techniques. Other objects and advantages of the method will become apparent from a description of certain present preferred embodiments illustrated in the drawings.
REFERENCES:
patent: 4661986 (1987-04-01), Adelson
patent: 4797942 (1989-01-01), Burt
patent: 5119444 (1992-06-01), Nishihara
patent: 5259040 (1993-11-01), Hanna
patent: 5325449 (1994-06-01), Burt et al.
patent: 5488674 (1996-01-01), Burt et al.
patent: 5550937 (1996-08-01), Bell et al.
patent: 5963664 (1999-10-01), Kumar et al.
“Practical Real-Time Imaging Stereo Matcher,” Nishihara,Optical Engineering, 23(5), pp. 536-545, Sep./Oct. 1984.
“Electronically Directed ‘Focal’ Stereo” by Peter J. Burt et al., Proceedings of the Fifth International Conference on Computer Vision, pp. 94-101, Jun. 1995.
“Real-time Scene Stablization and Mosaic Construction,” M. Hansen et al., Proceedings of the ARPA Image Understanding Workshop, Monterey, CA, Nov., 1994.
“Small Vision Systems: Hardware and Implementation,” Kurt Konolige at the Eighth International Symposium on Robotics Research, Hayama, Japan, Oct., 1997.
“VLSI Pyramid Chip for Multiresolution Image Analysis,” Gooitzen S. Van Der Wal and Peter J. Bert,International Journal of Computer Vision, 8:3, 177-189 (1992).
“The Laplacian Pyramid as a Compact Image Code,” Peter J. Bert,IEEE Transactions on Communications, vol. Com-31, No. 4, Apr., 1983.
Ahmed Samir
Sensar, Inc.
Woodcock & Washburn LLP
LandOfFree
Method for real time correlation of stereo images does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for real time correlation of stereo images, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for real time correlation of stereo images will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3126099