Image analysis – Image transformation or preprocessing – Changing the image coordinates
Reexamination Certificate
1999-04-27
2003-04-22
Patel, Jayanti K. (Department: 2625)
Image analysis
Image transformation or preprocessing
Changing the image coordinates
C382S291000
Reexamination Certificate
active
06553152
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates to image processing systems and methods, and more particularly to image registration systems that combine two or more images into a composite image.
Image registration involves combining two or more images, or selected points from the images, to produce a composite image containing data from each of the registered images. During registration, a transformation is computed that maps related points among the combined images so that points defining the same structure in each of the combined images are correlated in the composite image.
Currently, practitioners follow two different registration techniques. The first requires that an individual with expertise in the structure of the object represented in the images label a set of landmarks in each of the images that are to be registered. For example, when registering two MRI images of different axial slices of a human head, a physician may label points, or a contour surrounding these points, corresponding to the cerebellum in two images. The two images are then registered by relying on a known relationship among the landmarks in the two brain images.
The mathematics underlying this registration process is known as small deformation multi-target registration. In the previous example of two brain images being registered, using a purely operator-driven approach, a set of N landmarks identified by the physician, represented by x
i
, where i=1 . . . N, are defined within the two brain coordinate systems. A mapping relationship, mapping the N points selected in one image to the corresponding N points in the other image, is defined by the equation u(x
i
)=k
i
, where i=1 . . . N. Each of the coefficients, k
i
, is assumed known.
The mapping relationship u(x) is extended from the set of N landmark points to the continuum using a linear quadratic form regularization optimization of the equation:
u
=
arg
min
u
∫
&LeftDoubleBracketingBar;
Lu
&RightDoubleBracketingBar;
2
(
1
)
subject to the boundary constraints u(x
i
)=k
b
. The operator L is a linear differential operator. This linear optimization problem has a closed form solution. Selecting L=&agr;∇
2
+&bgr;∇(∇·) gives rise to small deformation elasticity. For a description of small deformation elasticity see S. Timoshenko,
Theory of Elasticity,
McGraw-Hill, 1934 and R. L. Bisplinghoff, J. W. Marr, and T. H. H. Pian,
Statistics of Deformable Solids,
Dover Publications, Inc., 1965. Selecting L=∇
2
gives rise to a membrane or Laplacian model. Others have used this operator in their work, see e.g., Amit, U. Grenander, and M. Piccioni, “Structural image restoration through deformable templates,”
J. American Statistical Association.
86(414):376-387, June 1991, and R. Szeliski,
Bayesian Modeling of Uncertainty in Low-Level Vision,
Kluwer Academic Publisher, Boston, 1989 (also describing a bi-harmonic approach). Selecting L=∇
4
gives a spline or biharmonic registration method. For examples of applications using this operator see Grace Wahba, “
Spline Models for Observational Data,
” Regional Conference Series in Applied Mathematics. SIAM, 1990, and F. L. Bookstein,
The Measurement of Biological Shape and Shape Change,
volume 24, Springer-Verlag: Lecture Notes in Biomathematics, New York, 1978.
The second currently-practiced technique for image registration uses the mathematics of small deformation multi-target registration and is purely image data driven. Here, volume based imagery is generated of the two targets from which a coordinate system transformation is constructed. Using this approach, a distance measure, represented by the expression D(u), represents the distance between a template T(x) and a target image S(x) The optimization equation guiding the registration of the two images using a distance measure is:
u
=
arg
min
u
∫
&LeftDoubleBracketingBar;
Lu
&RightDoubleBracketingBar;
2
+
D
(
u
)
(
2
)
The distance measure D(u) measuring the disparity between imagery has various forms, e.g., the Gaussian squared error distance ∫|T(h(x))−S(x)|
2
dx, a correlation distance, or a Kullback Liebler distance. Registration of the two images requires finding a mapping that minimizes this distance.
One limitation of the first approach to image registration is that the registration accuracy depends on the number and location of landmarks selected. Selecting too few landmarks may result in an inaccurate registration. Selecting too many landmarks does not necessarily guarantee accurate registration, but it does significantly increase the computational complexity of registration. Furthermore, it is not always possible to identify appropriate structural landmarks in all images.
The second technique is limited by the computational complexity presented by the number of data points in most images. The second technique is further limited by the fact that the process produces many local minima that confuse proper registration. This is because when registering two images according to the second technique, many possible orientations of the images produce subregions in the images that are properly matched, but the images as a whole are improperly registered.
There is, therefore, a need for a registration technique that overcomes the limitations of the conventional techniques.
SUMMARY OF THE INVENTION
The present invention overcomes the limitations of the conventional techniques by providing a methodology which combines, or fuses, some aspects of both Techniques. Specifically, the present invention uses landmark manifolds to produce a coarse registration, and subsequently incorporates image data to complete a fine registration of the template and target images.
Additional features and advantages of the invention will be set forth in the description which follows, and in part, will be apparent from the description, or may be learned by practicing the invention. The objectives and other advantages of the invention will be realized and obtained by the method and apparatus particularly pointed out in the written description and the claims hereof as well as in the appended drawings.
To achieve these and other advantages and in accordance with the purpose of the invention, as embodied and broadly described, a method according to the invention for registering a template image and a target image comprises several steps, including defining manifold landmark points in the template image and identifying points in the target image corresponding to the defined manifold landmark points. Once these points have been identified, the method includes the steps of computing a transform relating the defined manifold landmark points in the template image to corresponding points in the target image; fusing the first transform with a distance measure to determine a second transform relating all points within a region of interest in the target image to the corresponding points in the template image; and registering the template image with the target image using this second transform.
Both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
REFERENCES:
patent: 4590607 (1986-05-01), Kauth
patent: 4722056 (1988-01-01), Roberts et al.
patent: 5204944 (1993-04-01), Wolberg et al.
patent: 5323472 (1994-06-01), Falk
patent: 5351310 (1994-09-01), Califano et al.
patent: 5368030 (1994-11-01), Zinreich et al.
patent: 5399146 (1995-03-01), Nowacki et al.
patent: 5402801 (1995-04-01), Taylor
patent: 5465308 (1995-11-01), Hutcheson et al.
patent: 5483961 (1996-01-01), Kelly et al.
patent: 5568809 (1996-10-01), Ben-haim
patent: 5572999 (1996-11-01), Funda et al.
patent: 5588430 (1996-12-01), Bova et al.
patent: 5630431 (1997-05-01), Taylor
patent: 5675720 (1997-10-01), Sato et al.
patent: 5676673 (1997-10-01), Ferre et al.
patent: 5695500 (1997-12-01), Taylor et al.
patent:
Christensen Gary E.
Grenander Ulf
Joshi Sarang C.
Miller Michael I.
Azarian Seyed
Patel Jayanti K.
Senniger Powers Leavitt & Roedel
Surgical Navigation Technologies Inc.
LandOfFree
Method and apparatus for image registration does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for image registration, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for image registration will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3101606