Image analysis – Applications – Motion or velocity measuring
Reexamination Certificate
1997-10-09
2001-02-27
Couso, Jose L. (Department: 2724)
Image analysis
Applications
Motion or velocity measuring
C382S128000
Reexamination Certificate
active
06195445
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The invention relates to computer vision techniques and, more particularly, to apparatus and methods for automatically tracking objects contained in image sequences.
2. Description of the Prior Art
In the field of computer vision, active contours have been used to detect and track objects of interest in a sequence of digital images. Computer systems capable of tracking active contours have been successfully used to perform a variety of image processing tasks, such as deleting, enhancing, coloring, reshaping or otherwise modifying selected objects in digital images according to some predetermined criteria. Although contour tracking systems have served the purpose, they have not proved entirely reliable in many image processing applications where it is necessary to track complex, deformable and/or articulated objects.
For example, image tracking systems have found important applications in some medical diagnostic equipment. A need has long existed in the medical field for imaging systems which enhance selected portions of medical images, such as magnetic resonance images, digitally subtracted angiograms and computer tomography images. However, current diagnostic systems often have limited image tracking capabilities when processing medical images containing complex arrays of similar objects that are subject to rapid movements. Specifically, the medical community has long expressed a special need for more reliable techniques of automatically, or semi-automatically, detecting and displaying enhanced images of selected arteries in motion, e.g., the time evolution of the left and right ventricles, when diagnosing abnormalities of a human heart such as arterial stenosis. However, the relevant medical images normally contain, in addition to an artery of interest, an assortment of similarly shaped arteries, veins, and other vessels which move rapidly as the heart beats. To improve visualization of such medical image sequences, stabilizing techniques have been developed which track a user-selected point on an artery and digitally translate the image data such that the selected point remains motionless throughout the image sequence. Examples of point stabilizing techniques of this type may be found in the following documents: Eigler et al, “Improving detection of coronary morphologic features from digital angiograms: Effect of stenosis stabilization display,”
Circulation
, Volume 89, pp. 2700-2709, 1994 (hereinafter the Eigler et al article); U.S. Pat. No. 5,054,045 entitled “Coronary Tracking Display,” issued on Oct. 1, 1991 to Whiting et al (hereinafter the Whiting et al patent); and U.S. Pat. No. 5,293,574 entitled “Digital X-Ray Imaging System with Automatic Tracking,” issued on Mar. 8, 1994 to Roehm et al (hereinafter referred to as the Roehm et al patent).
Active contour tracking essentially involves the process of segmenting a first image into separate regions and then tracking these regions through time from a sequence of similar images. Segmenting a digital image, which typically comprises an array of pixels, involves the process of identifying which pixel belongs to which region. Data is then generated which identifies sets of pixels that represent a contour that approximately outlines a distinct feature, such as an edge or a ridge, that defines the regions of interest. In many applications, the regions may be relatively uncomplicated and can be approximated with simple geometric shapes, such as circles, rectangles, ellipses, or others. However, since many natural objects cannot be described by simple geometric shapes, techniques have been developed to represent an edge or a ridge on these objects with more complex contours than those simple shapes. One important prior art technique for modeling complex shapes with active contours involves the use of “snakes.” The following article describes a snake technique in detail: Kass et al, “Snakes : Active Contour Models,”
International Journal of Computer Vision
, Vol. 2, pp 321-331, 1988.
In general, a snake is an energy-minimizing active contour that is guided by external constraint forces and influenced by image forces that pull it toward features of interest such as lines, ridges and edges of an object. A typical energy or cost function for a snake may contain terms that measure the smoothness of the contour and the amount of edge strength along the contour. The goal is to minimize this function to find an optimal contour which is smooth and coincides with high-gradient magnitude points in the image. The Kass et al article proposes to minimize an energy or cost function using Euler equations and gradient descent.
A disadvantage of most snake techniques is that they can be very dependent on the starting points of the contour. The energy or cost minimization processes in snake techniques are usually based solely on gradient descent and are not guaranteed to locate a global minimum of the corresponding function. As a result, neighboring edges can be very distracting to such a process. Hence, depending on the initial contour configuration, different local minima of the corresponding function may be reached, thereby failing to find the optimal contour.
Another image tracking technique involves the use of “level sets”, which have been used to model moving boundaries between two regions in physical phenomenon, such as an interface between ice and water at the polar regions, or an interface between fire and grass in a brush fire. In such situations, it is difficult to model the evolution of the contour and prevent the contour from crossing over itself. The level set approach builds an original curve into a surface called a “level set function”. Then, instead of moving the curve, the level set function expands, rises and falls. The advantage of this technique is that the level set function is very well behaved; thus, topological changes which break the curve or merge two different curves are handled naturally. Also, this method extends very easily in three dimensions to model moving surface interfaces.
Unfortunately, the level set technique is primarily designed for tracking homogeneous objects. Also, it has been recognized that this technique requires symmetric initialization in the sense that if the initial contour is placed close to part of an object boundary, the contour can cross over that portion before reaching the other portions of the object boundary. In addition, if there are gaps in the object boundary, the level set will pass through the gaps without capturing the object of interest. In level set models, the contour usually slows down around image edges, but it does not come to a complete stop unless the edge is an ideal edge. For real edges, therefore, the contour has to be stopped in an ad-hoc manner.
A popular solution for locating the global optimum of a cost function involves a searching procedure that uses a graph exploration technique. Prior art graph exploration techniques have been primarily applied to extracting objects in a single image. Since it is difficult to model the shape of an object for tracking purposes, graph exploration techniques for contour extraction have had very limited success in tracking applications. Consequently, a need exists for image tracking systems capable of locating the global optimum of a cost function that combines shape and image information for a well defined active contour in an image sequence.
SUMMARY OF THE INVENTION
The present invention satisfies this need by providing an image tracking system, comprising an image sensor and an image processor, for acquiring a sequence of images and for generating digital image data related to light intensity at pixels having coordinates i and j of each of the images. A computer connects to the image sensor and image processor and stores and processes the digital image data to track an object of interest in the sequence of images. The computer comprises an input contour device for defining an input contour (in terms of pixel coordinates i and j) outlining an image characteristic of the object
Dubuisson-Jolly Marie-Pierre
Gupta Alok
Liang Cheng-Chung
Couso Jose L.
Do Anh Hong
Paschburg Donald B.
Siemens Corporate Research Inc.
LandOfFree
Motion compensation of an image sequence using optimal... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Motion compensation of an image sequence using optimal..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Motion compensation of an image sequence using optimal... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2558554