Image analysis – Applications – Target tracking or detecting
Reexamination Certificate
1999-04-26
2002-06-04
Johns, Andrew W. (Department: 2621)
Image analysis
Applications
Target tracking or detecting
Reexamination Certificate
active
06400832
ABSTRACT:
TECHNICAL FIELD
The present application relates to processing image data, wherein an object from or shown in a first clip of image frames is composited with the frames of a second clip on a frame by frame basis.
BACKGROUND
Advances in the field of digital signal processing have allowed many new developments to be effected in video and film post production. Many sophisticated image modifications and special effects have become widely accepted as part of post production procedures as a result of the developments of such products as “FLAME”, “FLINT RT” and “FIRE”,licensed by the present Assignee.
A “clip” of film or video consists of a plurality of image frames which are displayed at frame rate to create the illusion of a moving image. The process of removing an object from a first clip and adding it to a second clip, to create the illusion that the object was always present in the second clip, is generally referred to as compositing.
Many compositing procedures were developed using highly labour-intensive procedures. Consequently, their application has been limited and, recently, a demand has developed for reducing the amount of labour required in order to achieve these effects, so as to make them more widely available.
When objects are moving within a scene, it is often necessary for an added object to exhibit some movement so as to maintain the illusion. A known process for achieving this is to perform a tracking operation upon a selected position within the background image. The tracking information is then used to effect movement of an added object over time, on a frame by frame basis. This approach has many useful applications but problems occur if, for some reason, it is not possible to maintain a track. This occurs, for example, if a tracked location becomes obscured by another object or if the track location extends beyond the image frame.
A display control system is disclosed in U.S. Pat. No. 4,908,700 in which a moving image of an object is successively compounded with a color picture image from an external source, so as to obtain a compounded image in which the resulting image of the object appears to be moving with respect to the color picture image. A display control apparatus includes a register unit for color range selecting data and circuitry for selecting one of first color image data corresponding to signals which are supplied from an external device such as a television camera and second color image data read from video memory. The value of color image data selected by the selection circuit is compared with a value of the color range selecting data stored in the register unit and based on this comparison either the first color image or second color image data is selected. This allows a first moving image to be inserted within a moving scene but the inter-relation between the two image portions is determined exclusively by the automatic selection made by the system, which, particularly at high definitions, may not always be appropriate.
SUMMARY OF THE INVENTION
According to a first aspect of the present invention, there is provided a method of processing image data, wherein an object shown in a first clip of image frames is composited with frames of a second clip on a frame by frame basis, comprising steps of determining a track of positions over time which specify a relationship between a point on frames from said first clip in relation to corresponding frames in said second clip; overlaying said object transparently over corresponding frames of said second clip; modifying the positions of said track; and compositing said images on the basis of said modified track positions.
The invention provides an advantage in that it is possible to make manual modifications to a tracked object. While modifications are being made, the objects to be added is overlaid but the overlaying process renders the object transparent, such that the underlying background can also be viewed. In this way, it is possible to make manual modifications to the track such that, during the final compositing procedure, the added object is positioned as required and thereby maintain the illusion in the output composited clip.
Preferably, tracked positions are determined by making pixel comparisons between adjacent frames. Preferably, an object is overlaid transparently by adjusting blending values.
According to a second aspect of the present invention, there is provided image processing apparatus, configured to display an object from a first clip of image frames composited with frames of a second clip, comprising determining means configured to determine a track of positions over time which specify a relationship between a point on frames from said first clip in relation to corresponding frames in second clip; overlaying means configured to overlay said object transparently over corresponding frames of said second clip; modifying means configured to modify the positions of said track and compositing means configured to composite said images on the basis of said modified track positions.
Preferably, said modifying means includes means to allow modification by manual operation.
REFERENCES:
patent: 4903700 (1990-02-01), Ishii et al.
patent: 5077610 (1991-12-01), Searby et al.
patent: 5404316 (1995-04-01), Klingler et al.
patent: 5459529 (1995-10-01), Searby et al.
patent: 5923791 (1999-07-01), Hanna et al.
patent: 5999173 (1999-12-01), Ubillos
patent: 0360576 (1990-03-01), None
patent: 0589658 (1994-03-01), None
patent: WO 96/07979 (1996-03-01), None
patent: WO 98/11512 (1998-03-01), None
Discreet Logic Inc.
Gates & Cooper LLP
Johns Andrew W.
Nakhjavan Shervin
LandOfFree
Processing image data does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Processing image data, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Processing image data will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2977014