Television – Image signal processing circuitry specific to television – Special effects
Reexamination Certificate
2001-11-02
2003-12-23
Lee, Michael H. (Department: 2614)
Television
Image signal processing circuitry specific to television
Special effects
C348S586000, C348S598000, C382S167000
Reexamination Certificate
active
06667774
ABSTRACT:
BACKGROUND
In an image, a transition occurs between the edge of the subject and its background. This transition can be very narrow if the subject is sharply focused. However, lenses are not so sharp, nor subjects and cameras so still, that the transition will occur between two adjacent pixels in a digital image. The transition occurs over a minimum of at least three pixels, and up to the number of pixels comprising the width of the blurred edge of a moving or out-of-focus subject.
In motion picture and video applications, subjects are generally in motion. The resulting semi-transparency of blurred edges must be retained, but the contribution of the initial background seen through these blurred edges must be removed and replaced with the chosen background. Otherwise, any portion of the initial background remaining in the semitransparent edges becomes edge artifacts in the composite image.
The process described in U.S. Pat. No. 6,134,346, which has become known in the graphic arts industry as the Ultimate Knockout process, will be referred to as such in the subsequent discussion. This Knockout process for the graphics arts has reached such a level of perfection that many of those skilled in the art of compositing are not able to detect that the image they observe is a composite. However, Knockout requires two manually drawn boundary lines to define the subject-to-background transition area, and another outline at the perimeter of a shadow. The inner, outer, and shadow boundary lines are hand-drawn, using a cursor, close to the transition area without touching it. The requirement of hand drawn boundary lines has prevented the use of Knockout for motion picture and video applications.
The invention to be described makes possible the extension of the Knockout process to motion picture and video applications by automatically generating the transition area boundary lines, and by providing a modified clear frame containing shadow information.
U.S. Pat. No. 4,800,432 describes a “Video Difference Key Generator” that employs the subtraction of two images; the first image excludes the subject, while the second image includes the subject. Their difference creates a key signal. A key signal is a switch.
In a switching system there is no proper place to switch, since every pixel in the subject-to-background transition area contains both background and subject. In blurred subject edges, switching creates disturbing edge artifacts in the composite image. Switching does not occur in the Ultimate Knockout image compositing method. The contribution of the background to each pixel in the transition area is determined and removed by subtraction.
While the comparison of two images photographed at different times has been used successfully by military and government agencies to detect changes in the area photographed, it has not achieved much success in real time video because of edge artifacts and other problems. The importance of the difference principle in image compositing is that it does not require a colored backing or uniform illumination to detect a change between two images.
SUMMARY OF THE INVENTION
Changes in a current image frame from variations in room light level, and automatic camera adjustments, are determined and incorporated into a clear (reference) frame, thereby resulting in a zero difference in the background region when the clear frame and a current frame are subtracted. Any deviation from zero defines the beginning edge of a transition from background to subject.
The location of the outer edge of a transition area is further refined by subtracting derivatives of the RGB signals in each frame, and by the use of a fourth color channel when available.
The difference of derivitives (d
cu
-d
cl
) identifies the subject to background transition area, whose edges define the inner and outer boundary lines. These automatically generated inner and outer boundary lines permit the use of the Ultimate Knockout Process in motion picture and video image compositing.
Shadow areas on the backing are retained and may be transferred to the inserted background scene. Small areas on the backing having the same color and luminance as the subject are prevented from printing through the subject by a second “derivative” alpha channel for said small areas.
REFERENCES:
patent: 4800432 (1989-01-01), Barnett et al.
patent: 5812214 (1998-09-01), Miller
patent: 5940140 (1999-08-01), Dadourian et al.
patent: 6134345 (2000-10-01), Berman et al.
patent: 6134346 (2000-10-01), Berman et al.
patent: 6262778 (2001-07-01), Nonweiler et al.
patent: 6288703 (2001-09-01), Berman et al.
patent: 6301382 (2001-10-01), Smith et al.
patent: 6320624 (2001-11-01), Ayer et al.
patent: 6362854 (2002-03-01), Fierke et al.
patent: 6363526 (2002-03-01), Vlahos et al.
Berman Arie
Dadourian Arpag
Vlahos Paul
Blakely & Sokoloff, Taylor & Zafman
Desir Jean W.
iMatte, Inc.
Lee Michael H.
LandOfFree
Method and apparatus for the automatic generation of subject... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for the automatic generation of subject..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for the automatic generation of subject... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3171350