Television – Image signal processing circuitry specific to television – Special effects
Patent
1996-12-30
2000-09-19
Peng, John K.
Television
Image signal processing circuitry specific to television
Special effects
348586, 348590, 348591, 348592, 382106, H04N 975
Patent
active
061220132
DESCRIPTION:
BRIEF SUMMARY
FIELD OF THE INVENTION
The present invention relates to methods and apparatus for studio imaging including chromakeying.
BACKGROUND OF THE INVENTION
Background chromakey panels are commonly used in the art of television and video production in order to facilitate merging of a virtual background with foreground figures. The foreground figures are imaged on the chromakey panel background, and the known color of the chromakey panel background is detected and replaced by the virtual background. One problem associated with such productions is that changes in the foreground image, due to camera displacement, pan, tilt and zoom in and out, are not automatically applied to the background scene.
One system designed to solve this problem is the "Virtual Studio" developed by Ultimatte. The "Virtual Studio" requires a special memory head pedestal which measures the camera's pan and tilt angles directly from the camera's mount. A disadvantage of this approach is that in order to obtain a complete perspective transformation for the background image, the zoom state of the lens must be read and the instantaneous location of the camera must be determined. Also, this approach requires that each and every camera mount be replaced by a memory head pedestal, resulting in an expensive system and complicated operation if a large number of cameras are employed. Also, the accuracy of this method is inadequate for seamless foreground/background merging.
Conventional edge detection methods which are based on smoothing and finding directional derivates are described in the following publication, the disclosure of which is hereby incorporated by reference:
Canny, J., "A computational approach to edge detection", IEEE Trans. on PAMI, PAMI-8, No. 6, 1986, 679-697.
Conventional edge detection methods which are based on Hough transforms are surveyed in the following publication, the disclosure of which is hereby incorporated by reference:
J. Illingworth and J. Kitler, "A survey of the Hough transform", CVGIP, 44, 1988, 87-116.
FIG. BA-1 is a simplified block diagram of a state of the art chromakeying system.
SUMMARY OF THE INVENTION
The present invention seeks to provide improved methods and apparatus for chromakeying.
There is thus provided in accordance with a preferred embodiment of the present invention a chromakeying panel for use in conjunction with a chromakeying system having a color keying spectrum, the panel including a plurality of first locations bearing a first color within the color keying spectrum, and a plurality of second locations bearing a second color within the color keying spectrum.
Further in accordance with a preferred embodiment of the present invention the first color and the second color are of the same hue and of different intensities.
There is additionally provided in accordance with a preferred embodiment of the present invention a chromakeying system including a frame grabber operative to grab an image of a foreground image including at least one nonuniform chromakeying panel having a known pattern and a subject, a perspective transformation computation unit operative to compute a perspective transformation by comparing the image of at least one portion of the captured panel with the known pattern, and a background generation unit operative to receive a background image, to apply the perspective transformation thereto and to replace the captured portion of at least one panel with the transformed background, thereby to generate a composite image.
Still further in accordance with a preferred embodiment of the present invention the system also includes a 3D background image source operative to provide the background generation unit with a 3D representation of a background scene.
Additionally in accordance with a preferred embodiment of the present invention the system also includes a background image sequence source operative to provide the background generation unit with a temporal sequence of background scenes and wherein the perspective transformation computation unit is operative in real time relativ
REFERENCES:
patent: 2974190 (1961-03-01), Geiger
patent: 3887762 (1975-06-01), Uno et al.
patent: 3973239 (1976-08-01), Kakumoto et al.
patent: 4000399 (1976-12-01), Kawahara
patent: 4010446 (1977-03-01), Kawa
patent: 4200890 (1980-04-01), Inaba et al.
patent: 4393394 (1983-07-01), McCoy
patent: 4394680 (1983-07-01), Watanabe
patent: 4396939 (1983-08-01), Kitahama
patent: 4409611 (1983-10-01), Vlahos
patent: 4409618 (1983-10-01), Inaba et al.
patent: 4488169 (1984-12-01), Yamamoto
patent: 4533937 (1985-08-01), Yamamoto et al.
patent: 4547897 (1985-10-01), Peterson
patent: 4566126 (1986-01-01), Miyagawa et al.
patent: 4621280 (1986-11-01), Shinohara et al.
patent: 4628363 (1986-12-01), Kashiwa et al.
patent: 4630101 (1986-12-01), Inaba et al.
patent: 4947240 (1990-08-01), Hausdorfer
patent: 4949165 (1990-08-01), Riemann et al.
patent: 4979021 (1990-12-01), Thomas
patent: 5264933 (1993-11-01), Rosser et al.
patent: 5353392 (1994-10-01), Luquet et al.
patent: 5488675 (1996-01-01), Hanna
patent: 5491517 (1996-02-01), Kreitman et al.
patent: 5502482 (1996-03-01), Graham
patent: 5566251 (1996-10-01), Hanna
patent: 5737031 (1998-04-01), Tzidon
Canny, J., "A Computational Approach to Edge Detection", IEEE Trans. On PAMI, PAMI-8, No. 6,1986, 679-697.
Illingworth, J. And Kitler, J., "A Survey of the Hough Transform", CVGIP, 44,1988, 87-116.
Serra J. Image Analysis and Mathamatical Morphology, Academic Press, London 1982.
Rosenfeld et al. Digital Picture Processing, Academic Press 1982 2:84-112.
Haseba et al. Real-Timing compositing system of a real camera image and a computer graphic image, International Broadcasting Convention Sep. 16-20, 1994 Conf. Publ. No.. 397, IEEE 1994 656-660.
Cafforio et al. The differential method for motion estimation, in: T.S. Huang eg., Image sequence processing and dynamic scene analysis Spring, Berlin, 1983 104-124.
Adiv G. Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several moving objects, IEEE trans. Pattern Analysis and Machine Intelligence 1985 7:384-401.
Sommerhauser F. Das virtuelle studio Grundlagen Einer Neuen Studioproduktionstechnik Fernseh-Und Kino-Technik 50 Jahrgang Nr. 1-2/1996.
Adiv, G., "Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects", EEE trans. Pattern Analysis and Machine Intelligence, 1985, 7, 384-401.
Cafforio et al., "The Differential Method for Motion Estimation", in: Image Sequence Processing and Dynamic Scene Analysis, T. S. Huang (ed.) Spring, Berlin, 1983 104-124.
Weng et al., "Calibration of Stereo Cameras Using a Non-Linear Distortion Model", IEEE 10th. Intl. Conf. Pattern Recognition, Jun. 16-21, 1990, 246-253.
Sommerhauser, F., "Das Virtuelle Studio Grundlagen Einer neuen Studioproduktionstechnik", Fernseh-Und Kino-Technik 50, Jahrgang Nr. 1-2/1996 (English language abstract included).
Sharir Avi
Tamir Michael
Orad, Inc.
Peng John K.
Sajous Wesner
LandOfFree
Chromakeying system does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Chromakeying system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Chromakeying system will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-1078553