Computer graphics processing and selective visual display system – Computer graphics processing – Graphic manipulation
Reexamination Certificate
1999-03-31
2002-09-24
Brier, Jeffery (Department: 2672)
Computer graphics processing and selective visual display system
Computer graphics processing
Graphic manipulation
C348S584000
Reexamination Certificate
active
06456300
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates to processing image data to produce control data in which said control data has varying values to define softness.
INTRODUCTION TO THE INVENTION
Many compositing techniques are known in which a first image is combined with a second image selectively at positions throughout the image. The technique is known in cinematographic post production in which silhouettes or mattes are used to blank out portions of the image. Similar techniques have been used in broadcast video applications in which a control signal or a key signal is used to selectively derive images from a first video source or from a second image source. Such key signals may also be represented as images or, during the transmission of video data, control signals may be distributed in parallel with image signals in which the control channel is often referred to as the alpha channel.
In cinematographic film it is possible to produce hard edged mattes given the very high spatial definition of the media. However, when images are transmitted as video signals, at broadcast definition or at a higher definition, it is necessary to quantise the spatial images, thereby significantly reducing the availability of spatial definition.
It has been known for some time that the reduced spatial definition of a video image may be compensated by increased depth such that sub-pixel boundaries may be perceived by the eye by averaging colours at the actual position of the pixels. Similarly, control signals or key signal may be produced which provide for soft blending between the value representing a hard-key-on and a value representing a hard-key-off. Typically, such signals are recorded to a depth of eight bits with a similar eight bits being allocated for the red green and blue colour components.
In a process of chroma-keying, soft values for keys may be produced at image edges where pixels will be quantised with colour components being partially derived from a foreground image and partially derived from the background key colour. Thus, it is possible to derive soft-edge keys automatically which may then be used to smoothly blend a foreground image against a new background image. Furthermore, characteristics of the blending edge may be referred to as the softness of the edge and the key values may be modified in order to enhance the properties of softness.
Soft keys can also be used to key transparent and translucent objects against new backgrounds. Soft keys allow the new background colour to be partially mixed with the new foreground and the blue components present within the original foreground image are suppressed by a process of colour suppression; as is well known in the chroma-keying art. However, many translucent and transparent objects are not uniformly transparent and may achieve their transparency by being made up from very small regions which are either very opaque or very transparent. Thus, when used to produce a soft key signal in a chroma-keying process, it is likely that the transparent region will be perceived as noise and will not achieve the required effect.
A system in which each pixel is represented by three colour components defining a position within colour-space is disclosed in International patent publication WO 98/11510. A base colour is identified and a distance in colour-space between an input colour and said base colour is calculated. The control value, which may be used as a basis for chroma suppress or a chroma-key, is produced in response to the calculated distance.
The system disclosed in this publication provides improved procedures for producing a chroma-key, thereby achieving improved chroma-keying results. However, a problem with the system is that it is difficult for users to control operational parameters so as to make optimum use of the processing facilities available.
A system for processing image data taking the form of a plurality of image pixels forms the subject matter for the applicant's co-pending British patent application 98 06 975.0. A three-dimensional representation of colour-space is displayed and the colour of pixels within an image is analysed. Thereafter, the analysed pixels are displayed at colour related positions within the displayed colour-space.
An advantage of this improved approach is that a user is provided with a graphic visualisation of colour-space regions, thereby allowing colours defined in colour-space to be graphically identified as forming part of a tolerance region or a softness region within colour-space.
A problem associated with defining softness regions is that some textures within an image, such as translucent textures, may produce adverse affects. The development of a chroma-key involves non-linear processes in order to extract the key signal whereupon it is possible for the texture, perceived as noise, to become amplified in parts of the image where intermediate values are generated. This results in clearly visible processing artefacts which could severely restrict the application of the process when textures of this type are present.
A system is described in the applicant's co-pending British patent application 98 06 976.8 in which image data representing a matte, key or control signal is processed. A transitional or softness portion of the matte is identified in which undesirable transitions occur in a form displayed as noise artefacts. The position of the softness region in colour-space is adjusted so as to reduce the relative amplitudes of variations within the identified portion.
Preferably, the softness region is defined in colour-space as a three-dimensional ellipsoid and a process of enlarging the ellipsoid tends to result in additional colour points being included in the softness region which were previously excluded. Thus, a problem may exist in terms of defining softness regions in that the overall selectivity of the region for defining a key may be degraded if the shape of the region is modified in order to mitigate the effect of noise artefacts.
SUMMARY OF THE INVENTION
According to a first aspect of the present invention, there is provided a method of processing image data to produce control data, including a region in which said control data has varying values to define softness, comprising steps of defining a sub-region within said softness region in which said control data is set to a values substantially equal to values outside said softness region.
Preferably, the control data is generated by a process of chroma-keying and the sub-region may be defined with respect to a bounded region of colour-space. Preferably, the bounded region in colour-space has an internal tolerance region and its own surrounding softness region. The sub-region may be defined after the shape of the softness region has been modified to reduce noise artefacts.
According to a second aspect of the present invention, there is provided image processing apparatus configured to produce control data, including a region in which said control data has varying values to define softness, comprising processing means configured to define a sub-region within said softness region in which said control data is set to values substantially equal to values outside said softness region.
In a preferred embodiment, the apparatus includes display means for displaying an image frame and selecting means for manually selecting colours from said image frame, wherein said processing means is configured to define said sub-region in response to a manual selection of colours. The processing means may be configured to determine a bounding volume in response to selected colour co-ordinates and the bounding volume may take the form of a convex hull. An ellipsoid may be derived from the convex hull and the geometry of the ellipsoid may be modified in response to manual operations.
REFERENCES:
patent: 4771192 (1988-09-01), Jackson
patent: 5301016 (1994-04-01), Gehrmann
patent: 5347622 (1994-09-01), Takemoto et al.
patent: 5355174 (1994-10-01), Mishima
patent: 5408272 (1995-04-01), Barnett et al.
patent: 5455633 (1995-10-01), Gehrmann
patent
Autodesk Canada Inc.
Brier Jeffery
Gates & Cooper LLP
LandOfFree
Method and apparatus for processing image data to produce... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for processing image data to produce..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for processing image data to produce... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2885612