Image analysis – Color image processing – Drop-out color in image
Reexamination Certificate
1998-02-24
2002-01-29
Couso, Yon J. (Department: 2623)
Image analysis
Color image processing
Drop-out color in image
C382S167000
Reexamination Certificate
active
06343146
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates to an image signal processor and an image input processor.
Recently, image input processors have widely been marketed using inexpensive, light-weight single CCD chips. In such an image input processor, color filters are arranged in a mosaic pattern on a light-sensitive area to acquire color information of an object from a single image pickup element.
Such color filters are illustrated, for example, in
FIG. 19
where an array of complementary color mosaic filters including cyan (Cy), magenta (Mg), yellow (Ye), and green (G). It is assumed in
FIG. 19
that the luminance signals and the chrominance signals corresponding to the n-th line and the (n+1)th line of an even-numbered field are Y
o,n
, Y
o,n+1
and C
o,n
, C
o,n+1
, and the luminance signals and the chrominance signals corresponding to the n-th line and the (n+1)th line of an odd-numbered field are Y
e,n
, Y
e,n+1
and C
e,n
, C
e,n+1
. Those signals are expressed by:
Y
o,n
=Y
o,n+1
=Y
e,n
=Y
e,n+1
=2R+3G+2B (1)
C
o,n
=C
e,n
=2R−G (2)
C
o,n+1
=C
e,n+1
=2B−G (3)
Also, Cy, Mg, and Ye are expressed using three primary colors; green (G), red (R), and blue (B), by:
Cy=G+B (4)
Mg=R+B (5)
Ye=R+G (6)
As apparent from Equation (1), the luminance signals are generated from all the lines of both even- and odd-numbered fields. On the other hand, the chrominance signals defined by Equations (2) and (3) are generated from every alternate line while signals of dropout lines are compensated by linear interpolation. Then, proper matrix operation produces three primary color, R, G, and B, signals. This method is however disadvantageous in that the chrominance signals carry ½ of information as compared with the luminance signals and severe artifacts such as color moiré may appear on the edge. It is known for attenuating such moiré effects to provide a low pass filter with a crystal filter, in front of the image pickup element. The low pass filter may however decline the resolution.
As compared with simple interpolation with the chrominance signal, methods of correcting the chrominance signal with components of the luminance signal are disclosed in U.S. Pat. No. 5,032,910 and Jpn. Pat. KOKAI Publication No. 5-056446.
In U.S. Pat. No. 5,032,910, while the luminance signal Y is generated by the linear interpolation, the chrominance signal C is treated differently according to the variation of the signal Y. In the region where the luminance signal Y is less varied, the chrominance signal C is compensated by the linear interpolation, while in the region where the luminance signals is largely varied, the chrominance signal C′ is restored by modifying the signal Y of that region in the following way:
C′=aY+b (7)
where a and b are constants.
In No. 5-056446, while the luminance signal Y is generated by interpolation, the dropouts of chrominance signal C′ are restored by subjecting both the luminance signal Y and the chrominance signal C to electrical lowpass filtering to have their low frequency components Y
low
and C
low
which are then used in Equation (8).
C
′
=
Y
C
low
Y
low
(
8
)
The chrominance C′ is equivalent to a modified luminance signal Y using the low frequency components Y
low
and C
low
.
However, firstly, the conventional method using the single CCD chip includes linear interpolation for the luminance signal and a combination of linear interpolation and luminance signal modification for the chrominance signal, thus causing the luminance signal to carry substantially ½ of information as compared with using a three CCD imaging system. Accordingly, dropouts from the chrominance signal will hardly be restored at high definition and speed.
Secondly, the conventional method restores the chrominance signal based on the luminance signal, hence requiring a more number of luminance filters than that of chrominance filters and failing to work with an arrangement of the filters at an equal ratio.
Thirdly, the conventional method includes linear interpolation for the luminance signal and a combination of interpolation and luminance signal modification for the chrominance signal. When a certain inexpensive type of optical lens system which may produce chromatic aberration and deteriorate a particular signal component is used, the method will hardly restore dropouts of the chrominance signal at high definition.
BRIEF SUMMARY OF THE INVENTION
It is thus a first object of the present invention to provide an image signal processor capable of restoring dropouts of the color signal at high fidelity according to a structural model of image.
It is a second object of the present invention to provide an image signal processor capable of restoring dropouts of the color signal with high fidelity and high speed according to a structural model of image.
It is a third object of the present invention to provide an image signal processor capable of restoring dropouts of the color signal with high fidelity when the rate of the dropout of the color signal is same among different colors.
It is a fourth object of the present invention to provide an image signal processor capable of restoring dropouts of the color signal with high fidelity by repeatedly using a structural model of image.
It is a fifth object of the present invention to provide an image signal processor capable of restoring dropouts of the color signal which is generated by employing a certain inexpensive optical lens system with high fidelity by smoothing a structural model of image in accordance with the chromatic aberration.
According to a first feature for achievement of the first object of the present invention, an image signal processor for processing an image signal where each pixel is composed of more than one color signals and at least one of the color signals are dropped out according to the location of the pixel, comprises: an extracting unit for extracting from the image signal the color signals of a local area of a predetermined size which includes a desired pixel; a reference image generating unit for modifying and combining the color signals of the local area extracted by the extracting unit on the basis of a structure model and an evaluation function to generate a reference image; and a restoring unit for restoring the dropout color signal in accordance with the reference image generated by the reference image generating unit.
As a second feature for achievement of the second object of the present invention, an image signal processor for processing an image signal where each pixel is composed of more than one color signals and at least one of the color signals are dropped out according to the location of the pixel, comprises: an extracting unit for extracting from the image signal the color signals of a local area of a predetermined size which includes a desired pixel; a color signal selecting unit for calculating parameters from each of the color signals of the local area extracted by the extracting unit and selecting one of the color signals according to the parameters; a modifying unit for modifying the shape of the other color signals than the selected color signal so that their parameters are equal to the parameters of the selected color signal; a candidate image generating unit for combining the modified color signals modified by the modifying unit and the selected color signal selected by the color signal selecting unit to generate reference image candidates; a reference image selecting unit for selecting as a reference image one of the reference image candidates generated by the candidate image generating unit in accordance with a given evaluation function; and a restoring unit for restoring the dropout color signal with the use of the reference image determined by the reference image selecting unit.
As a third feature f
Tsukioka Taketo
Tsuruoka Takao
Couso Yon J.
Frishauf, Holtz, Goodman, Langer & Chick, PC
Olympus Optical Co,. Ltd.
LandOfFree
Image signal processor apparatus for restoring color signals... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image signal processor apparatus for restoring color signals..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image signal processor apparatus for restoring color signals... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2843440