Interpolation device, process and recording medium on which...

Details Interpolation device, process and recording medium on which... Interpolation device, process and recording medium on which...

1998-09-24

2003-05-13

Garber, Wendy R. (Department: 2712)

Television

Camera, system and detail

With single image scanning device supplying plural color...

C348S280000, C358S525000, C382S300000

Reexamination Certificate

active

06563538

ABSTRACT:

INCORPORATION BY REFERENCE
The disclosures of the following priority applications are herein incorporated by reference: Japanese Patent Application No. 9-261359, filed Sep. 26, 1997 and Japanese Patent Application No. 9-293912, filed Oct. 27, 1997.
BACKGROUND OF THE INVENTION
1. Field of Invention
The present invention relates to an interpolation device and process that perform interpolation of an image in which grid points that output a predetermined color and empty grid points that do not output the color are arrayed in a checkered configuration, and to a recording medium in which an interpolation processing program for use with such an image is recorded.
2. Description of Related Art
There are electronic cameras that use a single imaging element to produce an image signal of a color image. An imaging element like this, for example, as shown in
FIG. 16A
, is structured with color filters of the three colors of RGB (red color, green color, blue color) arranged in a Bayer array.
Referring to the green color (G), it can be said that the imaging element is structured as an array having some grid points, which are pixels that output green color as shown in
FIG. 16B
, and other empty grid points, which are pixels that do not output green color. These grid points are arrayed in a checkered configuration.
Furthermore, when using a color filter having a structure in which two imaging elements comprising only green color (G) as shown in
FIG. 17A
are shifted relative to each other, as shown in
FIG. 17B
, it can be said that imaginary empty grid points that do not output green color, and grid points that output green color are structured so as to be arrayed in a checkered configuration.
Furthermore, when using a two-plate-type of color filter, one imaging element is formed by G only, and the other imaging element is structured such that pixels that output red color and pixels that output blue color are arrayed in a checkered configuration. That is, the pixels that output blue color become empty grid points with respect to red color, and the pixels that output red color become empty grid points with respect to blue color.
Conventionally, in methods that perform interpolation of the color image that corresponds to the image signals formed by such imaging elements, the average value of the image (pixel) output of the grid points adjacent to empty grid points is used as the pixel output (interpolation amount) of the empty grid points.
U.S. Pat. No. 5,373,322 discloses a process that estimates the directionality of the image output of the empty grid points by using chrominance gradients as a technique for interpolating parts of an image, such as edges, having a spatially strong directivity.
FIG. 18
illustrates a conventional interpolation process disclosed in U.S. Pat. No. 5,373,322. In
FIG. 18
, G
11
, G
13
, . . . , G
66
, and so forth, show the pixel output of green color (G), R
12
, R
14
, . . . , R
56
, and so forth, show the pixel output of red color (R), and B
21
, B
23
, . . . , B
67
, and so forth, show the pixel output of blue color (B). In U.S. Pat. No. 5,373,322, as described above, when the interpolation amount G
34
of green color of the pixel that outputs R
34
is calculated, the information HDiff related to the chrominance gradients in the horizontal direction is obtained as
H
Diff=|((
R
32
+
R
36
)/2)−
R
34
|
and the information VDiff related to the chrominance gradients in the vertical direction is obtained as
V
Diff=|((
R
14
+
R
54
)/2)−
R
34
|.
The calculation method of G
34
varies from case to case, based upon the relationship between HDiff and VDiff, which were thus obtained. That is, in the case of HDiff<VDiff (when the correlation in the horizontal direction is strong), G
34
is obtained by
G
34
=(
G
33
+
G
35
)/2
and in the case of VDiff<HDiff (when the correlation in the vertical direction is strong), G
34
is obtained by
G
34
=(
G
24
+
G
44
)/2
and in the case of HDiff=VDiff, G
34
is obtained by
G
34
=(
G
24
+
G
44
+
G
33
+
G
35
)/4.
That is, the information related to the chrominance gradients of green color is estimated in this prior art technique based upon the pixel output of red color irrespective of the process that obtains the interpolation amount of green color.
Estimating the spatial similarity of the empty grid points in order to accurately predict the interpolation amount of the empty grid points is effective. However, the information related to the chrominance gradients of green color is estimated in the prior art based upon the pixel output of red color irrespective of the process that obtains the interpolation amount of green color. Because of this, it was not possible to accurately estimate the directivity of the pixel output of green color based upon the pixel output of red color in an image in which the chrominance gradients of green color and the chrominance gradients of red color are not constant, or in an image in which the component of red color is low, or the like.
Furthermnore, the directivity of the pixel output of the empty grid points is not always symmetrically right and left or symmetrically up and down. Because of this, for reasons similar to the prior art described above, when the information related to the chrominance gradients was obtained in only the horizontal and vertical directions, it was difficult to accurately estimate the directivity of the appropriate pixel output.
For example, when each pixel output in
FIG. 18
has the value shown in
FIG. 19
, G
34
has a strong correlation in the vertical direction (particularly in the upper direction).
U.S. Pat. No. 5,373,322 uses the following calculations:
H
Diff=|((
R
32
+
R
36
)/2)−
R
34
|
V
Diff=|((
R
14
+
R
54
)/2)−
R
34
|
In this example, HDiff=VDiff is established, and it is estimated that the correlation in the vertical and horizontal directions is the same. In such a situation, where HDiff=VDiff=0.5, it is preferable for G
34
=1 to be satisfied. However, in this situation, since HDiff=VDiff:
&AutoLeftMatch;
G34
=
(
G24
+
G44
+
G33
+
G35
)
/
4
=
0.75
That is, G
34
=0.75, rather than G
34
=1. Thus, when the interpolation is performed based upon the directivity of the pixel output as conventionally estimated, there is a possibility of damaging the clearness of the image, or destroying the image, in the worst case. Because of this, there is a possibility that the sharpness and the smoothness of the border parts can be lost.
SUMMARY OF THE INVENTION
Thus, one object of the invention is to provide an interpolation device and process that estimates the spatial directivity of empty grid points in detail, and accurately obtains the interpolation amount of the empty grid points.
Another object of the invention is to provide a recording medium on which is recorded an interpolation processing program that estimates the spatial directivity of the empty grid points in detail and that accurately obtains the interpolation amount of the empty grid points.
An interpolation device according to one aspect of the invention performs interpolation of an image having grid points that output a predetermined color and at least one empty grid point that does not output the predetermined color, the grid points being oriented in a checkered configuration, and obtains an interpolation amount that becomes a pixel output of the empty grid point. A correlation amount calculator determines a correlation between individual pixel outputs of at least two grid points adjacent to the empty grid point and pixel outputs of each one of grid points oriented in shifted positions in the four directions of upper, lower, right, and left directions, respectively, with respect to the at least two grid points, and calculates a correlation amount showing the correlation strength in each direction. A similar direction detector identifies a direction having a strong correlation amount b

Affiliated with

Also associated with

Rating

Interpolation device, process and recording medium on which... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Interpolation device, process and recording medium on which..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Interpolation device, process and recording medium on which... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3092315