Image analysis – Image enhancement or restoration
Reexamination Certificate
2000-08-30
2004-09-07
Ahmed, Samir (Department: 2623)
Image analysis
Image enhancement or restoration
C382S260000
Reexamination Certificate
active
06788822
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a method for correcting lightness of an image, which provides a desired, optimum dynamic range to a digital still color picture that has been captured by a digital camera, a monitoring camera, etc.
2. Description of the Related Art
As a method for correcting lightness information, color information, etc., of a digital still color image, a retinex method taking a retina of an eyeball as a model is proposed, in which a lightness value of an image with a biased dynamic range (dynamic characteristic) is corrected based on local information of the image. In such a retinex method, the quality of an image can be improved by correcting a low lightness value resulting in a darker portion in the image to a high lightness value, and a high lightness value resulting in a brighter portion in the image to a low lightness value.
As examples of such a retinex method, the single scale retinex method (Daniel J, Jobson, et al., “Properties and Performance of a Center/Surround Retinex,” IEEE Trans. on Image Processing vol.6, pp.451-462, March 1997) and the multiscale retinex method (Daniel J, Jobson, et al., “A Multiscale Retinex for Bridging the Gap Between Color Image and the Human Observation of Scenes,” IEEE Trans. on Image Processing vol.6, pp.956-976, July 1997) are proposed.
In the single scale retinex method, a spectrum component I
i
(x,y) (i=1, 2, . . . ) of a subject pixel I(x,y) in an original image is corrected by a surround function F(x,y) obtained from image information of the surround pixels. The result R
i
of retinex processing is represented by expression (1):
R
i
=log(
I
i
(
x,y
))−log[
F
(
x,y
)*
I
i
(
x,y
)] . . . (1)
where “*” denotes a convolution operator.
In this case, the surround function F(x,y) is a function which is based on the image information of the surround pixels with respect to the subject pixel I(x,y), which is represented by expression (2):
F
(
x,y
)=
Ke
−r
2
/c
2
. . . (2)
where r denotes a distance (r
2
=X
2
+y
2
) between the subject pixel and the surround pixel, and c is a scaling variable. Furthermore, K is a scalar coefficient, which is set so that ∫∫F(x,y)dxdy=1 is satisfied, i.e., the total value of the surround function is 1.
After the result R
i
(x,y) of the single scale retinex processing has been obtained, the result R
i
(x,y) is corrected with a gain correction value Ag and an offset correction value Ao, and extended to conform to an appropriate dynamic range. A result of the correction retinex processing, I
Ri
, is represented by expression (3):
I
R
i
=Ag×R
i
+Ao
. . . (3)
As described above, in the single scale retinex method, the spectrum band components of the subject pixel are retinex-processed based on the surround function. On the other hand, in the color restoration multiscale retinex (MSR) method, each of the spectrum band components, I
i
, of the subject pixel is retinex-processed by N types of scales. In this case, the result of the single retinex process for each of the N scales is multiplied by a weighting factor &ohgr;
n
, and the multiscale results with respect to all the scales are totaled. The result of the multiscale retinex (MSR) processing, R
MSRi
, is represented by expression (4):
R
MSR
i
=
∑
n
=
1
N
ω
n
R
n
i
(
4
)
The result of the MSR processing, RMSRi, which has been obtained by expression (4), is then corrected with a color correction coefficient Ci(x,y) that is represented by expression (5):
C
i
(
x
,
y
)
=
β
{
log
[
αI
i
(
x
,
y
)
]
-
log
[
∑
i
=
1
S
I
i
(
x
,
y
)
]
}
(
5
)
The result of the MSR processing, R
MSRi
, obtained by expression (4) is corrected by the color correction coefficient Ci(x,y) of expression (5), thereby obtaining the result of the color correction multiscale retinex processing, R
MSRCRi
(x,y), as shown in expression (6):
R
MSRCR
i
(
x,y
)=C
I
(
x,y
)·
R
MSR
i
(
x,y
) . . . (6)
The result of the color correction multiscale retinex processing,
RMSRCRi
(x,y), is corrected, as described as to the single scale retinex method, with the gain correction value Ag and the offset correction value Ao which are correction parameters, and extended to conform to an appropriate dynamic range. A result of the final color correction multiscale retinex processing, I
MSRCRi
, is represented by expression (7):
I
MSRCR
i
=Ag×R
MSRCR
i
+Ao
. . . (7)
In the color correction multiscale retinex method, an original image is generally single scale retinex processed with respect to three scales (small, medium, and large scales), whereby corrected images corresponding to the respective scales are obtained. These corrected images are synthesized to obtain an image with corrected lightness and color. In the small scale, a distance between a subject pixel and a surround pixel (the radius of the small scale) is relatively short, whereas in the large scale, a distance between a subject pixel and a surround pixel (the radius of the large scale) is relatively long. In the medium scale, a distance between the subject pixel and a surround pixel (the radius of the medium scale) is set to a length intermediate between that of the small scale and that of the large scale.
In each of the small, medium, and large scales, the scale size thereof is fixed, and is not an appropriate size for making a desirable correction. Accordingly, a correction result widely varies in accordance with the size or color of an original image to be corrected, whereby a sufficient correction effect may not be obtained. Especially in the case where the size of an image is large, if the scale size of the small scale is fixed at a small size, a noise may be generated in a corrected image.
Furthermore, the correction parameters shown in expression (7), i.e., the gain correction value Ag and the offset correction value Ao, are fixed values. With such parameters, in some images, the lightness of pixels may not be corrected so as to conform to an appropriate dynamic range.
Thus, with the conventional color correction multiscale retinex method, sufficient flexibility in correcting images cannot be obtained, and some images may not be corrected appropriately. Therefore, the conventional color correction multiscale retinex method is less than satisfactory as a method for correcting the lightness of images.
SUMMARY OF THE INVENTION
According to one aspect of the present invention, the method for correcting lightness of an image includes the steps of: calculating a first scale and a second scale based on an image scale of an original image from image information of the original image; multiscale retinex processing the original image with respect to the first scale and the second scale; and synthesizing a result of the multiscale retinex processing with the image information of the original image.
In one embodiment of the present invention, the method for correcting lightness of an image further includes the step of correcting the result of the multiscale retinex processing based on a gain correction value and an offset correction value.
In another embodiment of the present invention, the offset correction value is corrected based on a histogram of a lightness value against the number of pixels of the original image.
In still another embodiment of the present invention, the first scale is a small scale, and the second scale is a large scale.
In still another embodiment of the present invention, a radius of the large scale is about ½ of a longer side of the original image.
In still another embodiment of the present invention, a radius of the small scale is about ⅕ of a longer side of the original image.
According to another aspect of the present invention, the image processing device includes: a scale size calculating section for calculating a first scale and a second scale based on an image
Kubo Noboru
Niwa Akimasa
Okuhata Hiroyuki
Zhang Xiaomang
Ahmed Samir
Bali Vikkram
Sharp Kabushiki Kaisha
LandOfFree
Method and device for correcting lightness of image does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and device for correcting lightness of image, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and device for correcting lightness of image will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3203735