Television – Camera – system and detail – Camera image stabilization
Reexamination Certificate
1999-07-22
2004-10-05
Christensen, Andrew (Department: 2615)
Television
Camera, system and detail
Camera image stabilization
C348S362000, C348S155000, C358S450000, C358S453000
Reexamination Certificate
active
06801248
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to an image pick-up device such as electronic still camera and digital camera including a solid state image sensing element, and more particularly to an image pick-up device which can produce an image signal having a wider dynamic range than that of a solid state image sensing element. The present invention also relates to a record medium having recorded thereon a computer readable program for controlling an imaging operation of the above mentioned image pick-up device.
2. Description of the Related Art
In the image pick-up device of the kind mentioned above, since the solid state image sensing element has a relatively narrow dynamic range compared with a conventional photographic film, when a subject situating on a relatively bright background is to be picked-up under such an exposure time that the subject is picked-up with a proper exposure amount, the background might be picked-up with an overexposure amount and an image signal corresponding to the background might be saturated. On the other hand, when the subject is picked-up under such an exposure time that the bright background is picked-up with a proper exposure amount, the subject might be picked-up with an underexposure amount and might become too dark. In order to increase a dynamic range of the solid state image sensing element, it has been proposed a known image pick-up device, in which an object is picked-up twice with different exposure amounts, and the thus obtained two image signals are synthesized by simply adding these image signals each other or by partially exchanging or combining these image signals in a mosaic fashion.
In the former solution in which the two image signals obtained with different exposure amounts are synthesized by simply adding them, when a subject moves or a camera moves to produce a relative positional shift between successively picked-up two image signals, S/N is decreased at a portion which is subjected to the movement and pseudo-color or pseudo-edge might be produced in a synthesized image signal.
In order to remove such a problem, in Japanese Patent Application Laid-open Publication Kokai Hei 2-280585, it has been proposed to derive a synthesized image signal in such a manner that a difference between the two image signals is derived and an absolute value of said difference is subtracted from the synthesized image signal obtained by merely adding the two image signals. However, in this case, since the image shift portion in the synthesized image signal is removed by the subtractive correction, when a subject moves, a configuration of the subject within a synthesized image might be deformed, and therefore the synthesized image has a feeling of strangeness as compared with an image formed on a conventional photographic film.
The above problem also occurs in the later solution, in which the two image signals are synthesized by combining or exchanging them in a mosaic fashion. That is to say, as shown in
FIG. 13
, when a too bright portion B (e.g. background) in a first image A picked-up with a large exposure amount is replaced by a corresponding portion D in a second image C picked-up with a small exposure amount after adjusting a gain of said portion D to derive a synthesized image E, if a subject F moves from right to left in
FIG. 13
during a time interval between successive image picking-up operations, a part of the subject F in the second image C picked-up with small exposure amount corresponding to the movement is also synthesized as a part G in the synthesized image E. Then, the subject is partially seen double, and therefore a feeling of strangeness remains.
SUMMARY OF THE INVENTION
A first object of the present invention is to provide a novel and useful image pick-up device, in which a synthesized image having a wider dynamic range than that of a solid state image sensing element can be obtained by partially combining or exchanging a plurality of images picked-up with different exposure amounts in a mosaic fashion, while said synthesized image be seen without causing a feeling of strangeness.
A second object of the invention is to provide a record medium having recorded thereon a computer readable program which is to make a computer to execute procedures for controlling the image pick-up device in such a manner that a synthesized image with a wider dynamic range than that of a solid state image sensing element can be seen without causing a feeling of strangeness.
According to the invention for attaining the above mentioned first object, an image pick-up device for producing a synthesized image signal having a wide dynamic range by partially combining a plurality of images picked-up with different exposure amounts comprises:
an image picking-up means including a solid state image sensing element and picking-up an object by a plurality of times with different exposure amounts to derive a plurality of image signals;
a memory means for storing at least a part of said plurality of image signals derived successively from said image picking-up means;
an image synthesizing means for synthesizing said plurality of image signals a part of which is read out of said memory means to derive a synthesized image signal;
a detecting means for detecting a synthetic unsuitable portion in said plurality of image signals which is not suitable for synthesizing in accordance with a comparison of the plurality of image signals;
a correcting means for correcting pixel signals of said synthetic unsuitable portion detected by said detecting means to derive a corrected pixel signal; and
a combining means for combining said corrected pixel signal from said correcting means with said synthesized image signal from said synthesizing means to derive a corrected synthesized image signal.
In the image pick-up device according to the invention, a synthetic unsuitable portion is detected on the basis of a comparison of a plurality of image signals picked-up with different exposure amounts, and the pixel signal of the thus detected synthetic unsuitable portion is corrected. Therefore, even if a subject moves on a bright background during successive image picking-up operations, it is possible to minimize any undesired synthesis due to the movement of the subject, and thus a corrected synthesized image having a wide dynamic range can be obtained without causing a feeling of strangeness upon comparing with the conventional photographic film.
In an embodiment of the image pick-up device according to the invention, said synthetic unsuitable portion detecting means is constructed such that a ratio in level between a plurality of image signals picked-up with different exposure amounts is calculated, and a synthetic unsuitable portion is detected on the basis of a comparison of said ratio with a ratio in exposure amounts with which said plurality of image signals are picked-up. In this case, a synthetic unsuitable portion can be detected by a simple comparing operation using the plurality of image signals picked-up with different exposure amounts and data from a hardware controlling an exposing operation. Therefore, a cost can be reduced and an operation time can be shortened.
In another embodiment of the image pick-up device according to the invention, said synthetic unsuitable portion detecting means is constructed such that a difference between a plurality of image signals picked-up with different exposure amounts is calculated, and a synthetic unsuitable portion is detected on the basis of said difference. Also in this case, a synthetic unsuitable portion can be detected by a simple comparing operation using the plurality of image signals taken with different exposure amounts and data from a hardware controlling an exposing operation, and therefore a cost can be reduced and an operation time can be shortened.
In an embodiment of the image pick-up device according to the invention, said synthetic unsuitable portion detecting means is constructed such that a motional vector is calculated on the basis of a comparison of the plurality o
Christensen Andrew
Olympus Corporation
Stevens Davis Miller & Mosher LLP
Wu Dorothy
LandOfFree
Image pick-up device and record medium having recorded... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image pick-up device and record medium having recorded..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image pick-up device and record medium having recorded... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3322517