Television – Special applications – Observation of or from a specific location
Reexamination Certificate
1999-01-28
2004-05-04
Christensen, Andrew (Department: 2615)
Television
Special applications
Observation of or from a specific location
C348S149000
Reexamination Certificate
active
06731332
ABSTRACT:
FIELD OF THE INVENTION
The present invention relates to an image processing apparatus, which is carried on a movable body such as a vehicle or the like, for detecting or measuring a situation or the like around the movable body.
DESCRIPTION OF THE PRIOR ART
In recent years, there prevails an image processing apparatus for detecting a feature or situation of an object to be observed. Specifically, for example, an image processing apparatus has been generally known, which is carried on a vehicle, for processing images obtained by photographing a scene outside of the vehicle so as to obtain various information which is useful for driving or moving the vehicle (Hereinafter, the apparatus may be referred to “on-vehicle image processing apparatus”.). In the on-vehicle image processing apparatus described above, images, which continuously change wholly as the vehicle moves, are processed so that various feature information, such as a situation of the road and affairs around the road or motion of other vehicles, is extracted.
Further, generally among the image processing apparatus in which any feature portion in the images is extracted, particularly in the image processing apparatus in which the motion of a specified feature portion of the images is also extracted, the motion of the feature portion is extracted by motion compensation of MPEG (Moving Picture Expert Group), for example. Hereupon, the “motion compensation” means such an image processing procedure that divides each of the frames of the photographed images into a plurality of blocks, detects that a specified block (i.e. motion compensation block) including a feature portion in a certain frame is similar to another block in the preceding frame according to a value of correlation in a defined search area. Further, the motion of the feature portion among the frames is detected by detecting displacement of the center of gravity of the block in the search area (For example, see the magazine of “Electronics”, March, 1996.).
Further, a specific example of a, conventional image processing apparatus for detecting motion of a movable body is disclosed, for example, in the Japanese Laid-open Patent Publication No. 6-337938.
As shown in
FIG. 16
, the image processing apparatus disclosed in the Japanese Laid-open Patent Publication No. 6-337938 is provided with (a) image input means for inputting images including objects and their background, (b) background image extracting means for holding and outputting the background, (c) first average background extracting means for extracting the images including stationary objects, moving objects which are moving below the first velocity, and the background, (d) second average background extracting means for extracting the images including stationary objects, moving objects which are moving below the second velocity, and the background, (e) first difference processing means for seeking the difference between the output of the background image extracting means and the output of the first average background extracting means so as to generate velocity images on the basis of the difference, (f) second difference processing means for seeking the difference between the outputs of the both average background extracting means so as to generate velocity images on the basis of the difference, (g) third difference processing means for seeking the difference between the output of the image input means and the output of the second average background extracting means so as to generate velocity images on the basis of the difference.
However, in the conventional image processing apparatus utilizing the motion compensation of the MPEG described above, there is such a problem that although is is possible to detect the motion of the moving object within the block obtained by dividing the frame, it is impossible to extract the moving object from all the images.
Meanwhile, in the conventional image processing apparatus disclosed in the Japanese Laid-open Patent Publication No. 6-337938, there is such a problem that although it is possible to extract the moving object when the background is fixed, it is impossible to extract the moving object when the background changes as in the case of a on-vehicle image processing apparatus. That is, in the case that the conventional image processing apparatus is carried on the vehicle, because the shape of the background images in front of the vehicle continuously changes, it is impossible to exactly extract the motion of the background so that it is impossible to extract an obstruction or the like which is approaching the present vehicle, for example.
Moreover, in the conventional on-vehicle image processing apparatus in which the background images continuously change, there is such a problem that because it is required to process a huge amount of image data, the construction of the image processing apparatus is large-sized or complicated.
SUMMARY OF THE INVENTION
The present invention has been developed to solve the conventional problems described above, and has an object of providing an image processing apparatus of simple construction carried on a movable body such as a vehicle, which can extract the moving object or the like from the images over the whole images, even if the background continuously changes.
According to a first aspect of the present invention which is achieved to solve the above-mentioned problems, there is provided (i) an image processing apparatus carried on a movable body (apparatus which can move, for example, vehicle such as automobile etc.), which includes (ii) an image pick-up means for continuously photographing a scene (for example, road and its circumstance etc.) outside of the movable body to continuously form an image (pick-up image) corresponding to the scene, (iii) a feature extracting means for processing the image formed by the image pick-up means to continuously extract a predetermined feature (feature information) in the scene (iv) a transmitting means for transmitting the feature extracted by the feature extracting means to an external device, and (v) a recording means for recording therein the feature extracted by the feature extracting means.
According to the image processing apparatus, even if the background scene continuously changes, the feature information such as a moving object can be extracted from all the images. Moreover, because the extracted feature information can be transmitted to the outer device and recorded, the feature information can be utilized for driving or moving the movable body.
In the image processing apparatus according to the first aspect of the present invention, it is preferable that the apparatus further includes (vi) a feature estimating means for estimating a feature which is to be subsequently extracted by the feature extracting means on the previously extracted feature which has been extracted by the feature extracting means or the feature being recorded in the recording means, (vii) wherein the feature extracting means estimates the next feature on the basis of the feature estimated by the feature estimating means.
In this case, because the synopsis of the next feature can be grasped based on the estimated feature, the next feature may be easily extracted so that the time required for extracting the feature may be reduced. Moreover, the data volume of the image processing apparatus may be small.
According to the second aspect of the present invention, there is provided (i) an image processing apparatus carried on a movable body, which includes (ii) an image pick-up means for continuously photographing a scene outside of the movable body to continuously form an image corresponding to the scene (iii) a feature extracting means for processing the image formed by the image pick-up means to continuously extract a predetermined feature in the scene (iv) an intermittent image getting means for intermittently getting a stationary image at a predetermined periodic interval from the image formed by the image pick-up means (v) a synthesizing means for synthesizing the feature extracted in the periodic interval b
Iisaka Atsushi
Nomura Noboru
Yasui Nobuhiko
Christensen Andrew
Matsushita Electric - Industrial Co., Ltd.
Wenderoth , Lind & Ponack, L.L.P.
Wisdahl Eric
LandOfFree
Image processing apparatus does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image processing apparatus, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image processing apparatus will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3243158