Image analysis – Image transformation or preprocessing – Combining image portions
Reexamination Certificate
1996-09-30
2004-03-30
Couso, Yon J. (Department: 2623)
Image analysis
Image transformation or preprocessing
Combining image portions
C382S294000
Reexamination Certificate
active
06714689
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to an image synthesizing method of synthesizing a plurality of images each including a duplicate image area to form a single synthesized image.
2. Related Background Art
As a method of synthesizing a plurality of images to form an image having a wide angle of view, a method is known by which two images are synthesized by designating matching points in overlapping area of the two images and putting one matching point over the other. With this method, the matching points of the two images are required to be designated by a mouse or the like and this operation is cumbersome.
Extracting matching points may be executed automatically by template matching or the like to detect the positional relationship between two images and synthesize them.
Such conventional techniques, however, are associated with the following problems because a synthesizing process for two images is required to be executed a plurality of times if a panorama image of 360 degrees is to be formed by synthesizing images taken with an ordinary taking lens or if a large image with a high resolution is to be synthesized.
For example, in synthesizing four images, first a synthesized image of first and second images is formed, and then another synthesized image is formed from third and fourth images. The two synthesized images are synthesized to form a final synthesized image of the four images.
In this case, image data is required to be synthesized after the positional relationships between the first and second images, between the third and fourth images, and between the two synthesized images, are detected.
It is not so difficult to synthesize four images if the positional relationships between all images are known in advance. However, since a synthesizing process for two images is performed a plurality of times to synthesize image data, the process efficiency is poor.
If the matching points are automatically extracted by template matching or the like to detect the positional relationship between two images, two images are required to be designated at each of a plurality of synthesizing processes for two images. Therefore, even if the matching points are not required to be manually designated, the operation is cumbersome.
As a method of synthesizing a plurality of images to form an image having a wide angle of view, a method is known by which two images are synthesized by subjecting the two images to geometric conversion such as affine transformation so as to make the two same points in the duplicate areas of the two images coincide with each other.
With this conventional technique, however, it is necessary to recognize the duplicate areas of two images and extract the same two points (hereinafter called matching points) from the duplicate areas. This operation may be performed by displaying two images to be synthesized on a display screen and designating the matching points in the two images with a mouse or the like. With this method, however, the matching points are required to be manually designated so that the operation is not simple and some skill is necessary.
Template matching is a method of automatically extracting the matching points from two images. With this method, one image is divided into small areas and each area is compared with the other image to detect the matching points which are images most analogous to each other.
With this template matching, if the duplicate areas of two images to be synthesized are not designated in advance, erroneous matching points may be extracted in some cases from the areas other than the duplicate areas of the two images. Therefore, an extraction precision of matching points is lowered. With a lowered extraction precision of matching points, two images cannot be synthesized correctly.
Also with this template matching, if a broad duplicate area of one image is designated as a search area of a matching point and this broad duplicate area contains many analogous areas, it takes a long time to extract the matching points from the designated two duplicate areas, and therefore the two images cannot be synthesized quickly.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide an image synthesizing method capable of solving the above problems.
It is another object of the present invention to provide an image synthesizing method capable of efficiently synthesizing three or more images with simple operations.
Under the above objects, according to one embodiment of the present invention, an image synthesizing method for synthesizing a plurality of images partially overlapping with each other is provided which comprises the steps of: inputting a plurality of image data each corresponding to a plurality of image, extracting a matching point of duplicate areas of desired two images partially overlapping with each other among a plurality of images represented by the plurality of input image data, and sequentially detecting a position relationship between two images in accordance with the extracted matching point; detecting the position relationships of all images in accordance with the position relationship between two images sequentially detected by the position relationship detecting step; and synthesizing the images represented by the plurality of input image data in accordance with the position relationships of all images detected by the all image position relationship detecting step to form a synthesized image.
It is another object of the present invention to provide an image synthesizing method capable of synthesizing three or more images and forming a synthesized image having a good image quality at a desired image area, with simple operations.
Under the above objects, according to one embodiment of the present invention, an image synthesizing method for synthesizing a plurality of images partially overlapping with each other is provide which comprises the steps of: inputting a plurality of image data each corresponding to a plurality of images and arranging the plurality of images of the plurality of input image data in a display area; extracting a matching point of duplicate areas of desired two images partially overlapping with each other among a plurality of images arranged at the arranging step and sequentially detecting a position relationship between two images in accordance with the extracted matching point; forming a data list of an order of detecting the position relationship, an image associated with the matching point, and a position of the image associated with the matching point in the display area, in accordance with the position relationship between two images in the display area sequentially detected by the position relationship detecting step; detecting the position relationships of all images from the position relationship between two images sequentially detected, in accordance with the data list formed by the data list forming step; and synthesizing the images of the plurality of input image data in accordance with the position relationships of all images detected by the all image position relationship detecting step to form a synthesized image.
It is another object of the present invention to provide an image synthesizing method capable of automatically and precisely synthesizing a plurality of images without complicated operations.
Under the above objects, according to one embodiment of the present invention, an image synthesizing method for synthesizing a plurality of images partially overlapping with each other is provided which comprises the steps of: inputting a plurality of image data each corresponding to a plurality of images, stepwise reducing the plurality of images of the plurality of input image data at different reduction factors and generating a plurality of reduced image data of the reduced images; stepwise extracting a matching point of images of the reduced image data generated by the reduced image data generating step and sequentially from the reduced image data of a reduced image having a largest reduction factor to equal-size image d
Hatori Kenji
Katayama Tatsushi
Takiguchi Hideo
Yano Koutaro
Canon Kabushiki Kaisha
Couso Yon J.
Fitzpatrick ,Cella, Harper & Scinto
LandOfFree
Image synthesizing method does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image synthesizing method, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image synthesizing method will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3187783