Image analysis – Image transformation or preprocessing – Changing the image coordinates
Reexamination Certificate
1996-09-25
2003-04-15
Mehta, Bhavesh (Department: 2625)
Image analysis
Image transformation or preprocessing
Changing the image coordinates
C382S282000, C382S284000, C382S287000, C358S450000, C358S453000
Reexamination Certificate
active
06549681
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to an image synthesization method for synthesizing a plurality of images, in which the image areas partially overlap each other, in order to create a single synthetic image.
2. Related Background Art
The processing for the synthesization of a plurality of images that partially overlap each other, by using a computer to create a single synthetic image, is generally called panoramic image synthesization. This processing has been developed in response to a demand that it is possible to take a wide picture that constitutes a single image. When an electronic camera is compared with a silver halide camera or a scanner, the low resolution (the small number of pixels) provided by the electronic camera is pointed out as a disadvantage. For an image that is taken by an electronic camera, therefore, panoramic image synthesization is important not only as a means for acquiring a wide image, but also as a means for acquiring an image having a high resolution. Specifically, panoramic image synthesization is effectively demonstrated when a sheet of a document or a page of a magazine is divided into a plurality of segments and images of these segments are taken to acquire data at the similar lebel of a resolution as that afforded by a scanner, or when a scenic view is divided into a plurality of segments and each segment is recorded as a wide angle image at a high resolution.
In panoramic image synthesization, a process for erasing seams where segments overlap is important, and affects the quality of the resultant synthetic image. As a general method, a process for erasing the segment seams shown in
FIG. 1A
(hereinafter referred to as a “seamless process”) is performed. That is, in a location where portions of two images are overlapped, synthesization ratios are gradually changed in consonance with the positions of pixels, and the pixels are added together so that each of the two overlapped image portions constitute 50% of the pixels at the center position. When the overlapped areas are large, a seamless process having a predetermined width is performed, as is shown in FIG.
1
B.
The seamless process is effective especially for natural images, such as of scenery, and seamless images having a high quality can be provided.
The above described conventional technique has the following problems, however.
For panoramic synthesization, a method is employed by which matching points in a plurality of images to be synthesized are extracted to determine a position at which to synthesize overlapping images. At this time, an error may occur at the synthesization position. That is, since the minimum unit for which accuracy is possible when matching points are extracted is one pixel, and as accuracy can not be guaranteed if a unit that is smaller than one pixel is employed, an error occurs when a shift of less than one pixel occurs at the pixel synthesization position.
Further, when an image is recorded with an electronic camera, the portion of the image that is located at the periphery of a lens is more or less distorted. This also causes a shift of less than one pixel.
Then, as there is a sharp contrast between paper color, white, and character color, black, in an image, such as a document, in which characters are included, when a document image is synthesized and a seamless process is performed therefor, dual character images can be seen in the portion for which the seamless process has been performed, as is shown in FIG.
1
C. And as the characters are sharply contrasted with their background, the shift is easily discernable. For a natural image, however, since the contrast is less distinct than is that for a character image, and since a smooth continuation of the image lines is preferable, the seamless process is effective. Again, however, for images, such as documents, that include characters, in many cases adverse effects are obtained, as has been previously described.
As for an electronic camera, it has been pointed out that low resolution (a small number of pixels) is one of their disadvantages when compared with silver halide cameras or scanners, as is described above. Panoramic image synthesization is important for images recorded by electronic cameras not only for the acquisition of wide angle images but also for the provision of high image resolutions. More specifically, panoramic image synthesization is effective when a single sheet of a document or a page of a magazine is divided into segments and the image segments are recorded to acquire data at the similar level of a resolution as data is obtained at with a scanner, or when a scenic view is divided into segments to acquire a wide angle image at a high resolution.
For panoramic image synthesization, the most important process, and one that is difficult to accomplish, is finding a location where a plurality of images overlap. In essence, this process is one that involves a search for like points (hereinafter referred to as matching points) located in a plurality of images. The process is hereinafter referred to as a matching point extraction process. The difficulty encountered in performing the matching point extraction process (the error rate) differs, depending on the images being processed. When an overlapped image area includes a unique, characteristic shape that does not exist in other areas, a matching point can be found without any error. However, when a similar pattern exists in an image area other than the overlapped image area (e.g., characters in a document), an incorrect matching point may be extracted.
According to the conventional technique, generally, a user clearly designates a matching point, and based on the designated position, images are synthesized while slight adjustments are performed. Such a conventional example is shown in FIG.
2
. When a user selects a plurality of images to be synthesized, the window shown in
FIG. 2
is opened. The user designates matching points in two images, and provides marks
21
a
,
21
b
,
22
a
and
22
b
for these points. Patterns that are nearest the centers of a pair of the marks are examined, a matching positional relationship that applies to both of the marks is acquired, and the points specified by the marks are designated as matching points. A parameter for image synthesization is then acquired by using the matching points, and image synthesization is performed.
With the conventional example, however, the following problems are encountered.
(1) Since a user must with considerate accuracy designate matching points for two images, the user must perform a careful comparison of the two images. This imposes a heavy load on the user.
(2) Two matching points are required for image synthesization, and more or less than two points can not be designated. Although only one point is required when an image is shifted only horizontally or vertically, one-point designation is not possible.
(3) Although images can be synthesized more accurately by designating three or more points, this is not possible.
(4) Since the synthesization process is only begun after matching points are designated by a user, to the user the processing period seems overly long.
FIGS. 3A through 3C
are diagrams illustrating conventional panoramic image synthesization. In
FIGS. 3A and 3B
, overlapping portions for two images
201
and
202
are identified, and while the overlapping portions of the images are held in alignment, the images are synthesized to acquire a panoramic image
203
.
With such panoramic image processing, however, the following problems are encountered.
When an image, such as the panoramic image
203
in
FIG. 3B
, that is obtained by synthesizing a plurality of images does not have a rectangular shape, the resultant image must be converted into a rectangular shape and into a data form that can be handled by a computer. Therefore, a means is provided for describing a rectangle
204
that encompasses the panoramic image
203
, and for filling with a desired color or pattern an area (dummy)
205
, of the rectangle
204
Hatanaka Koji
Hatori Kenji
Katayama Tatsushi
Takahashi Fumiaki
Takiguchi Hideo
Kassa Yosef
Mehta Bhavesh
LandOfFree
Image synthesization method does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image synthesization method, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image synthesization method will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3038065