Image analysis – Applications – 3-d or stereo imaging analysis
Reexamination Certificate
2000-08-29
2003-10-14
Ahmed, Samir (Department: 2623)
Image analysis
Applications
3-d or stereo imaging analysis
Reexamination Certificate
active
06633665
ABSTRACT:
TECHNICAL FIELD
The present invention relates to a method for transforming a 3D object point into a 2D image point using linear pushbroom sensors, more particularly to the transformation method for rectification of linear pushbroom images so that the images can be geometrically referenced and for generation of 3D geometric information from linear pushbroom images.
Herein, the terms ‘2D’ and ‘3D’ mean ‘2-dimensional’ and ‘3-dimensional’, respectively, unless otherwise specified
BACKGROUND OF THE INVENTION
Linear pushbroom images are the images taken by sensors in motion during imaging and which have a focal point per line or per part according to sensors' scanning mechanism. The sensors taking images in the manner are referred to as linear pushbroom sensors. Herein, the term ‘sensor’ means ‘linear pushbroom sensor’ unless otherwise specified. In comparison with linear pushbroom images, perspective images are the images that have a single focal point per image.
For perspective images, the problem of mapping 3D object point onto 2-dimentional image point is well developed and being widely used. For linear pushbroom images, however, a robust numerical solution for the problem has not been discovered.
A previously proposed solution for the problem is based on the Newton-Raphson method. However, the Newton-Raphson method works only within the region where the equation to be solved varies monotonically and hence it is very sensitive to the initial value. In some cases, this method ends up to diverse or create large errors. Although this method may work in others, it is not so easy to choose appropriate initial values. Therefore, the solution cannot be applied to rectification or generation of 3D information of linear pushbroom images.
SUMMARY OF THE INVENTION
In order to eliminate the difficulties of previous approaches, this invention proposes a new powerful and robust method to transform a 3D object point onto a 2D image point for linear pushbroom images.
In order to achieve the goal, this invention proposes a method for transforming an object point in a 3D coordinate system into an image point on a linear pushbroom image captured by a linear pushbroom sensor and represented in a 2D coordinate system. The method comprises steps for: setting collinearity equations in relation with the object point and the image point for the linear pushbroom image; assuming an initial coordinate on a first coordinate axis in the 2D coordinate system and calculating the attitude of the linear pushbroom sensor using the initial coordinate; obtaining a temporary coordinate by solving the collinearity equation, while assuming that the linear pushbroom sensor keeps a constant attitude as calculated; calculating a differential between the initial coordinate and the temporary coordinate; comparing the differential with a given threshold; repeating the attitude calculation step through the differential comparison step after considering the temporary coordinate as the initial coordinate if the differential exceeds the given threshold; deciding on the temporary coordinate to be a final coordinate on the first coordinate axis if the differential does not exceed the given threshold; and obtaining a coordinate on a second coordinate axis in the 2D coordinate system by solving the collinearity equations using the final coordinate on the first coordinate axis.
Preferably, the collinearity equations are set on, as follows;
0
=
-
f
r
11
(
X
-
X
S
)
+
r
21
(
Y
-
Y
S
)
+
r
31
(
Z
-
Z
S
)
r
13
(
X
-
X
S
)
+
r
23
(
Y
-
Y
S
)
+
r
33
(
Z
-
Z
S
)
y
=
-
f
r
12
(
X
-
X
S
)
+
r
22
(
Y
-
Y
S
)
+
r
32
(
Z
-
Z
S
)
r
13
(
X
-
X
S
)
+
r
23
(
Y
-
Y
S
)
+
r
33
(
Z
-
Z
S
)
in which, X, Y and Z mean a coordinate of an object point, respectively; X
S
, Y
S
and Z
S
mean a coordinate of the sensor upon capturing an image of the object, respectively; r
11
through r
33
mean an element of a rotation matrix R determined by the sensor attitude upon capturing an image of the object, respectively; ƒ means the focal length of the camera; and x and y mean a coordinate of an image point, respectively.
It is also preferred that the temporary coordinate obtainment step comprises sub-steps for: calculating elements of the rotation matrix R using the attitude of the linear pushbroom sensor; and solving the collinearity equation using the elements of the rotation matrix R.
According to the present invention, there is also provided a machine-readable medium on which a program is recorded, wherein the program conducts to transform an object point in a 3D coordinate system into an image point on a linear pushbroom image captured by a linear pushbroom sensor and represented in a 2D coordinate system by taking steps for: setting collinearity equations in relation with the object point and the image point for the linear pushbroom image; assuming an initial coordinate on a first coordinate axis in the 2D coordinate system and calculating the attitude of the linear pushbroom sensor using the initial coordinate; obtaining a temporary coordinate by solving the collinearity equation, while assuming that the linear pushbroom sensor keeps a constant attitude as calculated; calculating a differential between the initial coordinate and the temporary coordinate; comparing the differential with a given threshold; repeating the attitude calculation step through the differential comparison step after considering the temporary coordinate as the initial coordinate if the differential exceeds the given threshold; deciding on the temporary coordinate to be a final coordinate on the first coordinate axis if the differential does not exceed the given threshold; and obtaining a coordinate on a second coordinate axis in the 2D coordinate system by solving the collinearity equations using the final coordinate on the first coordinate axis.
REFERENCES:
patent: 6028606 (2000-02-01), Kolb et al.
patent: 6556195 (2003-04-01), Totsuka et al.
Kim Tae Jung
Kim Tag Gon
Shin Dong Seok
Ahmed Samir
Akin Gump Strauss Hauer & Feld L.L.P.
Bali Vikkram
Korea Advanced Institute of Science and Technology
LandOfFree
Transformation method of three-dimensional object points... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Transformation method of three-dimensional object points..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Transformation method of three-dimensional object points... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3157811