Computer graphics processing and selective visual display system – Computer graphics processing – Three-dimension
Reexamination Certificate
1999-06-19
2003-09-02
Zimmerman, Mark (Department: 2671)
Computer graphics processing and selective visual display system
Computer graphics processing
Three-dimension
C382S154000, C382S107000
Reexamination Certificate
active
06614429
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention.
The present invention relates in general to object modeling, and in particular to a system and method for determining structure and motion from two-dimensional (2D) images for multi-resolution object modeling.
2. Related Art.
In the computer vision field, it is very desirable to determine motion and structure from 2D images. One of the first methods to determine motion and structure and solve this problem involved assuming an orthographic camera projection model. Three views were necessary to recover the motion and structure from point correspondences with this method. A full perspective projection model was used, and thus two views were sufficient from point correspondences. After this method was introduced, other approaches have been proposed to solve the problem using either linear or nonlinear methods.
Recently, the use of uncalibrated images has been used. The main motivation to use linear projection models is in order to avoid the non-linearity of perspective projection and the numerical instabilities incurred during structure from motion (SFM) analysis that arise due to this non-linearity. When the field of view subtended by the object/scene of interest is small, the errors due to the linear approximation can be negligible. Thus, the approximation errors (potentially negligible) are traded off against the numerical instabilities (potentially severe for narrow field-of-view).
Although both full perspective and its linear approximation (affine, weak perspective and orthographic projection models) are used in structure from motion, currently they are only used separately. In other words, images are assumed to be obtained under. the same projection model. Therefore, what is needed is an efficient system and method for determining structure and motion from two-dimensional (2D) images of different projection models for multi-resolution object modeling. What is also needed is a system and method that performs multi-resolution object modeling from different projection models that produces stable results.
Whatever the merits of the above mentioned systems and methods, they do not achieve the benefits of the present invention.
SUMMARY OF THE INVENTION
To overcome the limitations in the prior art described above, and to overcome other limitations that will become apparent upon reading and understanding the present specification, the present invention, in general, is embodied in systems and methods for determining structure and motion of an object using multiple sets of images from different projection models of the object for multi-resolution modeling of the object. In addition, the present invention is embodied in a method for deriving a novel fundamental matrix from multiple images of the object and using parameters of the fundamental matrix to digitally recover a model of the object.
Namely, two-dimensional (2D) images of a three-dimensional (3D) object are obtained from multiple sets of views with different projection models, such as from a full perspective view and a weak perspective views. The fundamental matrix embodies the epipolar geometry between a full perspective view and a weak perspective view. The systems and methods of the present invention preferably uses the derived fundamental matrix together with the 2D image information of the full and weak perspective views to digitally reconstruct the 3D object and produce results with multi-resolution processing techniques. These techniques include recovering and refining motion parameters and recovering and refining structure parameters. The results can include, for example, 3D positions of points, camera position between different views, texture maps, and the like.
The foregoing and still further features and advantages of the present invention as well as a more complete understanding thereof will be made apparent from a study of the following detailed description of the invention in connection with the accompanying drawings and appended claims.
REFERENCES:
patent: 5633995 (1997-05-01), McClain
patent: 5740341 (1998-04-01), Oota et al.
patent: 5748199 (1998-05-01), Palm
Zhang Z. Determining the Epipolar Geometry and its Uncertainty: A Review. pp. 161-195 1997.
Xu G. and Zhang Z. Epipolar Geometry in Stereo, Motion and Object Recognition. Kluwer Academic Publishers. 1996.
Luong Q. and Faugeras O. The Fundamental Matrix: Theory, Algorithms, and Stability Analysis. International Journal of Computer Vision, 17, pp. 43-75, 1996.
Nash S. and Sofer A. Linear and Nonlinear Programming. 1996.
Shapiro L. Affine Analysis of Image Sequences. Cambridge University Press, pp. 1-210, 1995.
Hartley R. In Defence of the 8-point Algorithm. GE-Corporate Research and Development. pp. 1064-1070, 1995.
Huang T. and Netravali A. Motion and Structure from Feature Correspondences: A Review. Proceedings of the IEEE. vol. 82 No. 2, pp. 252-268, 1994.
Shashua A. Projective Structure from Uncalibrated Images: Structure frim Motion and Recognition. IEEE Trans. PAMI, vol. 16 No, 8, pp. 778-790, Aug. 1994.
Faugeras O. Three-Dimensional Computer Vision, The MIT Press, 1993.
Mohr R., Veillon F., and Quan L. Relative 3D Reconstruction Using Multiple Uncalibrated Images. pp. 543-548, 1993.
Haryley R., Gupta R., and Chang T. Stereo from Uncalibrated Cameras. GE-Corporate Research and Development. pp. 761-764, 1992.
Huang T.S. and Faugeras o. Some Properties of the E Matrix in Two-View Motion Estimation. IEEE Trans. PAMI, vol. 11, No. 12 pp. 1310-1312, Dec. 1989.
Aggarwal J.K. and Nandhakumar N. On the Computation of Motion from Sequences of Images—A Review. Proceedings Of the IEEE, vol. 75, pp. 917-935, No. 8, 1988.
Roach J. and Aggarwal J.K. Determining the Movement of Objects from a Sequence of Images. pp. 554-562, 1980.
Ullman S. The Interpretation of Visual Motion. The MIT Press. 1979.
Aloimonos J. Perspective approximations. vol. 8, No. 3 pp. 179-192.
Faugeras O. What can be seen in three dimensions with an uncalibrated stereo rig? pp. 563-578.
Golub G. and Van Loan C. Matrix Computations-Third Edition. The John Hopkins University Press.
Hartley R. Euclidean Reconstruction from Uncalibrated Views. pp. 237-257.
Maybank S. Theory of Reconstruction from Image Motion.
Spellucci P. A SQP Method for General Nonlinear Programs Using Equality Contrained Subproblems. Technical University at Darmstadt, Department of Mathematics. pp. 1-27.
Anandan Padmananbhan
Shum Heung-Yeung
Zhang Zhengyou
Cao Huedung X.
Lyon Richard T.
Lyon & Harr LLP
Microsoft Corporation
Zimmerman Mark
LandOfFree
System and method for determining structure and motion from... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for determining structure and motion from..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for determining structure and motion from... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3111322