Image analysis – Applications – 3-d or stereo imaging analysis
Reexamination Certificate
2005-02-22
2005-02-22
Dastouri, Mehrdad (Department: 2623)
Image analysis
Applications
3-d or stereo imaging analysis
C382S296000
Reexamination Certificate
active
06859549
ABSTRACT:
An algorithm for recovering structure and motion from points, lines and/or image intensities. The algorithm combines feature based reconstruction and direct methods. The present invention is directed to a method for recovering 3D scene structure and camera motion from image data obtained from a multi-image sequence, wherein a reference image of the sequence is taken by a camera at a reference perspective and one or more successive images of the sequence are taken at one or more successive different perspectives by translating and/or rotating the camera. The method comprising the steps of (a) determining image data shifts for each successive image with respect to the reference image; the shifts being derived from the camera translation and/or rotation from the reference perspective to the successive different perspectives; (b) constructing a shift data matrix that incorporates the image data shifts for each image; (c) calculating two rank-3 factor matrices from the shift data matrix using SVD, one rank-3 factor matrix corresponding the 3D structure and the other rank-3 factor matrix corresponding the camera motion; (d) recovering the 3D structure from the 3D structure matrix using SVD by solving a linear equation; and (e) recovering the camera motion from the camera motion matrix using the recovered 3D structure.
REFERENCES:
patent: 6614429 (2003-09-01), Zhang et al.
Oliensis et al., “Structure from Motion using Points, Lines, and Intensities,” IEEE, pp. 599-605, 2000.*
Aguiar et al., “Factorization as a Rank 1 Problem,” IEEE, pp. 178-184, 1999.*
Kung et al., “An SVD Approach to Multi-Camera-Multi-Target 3D Motion-Shape Analysis,” IEEE, pp. 573-577, 1994.*
Diamantaras et al., “Camera Motion Parameter Recovery Under Perspective Projection,” IEEE, pp. 807-810, 1996.*
Astrom et al., “Structure and Motion From Lines Under Affine Projections,” IEEE, pp. 285-292, 1999.
Azarbayejani et al., “Recursive Estimation of Motion, Structure, and Focal Length,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, No. 6, pp. 562-575, 1995.
Bergen et al., “Hierarchical Model-Based Motion Estimation,” ECCV, pp. 237-252, 1992.
Burt et al., “The Laplacian Pyramid as a Compact Image Code,” IEEE Transactions on Communications, vol. COM-31, No. 4, pp. 532-540, 1983.
Fermuller et al., “On the Geometry of Visual Correspondence,” International Journal of Computer Vision, vol. 21, No. 3, pp. 223-247, 1997.
Fermuller et al., “Direct Motion Perception,” in Visual Navigation, pp. 135-177, 1997.
Fernmuller et al., “Qualitative Egomotion,” International Journal of Computer Vision, vol. 15, pp. 7-29, 1995.
Fermuller, “Passive Navigation as a Pattern Recognition Problem,” International Journal of Computer Vision, vol. 14, pp. 147-158, 1995.
Fermuller et al., “Direct Perception of Three-Dimensional Motion from Patterns of Visual Motion,” Science, vol. 270, pp. 1973-1976, 1995.
Hanna, “Direct multi-resolution estimation of ego-motion and structure from motion,” IEEE Motion Workshop, pp. 156-162, 1991.
Harris et al., “3D positional integration from image sequences,” IVC, vol. 6, No. 2, pp. 87-90, 1988.
Hartley, “Lines and Points in Three Views and the Trifocal Tensor,” IJCV, pp. 1-24, 1997.
Hartley, “In Defense of the Eight-Point Algorithm,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, No. 6, pp. 580-593, 1997.
Holt et al., “Number of Solutions for Motion and Structure from Multiple Frame Correspondence,” International Journal of Computer Vision, vol. 23, No. 1, pp. 5-15, 1997.
Holt et al., “Uniqueness of Solutions to Structure and Motion from Combinations of Point and Line Correspondences,” Journal of Visual Communication and Image Representation, vol. 7, No. 2, pp. 126-136, 1996.
Horn et al., “Direct Methods for Recovering Motion,” International Journal of Computer Vision, vol. 2, pp. 51-76, 1988.
Horn et al., “Determining Optical Flow,” Artificial Intelligence, pp. 185-203, 1981.
Irani, “Multi-Frame Optical Flow Estimation Using Subspace Constraints,” IEEE, 1999.
Irani et al., “Recovery of Ego-Motion Using Region Alignment,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, No. 3, pp. 268-272, 1997.
Jepson et al., “Linear Subspace Methods for Recovering Translational Direction,” in Spatial Vision in Humans and Robots, Cambridge University Press, pp. 39-62, 1993.
Lucas et al., “An Iterative Image Registration Technique with an Application to Stereo Vision,” Proceedings of the Seventh International Joint Conference on Artificial Intelligence, vol. II, pp. 674-679, 1981.
Mitiche et al., “Counting Straight Lines,” Computer Vision, Graphics, and Image Processing, vol. 47, pp. 353-360, 1989.
Morris et al., “A Unified Factorization Algorithm for Points, Line Segments and Planes with Uncertainty Models,” ICCV, pp. 696-702, 1998.
Oliensis, “Direct Multi-Frame Structure from Motion for Hand-Held Cameras (1372)”, NECI Technical Report, 1999.
Oliensis, “A Multi-Frame Structure-from-Motion Algorithm under Perspective Projection,” International Journal of Computer Vision, vol. 34, pp. 163-192, 1999.
Oliensis et al., “Fast Algorithms for Projective Multi-Frame Structure from Motion,” IEEE, pp. 536-543, 1999.
Oliensis, “Computing the Camera Heading from Multiple Frames,” IEEE, pp. 203-210, 1998.
Oliensis, “Structure from Linear or Planar Motions,” IEEE, pp. 335-342, 1996.
Oliensis, “Rigorous Bounds for Two-Frame Structure from Motion,” ECCV, pp. 184-195, 1996.
Quan et al., “Affine Structure from Line Correspondences with Uncalibrated Affine Cameras,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, No. 8, pp. 834-845, 1997.
Salari et al., “A Method to Calculate the Structure and Motion Parameters From Line Correspondences,” Pattern Recognition, vol. 23, No. 6, pp. 553-561, 1990.
Soatto et al., “Reducing “Structure From Motion”: A General Framework for Dynamic Vision Part 1: Modeling”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, No. 9, pp. 933-942, 1998.
Spetsakis, “A Linear Algorithm for Point and Line-Based Structure from Motion,” CVGIP: Image Understanding vol. 56, No. 2, pp. 23-241, 1992.
Spetsakis et al., “Structure from Motion Using Line Correspondences,” International Journal of Computer Vision, vol. 4, pp. 171-183, 1990.
Stein et al., “Model-based Brightness Constraints: on Direct Estimation of Structure and Motion,” IEEE, pp. 400-406, 1997.
Sturm et al., “A Factorization Based Algorithm for Multi-Image Projective Structure and Motion,” 4th European Conference on Computer Vision, pp. 709-720, 1996.
Taylor et al., “Structure and Motion from Line Segments in Multiple Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, No. 11, pp. 1021-1032, 1995.
Tomasi et al., “Shape and Motion from Image Streams under Orthography: a Factorization Method,” International Journal of Computer Vision, vol. 9, pp. 137-154, 1992.
Torr et al., “Maintaining Multiple Motion Model Hypotheses Over Many Views to Recover Matching and Structure,” ICCV, pp. 485-491, 1998.
Triggs, “Factorization Methods for Projective Structure and Motion,” IEEE, pp. 845-851, 1996.
Weng et al., “Optimal Motion and Structure Estimation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, No. 9, pp. 864-884, 1993.
Weng et al., “Estimating Motion and Structure from Line Matches: Performance Obtained and Beyond,” IEEE, pp. 168-172, 1990.
Weng et al.,
Dastouri Mehrdad
Kibler Virginia
NEC Laboratories America, Inc.
LandOfFree
Method for recovering 3D scene structure and camera motion... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for recovering 3D scene structure and camera motion..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for recovering 3D scene structure and camera motion... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3499628