Image analysis – Applications – 3-d or stereo imaging analysis
Reexamination Certificate
1997-02-11
2001-02-20
Chang, Jon (Department: 2723)
Image analysis
Applications
3-d or stereo imaging analysis
C359S470000, C382S107000, C382S236000
Reexamination Certificate
active
06192145
ABSTRACT:
FIELD OF THE INVENTION
The invention generally relates to image processing systems and, more particularly, to a method and apparatus for processing the parallax geometry of pairs of points within three-dimensional scene.
BACKGROUND OF THE INVENTION
The analysis of three dimensional scenes from image sequences has a number of goals. These goals include, but are not limited to: (i) the recovery of 3D scene structure, (ii) the detection of moving objects in the presence of camera induced motion, and (iii) the synthesis of new camera views based on a given set of views.
The traditional approach to these types of problems has been to first recover the epipolar geometry between pairs of frames and then apply that information to achieve the above-mentioned goals. However, this approach is plagued with the difficulties associated with the recovery of the epipolar geometry.
Recent approaches to 3D scene analysis have attempted to overcome some of the difficulties in recovering the epipolar geometry by decomposing the motion into a combination of a planar homography and residual parallax. The residual parallax motion depends on the projective structure, and the translation between the camera origins. While these methods remove some of the ambiguities in estimating camera rotation, they still require the explicit estimation of the epipole itself, which can be difficult under many circumstances. In particular, epipole estimation is ill-conditioned when the epipole lies significantly away from the center of the image and the parallax motion vectors are nearly parallel to each other. Also, when there are only a small number of parallax vectors and the scene contains moving objects, these objects incorrectly influence the estimation of the epipole.
In general, the treatment of multipoint geometry assumes that the scene is static and relies on the fact that almost all points selected for the shape estimation are known to belong to a single rigid body. In its current form, this class of methods has drawbacks, for example, these methods do not address the problem of shape recovery in dynamic scenes, in particular when the amount of image motion due to independent moving object is not negligible.
SUMMARY OF THE INVENTION
The present invention involves a technique for image processing which receives a plurality of two dimensional images representative of a scene, computes a parallax-related constraint for a pair of points within the plurality of images, applies the parallax-related constraint to a plurality of points within the plurality of images in order to generate information representative of whether a given point within the plurality of images is consistent with the parallax-related constraint; and uses the generated information for an image processing task related to the received plurality of images.
REFERENCES:
patent: 3715482 (1973-02-01), Haines et al.
patent: 4573191 (1986-02-01), Kidode et al.
patent: 4654872 (1987-03-01), Hisano et al.
patent: 4669048 (1987-05-01), Ackermann et al.
patent: 4908573 (1990-03-01), Kaufman et al.
patent: 4982438 (1991-01-01), Usami et al.
patent: 4985856 (1991-01-01), Kaufman et al.
patent: 5076687 (1991-12-01), Adelson
patent: 5185671 (1993-02-01), Lieberman et al.
patent: 5249035 (1993-09-01), Yamanaka
patent: 5390024 (1995-02-01), Wright
patent: 5448687 (1995-09-01), Hoogerhyde et al.
patent: 5473364 (1995-12-01), Burt
patent: 5490133 (1996-02-01), Nakamura et al.
patent: 5495576 (1996-02-01), Ritchey
patent: 5528194 (1996-06-01), Ohtani et al.
patent: 5577130 (1996-11-01), Wu
patent: 5586231 (1996-12-01), Florent et al.
patent: 5623528 (1997-04-01), Takeda
patent: 5644651 (1997-07-01), Cox et al.
patent: 5680474 (1997-10-01), Iijima et al.
patent: 5694531 (1997-12-01), Golin et al.
patent: 5696551 (1997-12-01), Katto
patent: 5703961 (1997-12-01), Rogina et al.
patent: 5706416 (1998-01-01), Mann et al.
patent: 5764871 (1998-06-01), Fogel
patent: 5821943 (1998-10-01), Shashua
patent: 5828793 (1998-10-01), Mann
patent: 5852672 (1998-12-01), Lu
patent: 5986668 (1999-11-01), Szeliski et al.
Sinclair et al., “Further constraints on visual articulated motions”, Institute for Computer Graphics, IEEE 1996, oo. 94-99.
Sawhney, “3D Geometry from Planar Parallax”, Machine Vision Group, IEEE, 1994, pp. 929-934.
Boufama et al., “Epipole and fundamental matrix estimation using virtual parallax”, LIFIA-INRIA, IEEE, 1995, pp. 1030-1036.
Copy of International Search Report dated Jun. 9, 1997, from corresponding international application.
J.R. Bergen, P. Anandan, K. J. Hanna, and R. Hingorani. “Hierarchial Model-based Motion Estimation” inEuropean Conference on Computer Vision, pp. 237-252, Santa Margarita Ligure, May 1992.
J.R. Bergen, P. J. Burt, K. Hanna, R. Hingorani, P., Jeanne, and S. Peleg. “Dynamic Multiple-Motion Computation” In Y. A. Feldman and A. Bruckstein, editors,Artificial Intellegience and Computer Computer Vision: Proceedings of the Israeli Conference, pp. 147-156. Elsevier, 1991.
J. R. Bergen, P. J. Burt, R. Hingorani, and S. Peleg. “A Three-frame Algorithm For Estimating Two-component Image Motion”IEEE Trans. on Pattern Analysis and Machine Intelligence, 14:886-8895, 895 Sep. 1992.
P.J. Burt, R. Hingorani, and R.J. Kolczynski. “Mechanisms For Isolating Component Patterns In The Sequential Analysis Of Multiple Motion” InIEEE Workshop on Visual Motion, pp. 187-193, Princeton, New Jersey, Oct. 1991.
S. Carlsson. “Duality of Reconstruction And Positioning From Projective Views” InWorkshop on Representations of Visual Scenes, 1995.
T. Darrell and A. Pentland. “Robust Estimation of a Multi-layered Motion Representation”. InIEEE Workshop on Visual Motion, pp. 173-178, Princeton, New Jersey, Oct. 1991.
T. Darrell and E. Simoncelli. “Nulling” Filters and The Separation of Transparent Motions InIEEE Conference on Computer Vision and Pattern Recognition, pp. 738-739, New York, Jun. 1993.
O. Faugeras and L. Robert. “What Can Two Images Tell Us About A Third One?” InEuropeanConferenceConference on Computer Vision, pp. 485-492, May 1994.
O.D. Faugeras. “What Can Be Seen In Three Dimensions With An Uncalibrated Stereo Rig?” in EuropeanEuropean Conference on Computer Vision, pp. 563-578, Santa Margarita Ligure, May 1992.
O.D. Faugeras and B. Mourrain. “On the Geometry and Algebra of the Point and Line Correspondences Between n Images” InInternational Conference on Computer Vision, pp. 951-956, Cambridge, MA Jun. 1995.
K. Hanna. “Direct Multi-resolution Estimation of Ego-motion and Structure From Motion”. InIEEEWorkWorkshop on Visual Motion, pp. 156-162, Princeton, NJ Oct. 1991.
R. Hartley, R. Gupta, and T. Chang. “Stereo From Uncalibrated Cameras” InIEEE Conference on Computer Vision and Pattern Recognition, Jun. 1992.
M. Irani, B. Rousso, and S. Peleg. “Detecting and Tracking Multiple Moving Objects Using Temporal Integration” InEuropean Conference on Computer Vision, pp. 282-287, Santa Margarita Ligure, May 1992.
M. Irani, B. Rousso, and S. Peleg. “Computing Occluding and Transparent Motions”International Journal Journal of Computer Vision, 12(1):5-16, Jan. 1994.
M. Irani, B. Rousso, and S. Peleg. “Recovery of Ego-motion Using Image Stabilization” InIEEE Conference on Computer Vision and Pattern Recognition, pp. 451-460, Seattle, WA, Jun. 1994.
Rakesh Kumar, P. Anandan, and K. Hanna “Shape Recovery from Multiple Views: A Parallax Based Approach”, InDARPA IU Workshop, Monterey, CA, Nov. 1994.
Rakesh Kumar, P. Anandan, M. Irani, J. R. Bergen, and K. J. Hanna. “Representation of Scenes From Collections of Images” InWorkshop on Representations of Visual Scenes, 1995.
J. M. Lawn and R. Cipolla. “Robust Egomotion Estimation From Affine Motion Parallax” InEuropean Conference on Computer Vision, pp. 205-210, May 1994.
F. Meyer and P. Bouthemy. “Region-based Tracking In Images Sequences” InEuropean Conference on Computer Vision, pp. 476-484, Santa Margarita Ligure, May 1992.
Harpreet Sawhney. “3d Geometry From Planar Parallax” InProc. CVPR 92,Jun. 1994.
A. Shashua “Projective Structure From Uncalibrated Images: Structure From Motion and Recognition”IEEE Tra
Anandan Padmanabhan
Irani Michal
Burke William J.
Chang Jon
Patel Jayanti K.
Sarnoff Corporation
LandOfFree
Method and apparatus for three-dimensional scene processing... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for three-dimensional scene processing..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for three-dimensional scene processing... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2591004