Image analysis – Applications – 3-d or stereo imaging analysis
Reexamination Certificate
2005-11-29
2005-11-29
Mehta, Bhavesh M. (Department: 2625)
Image analysis
Applications
3-d or stereo imaging analysis
C382S285000, C345S419000, C356S012000, C348S042000
Reexamination Certificate
active
06970591
ABSTRACT:
In an image processing apparatus20an input sequence130of video images is processed to determine the different positions and orientations at which the images were recorded in an efficient and accurate manner. A subset of the input images are selected as keyframes to form a sequence250of keyframes. Respective triples of keyframes having different, non-overlapping positions in the sequence250are selected and processed to determine the relative positions and orientations at which the keyframes in each triple were recorded to form respective sets of keyframes. The positions and orientations of keyframes between the keyframes in each triple are then calculated to form expanded sets of keyframes266, 276, 286. The sets are further expanded by calculating the positions and orientations of keyframes which lie between sets in the sequence250. The sets are merged by calculating the relationship between the coordinate systems in which the positions and orientations of the keyframes in each set are defined. During the processing, the positions and orientations calculated for keyframes in a set are adjusted to optimise the calculated solutions. This is performed in stages, considering at each stage a different window270of the keyframes and performing processing to minimise the error associated with the keyframes in the window. The window is moved sequentially through the keyframes so that every keyframe in a set is considered at least once.
REFERENCES:
patent: 5511153 (1996-04-01), Azarbayejani et al.
patent: 5850469 (1998-12-01), Martin et al.
patent: 5870099 (1999-02-01), Horii et al.
patent: 6044181 (2000-03-01), Szeliski et al.
patent: 6278798 (2001-08-01), Rao
patent: 6297825 (2001-10-01), Madden et al.
patent: 6348918 (2002-02-01), Szeliski et al.
patent: 6515099 (2003-02-01), Sato et al.
patent: 6516099 (2003-02-01), Davison et al.
patent: 6571024 (2003-05-01), Sawhney et al.
patent: 6614429 (2003-09-01), Zhang et al.
patent: 6628819 (2003-09-01), Huang et al.
patent: 6647146 (2003-11-01), Davison et al.
patent: 6661913 (2003-12-01), Zhang et al.
patent: 6664956 (2003-12-01), Erdem
patent: 6668082 (2003-12-01), Davison et al.
patent: 0680014 (1995-11-01), None
patent: 0707288 (1996-04-01), None
patent: 0895192 (1999-02-01), None
patent: 0898245 (1999-02-01), None
patent: 0901105 (1999-03-01), None
patent: 0902395 (1999-03-01), None
patent: 2353659 (2001-02-01), None
U.S. Appl. No. 09/718,342, filed Nov. 24, 2000.
U.S. Appl. No. 09/718,343, filed Nov. 24, 2000.
U.S. Appl. No. 09/718,413, filed Nov. 24, 2000.
U.S. Appl. No. 09/129,077, filed Aug. 5, 1998.
U.S. Appl. No. 09/129,079, filed Aug. 5, 1998.
U.S. Appl. No. 09/129,080, filed Aug. 5, 1998.
“Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment” by Shum and Szeliski in International Journal of Computer Vision 36(2), pp. 101-130 (2000).
“A unifying Framework for Structure and Motion Recovery from Image Sequences” by P. F. McLauchlan and D. W. Murray in Proc 5th International Conf. on Computer Vision, Boston, pp. 314-320, Jun. 1995.
“The Variable State Dimension Filter applied to Surface-Based Structure from Motion” by Philip F. McLauchlan, CVSSP Technical Report VSSP-TR-4/99, pp. 1-52.
“Epipolar Geometry in Stereo, Motion and object Recognition”.by Xu and Zhang, Chapter 2, Kluwer Academic Press, ISBN 0792341996.
“Euclidean Reconstruction from Uncalibrated Views” by Hartley in Applications of Invariance in Computer Vision: Proceedings of Second Joint Euro-US Workshop, Chapter 5, Ponta del Gada, Azores, Portugal, Oct. 1993, Springer-Verlag, ISBN 0387582401.
“Efficient Bundle Adjustment with Virtual Key Frames: A Hierarchical Approach to Multi-Frame Structure from Motion” by Shum et al in Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 538-543, ISBN 0769501494.
“Calibration of Image Sequences for Model Visualisation” by Broadhurst and Cipolla in Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 100-105, ISBN 0769501494.
“Multi-View 3D Estimation and Applications to Match Move” by Sawhney et al in 1999 IEEE Workshop on Multi-View Modelling and Analysis of Visual Scenes, pp. 21-28, ISBN 0769501109.
“Calibrating and 3D Modelling with a Multi-Camera System” by Wiles and Davison in 1999 IEEE Workshop on Multi-View Modelling and Analysis of Visual Scenes, pp. 29-36, ISBN 0769501109.
“Adaptive Least Squares Correlation: A Powerful Image Matching Technique” by A. W. Gruen in Photogrammetry Remote Sensing and Cartography, 14(3), 1985 pp. 175-187.
“Computer and Robot Vision Vol. 2”, Section 13.4.15, by R. M. Haralick and L. G. Shapiro, Addison-Wesley Publishing Company, 1993, pp. 85-91, ISBN 0-201-56943-4 (v.2).
“Numerical Recipes in C”, Chapter 15.5, pp. 681-688 by Press et al, Cambridge University Press, ISBN 0-521-43108-5.
“Closed Form Solution of Absolute Orientation Using Unit Quaternions” by Horn in Journal of Optical Soc. of America 4(4), pp. 629-649, Apr. 1987.
“Shape and Motion from Image Streams under orthography: a Factorization Method” by Tomasi and Kande, IJCV 9:2, 137154 (1992), pp. 137-154.
“Computer and Robot Vision vol. 1”, Section 8, by R. M. Haralick and L. G. Shapiro, Addison-Wesley Publishing Company, 1992, pp. 371-452, ISBN 0-201-10877-1 (v.I).
“Rapid Octree Construction from Image Sequences” by R. Szeliski in CVGIP: Image Understanding, vol. 58, No. 2, Jul. 1993, pp. 23-32.
“Marching Cubes: A High Resolution 3D Surface Construction Algorithm” by W. E. Lorensen & H. E. Cline in Computer Graphics, SIGGRAPH 87 proceedings, 21; pp. 163-169, Jul. 1987.
“An Implicit Surface Polygonizer” by J. Bloomenthal in Graphics Gems IV, AP Professional, 1994, ISBN 0123361559, pp. 324-350.
“Photorealistic Scene Reconstruction by Voxel Coloring” by Seitz and Dyer in Proc. Conf. Computer Vision and Pattern Recognition 1997, pp. 1067-1073.
“Plenoptic Image Editing” by Seitz and Kutulakos in Proc. 6th International Conference on Computer Vision, pp. 17-24.
“What Do N Photographs Tell Us About 3D Shape?” by Kutulakos and Seitz in University of Rochester Computer Sciences Technical Report 680, Jan. 1998, pp. 1-8.
“A Theory of Shape by Space Carving” by Kutulakos and Seitz in University of Rochester Computer Sciences Technical Report 692, May 1998, pp. 1-27.
“Robust Video Mosaicing Through Topology Inference and Local to Global Alignment” by Sawhney et al in Proc. European Conference on Computer Vision, ECCV, Freiburg Germany vol. 2, pp. 103-119, Jun. 1998.
“The Variable State Dimension Filter” by Philip McLauchlan.
“Good Features to Track” by Shi and Tomasi in 1994 IEEE Conference on Computer Vision and Pattern Recognition pp. 593-600.
“A Multiple-Baseline Stereo” by Okutomi and Kanade in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, No. 4, Apr. 1993, pp. 353-363.
“Relative Orientation”, B. Horn, Inspec.l Abstract accession No. 3620717, Jun. 1990, Netherlands.
Baumberg Adam Michael
Lyons Alexander Ralph
Carter Aaron
Mehta Bhavesh M.
LandOfFree
Image processing apparatus does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image processing apparatus, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image processing apparatus will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3491771