Image analysis – Image transformation or preprocessing – Mapping 2-d image onto a 3-d surface
Reexamination Certificate
2005-03-15
2005-03-15
Boudreau, Leo (Department: 2621)
Image analysis
Image transformation or preprocessing
Mapping 2-d image onto a 3-d surface
C345S419000, C345S422000, C345S606000, C345S632000
Reexamination Certificate
active
06868191
ABSTRACT:
The present invention is directed toward providing a system for constructing a graphical representation of an image, as perceived from a desired view, from a plurality of calibrated views. An optimum, median fused depth map of a new, desired view of an object or a scene is constructed from a plurality of depth maps of the object or scene, utilizing median values for each of the image pixels within the image domain of the new view. Each of the known depth maps are rendered into the new view, and the pixels of the rendered image are processed one at a time until a median value for each pixel in the new view of the image of the object or scene is calculated. The calculated median values are then assembled into a median fused depth map of the new view of the object or scene, with the median fused depth map available to construct a new two or three dimension images and models of the object or scene as perceived from the new view.
REFERENCES:
patent: 6046763 (2000-04-01), Roy
patent: 6052124 (2000-04-01), Stein et al.
patent: 6084979 (2000-07-01), Kanade et al.
patent: 6252974 (2001-06-01), Martens et al.
patent: 6266064 (2001-07-01), Snyder
patent: 6314211 (2001-11-01), Kim et al.
patent: 6504569 (2003-01-01), Jasinschi et al.
patent: 6633664 (2003-10-01), Minamida et al.
patent: 0871144 (1998-10-01), None
patent: WO9906956 (1999-02-01), None
patent: WO0122366 (2001-03-01), None
Tirumalai et al., Dynamic Stereo with Self-Calibration, Dec. 1992, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, Issue 12, pp. 466-470.*
Y. Boykov, et al., “Fast approximate energy minimization via graph cuts”, ICCV 99, pp. 377-384.
P. Eisert et al., “Automatic reconstruction of 3-D stationary objects from multiple uncalibrated camera views”, IEEE Transactions on Circuits and Systems for Video Technology, 10(2), pp. 261-277, Mar. 2000.
P. Fua, “Reconstructing complex surfaces from multiple stereo views”, Proc, ICCV 95, pp. 1078-1985.
R. Mandelbaum, et al., “Correlation-based estimation of ego-motion and structure from motion and stereo”, ICCV 99, pp. 544-550.
L. Robert et al., “Dense depth map reconstruction: A minimization and regularization approach which preserves discontinuities”, ECCV 96, pp. 439-451.
H. Saito, et al., “Shape reconstruction in projective grid space from large number of images”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 99), Fort Collins, CO, Jun. 1999.
S. Birchfield et al., Multiway Cut for Stereo and Motion With Slated Surfaces, ICCV 99, pp. 489-496. (date unknown).
A. Fitzgibbon et al., Automatic Camera Recovery for Closed or Open Image Sequences, Proc. ECCV 98, pp. 311-326, (date unknown).
P. Beardsley et al., Sequential Updating of Projective and Affine Structure from Motion, IJCV, 23(3), pp. 235-259, 1997.
R. Cipolla et al., 3D Model Acquisition from Uncalibrated Images, Proc. IAPR Workshop on Machine Vision Applications, Chiba Japan, pp. 559-568, Nov. 1998.
P. Debevec, Modeling and Rendering Architecture from Photographs: A hybrid Geometry-and Image-based Approach, Siggraph 96, pp. 11-20, Computer Graphics Proceedings, Annual Conference Series, 1996.
O. Faugeras et al., Variational Principles, Surface Evolution, PDE's Level Set Methods and the Stereo Problem, IEEE Transactions on Image Processing, 7(3), pp. 336-344, Mar. 1998.
O. Faugeras, What Can Be Seen in Three Dimensions With an Uncalibrated Stereo Rig?, Proc. ECCV 92, pp. 563-578. (date unknown.
L. Gaucher, et al., Accurate Motion Flow Estimation with Discontinuities, ICCV 99, pp. 695-702. (date unknown).
D. Greig et al., Exact Maxium A Posteriori Estimation for Binary Images, Journal of the Royal Statistical Society, Series B, 51(2), pp. 271-279, 1989.
K. Hanna et al., Combining Stereo and Motion for Direct Estimation of Scene Structure, Proc. ICCV 93, pp. 357-365, 1993.
R. Hartley, Euclidean Reconstruction from Uncalibrated Views, Application of Invariance in Computer Vision, LNCS 825, pp. 237-256, Springer-Verlag, 1994.
A. Heyden et al., Euclidean Reconstruction from Image Sequences with Varying and Unknown Focal Length and Principal Point, Proc. CVPR 97, pp. 438-443, 1997.
K. Kutulakos et al., A Theory of Shape by Space Carving, Proc ICCV 99, pp. 307-314. (date unknown).
S. Maybank et al., A Theory of Self-Calibration of a Moving Camera, International Journal of Computer Vision, 8(2), pp. 123-151, 1992.
D. Nister, Frame Decimation for Structure and Motion, Accepted to SMILE 2000.
D. Nister, Reconstruction from Uncalibrated Sequences with a Hierarchy of Trifocal Tensors, Accepted to ECCV 2000.
M. Pollefeys et al., Self-Calibration and Metric Reconstruction In spite of Varying and Unknown Internal Camera Parameters, IJCV, 32(1), pp. 7-26, Aug. 1999.
P. Torr et al., An Integrated Bayesian Approach to Layer Extraction from Image Sequences, ICCV 99, pp. 983-990. (date unknown).
L. Van Gool et al., Automatic 3D Model Building from Video Sequences, Proc. ECMAST 96, vol. 8., No. 4, pp. 563-582, 1997.
Ahuja, et al., Network Flows: theory, algorithms and applications. ISBN 0-136-17549-X, Prentice Hall, pp. 207-249, 1993.
European Search Report Application No.: RS 105653, mailed Jan. 17, 2002.
International Search Report Application No.: PCT/SEO1/01494, mailed Jan. 3, 2002.
Narayanan P J et al., “Constructing virtual worlds using dense stereo” pp. 3-10, XP000874141, Jan. 1998.
Park J—I et al., Arbitrary view generation form multiple cameras pp. 149-152, vol. 1, XP000792737, 1997.
Saito H et al., “Appearance-based virtual view generation of temporally-varying events from multi-camera images in the 3D room” pp. 516-525, XP002157613, Oct. 1999.
Boudreau Leo
Rosario-Vasquez Dennis
Telefonaktiebolaget LM Ericsson (publ)
LandOfFree
System and method for median fusion of depth maps does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for median fusion of depth maps, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for median fusion of depth maps will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3425714