Color segmentation-based stereo 3D reconstruction system and...

Image analysis – Applications – 3-d or stereo imaging analysis

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

C382S164000

Reexamination Certificate

active

07379583

ABSTRACT:
A system and process for computing a 3D reconstruction of a scene from multiple images thereof, which is based on a color segmentation-based approach, is presented. First, each image is independently segmented. Second, an initial disparity space distribution (DSD) is computed for each segment, using the assumption that all pixels within a segment have the same disparity. Next, each segment's DSD is refined using neighboring segments and its projection into other images. The assumption that each segment has a single disparity is then relaxed during a disparity smoothing stage. The result is a disparity map for each image, which in turn can be used to compute a per pixel depth map if the reconstruction application calls for it.

REFERENCES:
patent: 5179441 (1993-01-01), Anderson et al.
patent: 6788809 (2004-09-01), Grzeszczuk et al.
U.S. Appl. No. 10/880,774, filed Jun. 28, 2004, Kang et al.
U.S. Appl. No. 10/879,327, filed Jun. 28, 2004.
U.S. Appl. No. 10/879,235, filed Jun. 28, 2004, Zitnick et al.
U.S. Appl. No. 10/910,088, filed Aug. 3, 2004, Uyttendaele et al.
Buehler, C., M. Bosse, L. McMillan, S. Gortler, and M. Cohen, Unstructured lumigraph rendering,Proceedings of SIGGRAPH 2001, pp. 425-432.
Carceroni, R. L., and K. Kutulakos, Multi-view scene capture by surfel sampling: From video streams to non-rigid 3D motion, shape and reflectance,Eighth International Conference on Computer Vision, vol. 11, pp. 60-67, Dated 2001.
Carranza, J., C. Theobalt, M. Magnor, and H.-P. Seidel, Free-viewpoint video of human actors,ACM Transactions on Graphics, vol. 22, No. 3, pp. 569-577, Dated Jul. 2003.
Chai, B.-B., S. Sethuraman, H. S. Sawhney, P. Hatrack, Depth map compression for real-time view-based rendering,Pattern Recognition Letters, 2004, vol. 25, No. 7, pp. 755-766.
Chang, C.-L., X. Zhu, P. Ramanathan, and B. Girod, Inter-view wavelet compression of light fields with disparity-compensated lifting,SPIE Visual Communications and Image Processing,2003,Invited Paper.
Chuang, Y.-Y., B. Curless, D. Salestin, and R. Szeliski, A Bayesian approach to digital matting,Conf. on Comp. Vision and Pattern Recognition, 2001, vol. II, pp. 264-271.
Debevec, P.E., C. J. Taylor, and J. Malik, Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach,Computer Graphics(SIGGRAPH'96), Aug. 1996, pp. 11-20.
Debevec, P.E., Y. Yu, and G. Borshukov, Efficient view-dependent image-based rendering with projective texture mapping,Ninth Eurographics Rendering Workshop, Vienna, Austria, Jun. 1998.
Gortler, S.J., R. Grzeszczuk, R. Szeliski, and M. F. Cohen, The lumigraph,ACM SIGGRAPH Comp. Graphics Proceedings, Annual Conference Series, pp. 43-54, Dated 1996.
Grammalidis, N., M. G. Strintzis, Sprite generation and coding in multiview image sequences,IEEE Transactions on Circuits and Sys. for Video Tech., Mar. 2000, vol. 10, No. 2, pp. 302-311.
Hall-Holt, O., and S. Rusinkiewicz, Stripe boundary codes for real-time structured-light range scanning of moving objects,Eighth Int'l. Conf. on Comp. Vision, vol. II, pp. 359-366, Dated: Jul. 2001.
Heigl, B., R. Koch, M. Pollefeys, J. Denzler, L. Van Gool, Plenoptic modeling and rendering from image sequences taken by hand-held camera,DAGM'99, pp. 94-101.
Kanade, T., P. W. Rander, and P. J. Narayanan, Virtualized reality: constructing virtual worlds from real scenes,IEEE MultiMedia Magazine, Jan.-Mar. 1997, vol. 1, No. 1, pp. 34-47.
Krishnamurthy, R., B.-B. Chai, H. Tao, S.Sethuraman, Compression and transmission of depth maps for image-based rendering,Int'l Conf. on Image Processing, 2001, vol. 3, pp. 828-831.
Levoy, M. and P. Hanrahan, Light field rendering,ACM SIGGRAPH Comp. Graphics Proceedings, Annual Conference Series, Aug. 1996, pp. 31-42.
Lim, J., K. N. Ngan, W. Yang, K. Sohn, A multiview sequence CODEC with view scalability,Signal Processing: Image Communication, 2004, vol. 19, pp. 239-256.
Pulli, K., M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle, View-based rendering,Eurographics Workshop on Rendering, 1997,.pp. 23-34.
Scharstein, D., and R. Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms,Int'l. J. of Comp. Vision, vol. 47, No. 1, pp. 7-42, Dated: 2001.
Seitz, S. M., and C. M. Dyer, Photorealistic scene reconstruction by voxel coloring,CVPR'97, Jun. 1997, pp. 1067-1073.
Shade, J., S. Gortler, L.-W. He, and R. Szeliski, Layered depth images,Comp. Graphics(SIGGRAPH'98) Proceedings, Jul. 1998, pp. 231-242.
Szeliski, R., Scene reconstruction from multiple cameras,Int'l Conf. on Image Processing(ICIP-2000), Vancouver, Sep. 2000, vol. 1, pp. 13-16
Tao, H., H. Sawhney, and R. Kumar, A global matching framework for stereo computation,Eighth Int'l. Conf. on Comp. Vision, vol. 1, pp. 532-539, Dated: 2001.
Torr, P., R. Szeliski, and P. Anandan, An integrated Bayesian approach to layer extraction from image sequences,IEEE Trans. on Pattern Analysis and Mach. Intelligence, 2001, vol. 23, No. 3, pp. 297-303.
Vedula, S., S. Baker, S. Seitz, and T. Kanade, Shape and motion carving in 6D,Conf. on Comp. Vision and Patten Recognition, vol. 11, pp. 592-598, Dated: 2000.
Wexler, Y., A. Fitzgibbon, and A. Zisserman, Bayesian estimation of layers from multiple images,Seventh European Conf. on Comp. Vision, vol. III, pp. 487-501, Dated: 2002.
Wilburn, B., M. Smulski, H. K. Lee and M. Horowitz, The light field video camera,SPIE Electronic Imaging: Media Processors, vol. 4674, pp. 29-36, Dated: 2002.
Yang, J. C., M. Everett, C. Buehler, and L. McMillan, A real-time distributed light field camera,Thirteenth Eurographics Workshop on Rendering, 2002, pp. 77-85, Dated: 2002.
Zhang, L., B. Curless, and S. M. Seitz, Spacetime stereo: Shape recovery for dynamic scences,Conf. on Comp. Vision and Pattern Recognition, 2003, pp. 367-374, Dated: 2003.
Zhang, Y., and C. Kambhamettu, On 3D scene flow and structure estimation,Conf. on Comp. Vision and Pattern Recognition, 2001, vol. II, pp. 778-785.
Zhang, Z. A flexible new technique for camera calibration,Technical Report: MSR-TR-98-71, Microsoft Research, Redmond, WA, Dated: Aug. 10, 2002.
Ziegler, G., H. Lensch, N. Ahmed, M. Magnor, and H.-P. Seidel, Multi-video compression in texture space,IEEE International Conference on Image Processing(ICIP'04), 2004, (accepted for publication).
Ziegler, G., H. Lensch, M. Magnor, and H.-P. Seidel, Multi-video compression in texture space using 4D SPIHT,IEEE Int'l. Workshop on Multimedia and Signal Processing, (MMSP'04), 2004, (accepted for publication).

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Color segmentation-based stereo 3D reconstruction system and... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Color segmentation-based stereo 3D reconstruction system and..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Color segmentation-based stereo 3D reconstruction system and... will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-2802701

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.