Computer graphics processing and selective visual display system – Computer graphics processing – Graphic manipulation
Reexamination Certificate
2007-11-06
2007-11-06
Yang, Ryan (Department: 2628)
Computer graphics processing and selective visual display system
Computer graphics processing
Graphic manipulation
C345S419000, C345S422000, C382S154000
Reexamination Certificate
active
10880774
ABSTRACT:
A system and process for generating, and then rendering and displaying, an interactive viewpoint video in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. In general, the interactive viewpoint video is generated using a small number of cameras to capture multiple video streams. A multi-view 3D reconstruction and matting technique is employed to create a layered representation of the video frames that enables both efficient compression and interactive playback of the captured dynamic scene, while at the same time allowing for real-time rendering.
REFERENCES:
patent: 6954202 (2005-10-01), Han et al.
patent: 7015926 (2006-03-01), Zitnick et al.
patent: 7085409 (2006-08-01), Sawhney et al.
patent: 7142209 (2006-11-01), Uyttendaele et al.
patent: 2002/0061131 (2002-05-01), Sawhney et al.
U.S. Appl. No. 10/879,327, filed Jun. 28, 2004, Zitnick et al.
U.S. Appl. No. 10/879,235, filed Jun. 28, 2004, Zitnick et al.
U.S. Appl. No. 10/910,077, filed Aug. 3, 2004, Winder et al.
U.S. Appl. No. 10/910,088, filed Aug. 3, 2004, Uyttendaele et al.
Buehler, C., M. Bosse, L. McMillan, S. Gortler, and M. Cohen, Unstructured lumigraph rendering,Proceedings of SIGGRAPH 2001, pp. 425-432.
Carceroni, R. L., and K. Kutulakos, Multi-view scene capture by surfel sampling: From video streams to non-rigid 3D motion, shape and reflectance,Eighth International Conference on Computer Vision, vol. II, pp. 60-67.
Carranza, J., C. Theobalt, M. Magnor, and H.-P. Seidel, Free-viewpoint video of human actors,ACM Transactions on Graphics, vol. 22, No. 3, pp. 569-577.
Chang, C.-L., X. Zhu, P. Ramanathan, and B. Girod, Inter-view wavelet compression of light fields with disparity-compensated lifting,SPIE Visual Communications and Image Processing,2003,Invited Paper.
Chuang, Y.-Y., B. Curless, D. Salesin, and R. Szeliski, A Bayesian approach to digital matting,Conf. on Comp. Vision and Pattern Recognition, 2001, vol. II, pp. 264-271.
Debevec, P.E., C. J. Taylor, and J. Malik, Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach,Computer Graphics(SIGGRAPH '96), Aug. 1996, pp. 11-20.
Debevec, P.E., Y. Yu, and G. Borshukov, Efficient view-dependent image-based rendering with projective texture mapping,Ninth Eurographics Rendering Workshop, Vienna, Austria, Jun. 1998.
Gortler, S.J., R. Grzeszczuk, R. Szeliski, and M. F. Cohen, The lumigraph,ACM SIGGRAPH Comp. Graphics Proceedings, Annual Conference Series, pp. 43-54.
Hall-Holt, O., and S. Rusinkiewicz, Stripe boundary codes for real-time structured-light range scanning of moving objects,Eighth Int'l. Conf. on Comp. Vision, vol. II, pp. 359-366.
Heigl, B., R. Koch, M. Pollefeys, J. Denzler, L. Van Gool, Plenoptic modeling and rendering from image sequences taken by hand-held camera,DAGM'99, pp. 94-101.
Kanade, T., P. W. Rander, and P. J. Narayanan, Virtualized reality: constructing virtual worlds from real scenes,IEEE MultiMedia Magazine, Jan.-Mar. 1997, vol. 1, No. 1, pp. 34-47.
Levoy, M. and P. Hanrahan, Light field rendering,ACM SIGGRAPH Comp. Graphics Proceedings, Annual Conference Series, Aug. 1996, pp. 31-42.
Pulli, K., M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle, View-based rendering,Eurographics Workshop on Rendering, 1997, pp. 23-34.
Scharstein, D., and R. Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms,Int'l. J. of Comp. Vision, vol. 47, No. 1, pp. 7-42.
Seitz, S. M., and C. M. Dyer, Photorealistic scene reconstruction by voxel coloring,CVPR'97, Jun. 1997, pp. 1067-1073.
Shade, J., S. Gortler, L.-W. He, and R. Szeliski, Layered depth images,Comp. Graphics(SIGGRAPH'98) Proceedings, Jul. 1998, pp. 231-242.
Tao, H., H. Sawhney, and R. Kumar, A global matching framework for stereo computation,Eighth Int'l. Conf. on Comp. Vision, vol. I, pp. 532-539.
Vedula, S., S. Baker, S. Seitz, and T. Kanade, Shape and motion carving in 6D,Conf. on Comp. Vision and Patten Recognition, vol. II, pp. 592-598.
Wexler, Y., A. Fitzgibbon, and A. Zisserman, Bayesian estimation of layers from multiple images,Seventh European Conf. on Comp. Vision, vol. III, pp. 487-501.
Wilburn, B., M. Smulski, H. K. Lee and M. Horowitz, The light field video camera,SPIE Electronic Imaging: Media Processors, vol. 4674, pp. 29-36.
Yang, J. C., M. Everett, C. Buehler, and L. McMillan, A real-time distributed light field camera,Thirteenth Eurographics Workshop on Rendering, 2002, pp. 77-85.
Zhang, L., B. Curless, and S. M. Seitz, Spacetime stereo: Shape recovery for dynamic scenes,Conf. on Comp. Vision and Pattern Recognition, 2003, pp. 367-374.
Zhang, Y., and C. Kambhamettu, On 3D scene flow and structure estimation,Conf. on Comp. Vision and Pattern Recognition, 2001, vol. II, pp. 778-785.
Zhang, Z. A flexible new technique for camera calibration,Technical Report: MSR-TR-98-71, Microsoft Research, Redmond, WA.
Ziegler, G., H. Lensch, N. Ahmed, M. Magnor, and H.-P. Seidel, Multi-video compression in texture space,IEEE International Conference on Image Processing(ICIP'04), 2004, (accepted for publication).
Ziegler, G., H. Lensch, M. Magnor, and H.-P. Seidel, Multi-video compression in texture space using 4D SPIHT,IEEE Int'l. Workshop on Multimedia and Signal Process, (MMSP'04), 2004, (accepted for publication).
Chai, B.-B., S. Sethuraman, H. S. Sawhney, P. Hatrack, Depth map compression for real-time view-based rendering,Pattern Recognition Letters, 2004, vol. 25, No. 7, pp. 755-766.
Grammalidis, N., M. G. Strintzis, Sprite generation and coding in multiview image sequences,IEEE Transactions on Circuits and Sys. for Video Tech., Mar. 2000, vol. 10, No. 2, pp. 302-311.
Krishnamurthy, R., B.-B. Chai, H. Tao, S.Sethuraman, Compression and transmission of depth maps for image-based rendering,Int'l Conf. on Image Processing, 2001, vol. 3, pp. 828-831.
Lim, J., K. N. Ngan, W. Yang, K. Sohn, A multiview sequence CODEC with view scalability,Signal Processing: Image Communication, 2004, vol. 19, pp. 239-256.
Szeliski, R., Scene reconstruction from multiple cameras,Int'Conf. on Image Processing(ICIP-2000), Vancouver, Sep. 2000, vol. I, pp. 13-16.
Torr, P., R. Szeliski, and P. Anandan, An integrated Bayesian approach to layer extraction from image sequences,IEEE Trans. on Pattern Analysis and Mach. Intelligence, 2001, vol. 23, No. 3, pp. 297-303.
European Search Report, Application No. EP05105244.7, completed Oct. 19, 2006, received Nov. 8, 2006.
Kang Sing Bing
Szeliski Richard
Uyttendaele Matthew
Winder Simon
Zitnick, III Charles
Lyon Richard T.
Lyon & Marr, LLP
Microsoft Corporation
Yang Ryan
LandOfFree
Interactive viewpoint video system and process does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Interactive viewpoint video system and process, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Interactive viewpoint video system and process will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3841978