Computer graphics processing and selective visual display system – Computer graphics processing – Graphic manipulation
Reexamination Certificate
2007-10-23
2007-10-23
Chauhan, Ulka J. (Department: 2628)
Computer graphics processing and selective visual display system
Computer graphics processing
Graphic manipulation
C345S619000, C345S634000, C345S638000, C345S639000, C345S419000, C345S427000, C345S428000, C345S426000
Reexamination Certificate
active
11097542
ABSTRACT:
A system and process for generating, and then rendering and displaying, an interactive viewpoint video in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. In general, the interactive viewpoint video is generated using a small number of cameras to capture multiple video streams. A multi-view 3D reconstruction and matting technique is employed to create a layered representation of the video frames that enables both efficient compression and interactive playback of the captured dynamic scene, while at the same time allowing for real-time rendering.
REFERENCES:
patent: 6266068 (2001-07-01), Kang et al.
patent: 6320978 (2001-11-01), Szeliski et al.
patent: 6348918 (2002-02-01), Szeliski et al.
patent: 6788809 (2004-09-01), Grzeszczuk et al.
patent: 7016411 (2006-03-01), Azuma et al.
patent: 2002/0122113 (2002-09-01), Foote
patent: 2003/0012277 (2003-01-01), Azuma et al.
U.S. Appl. No. 10/880,774, filed Jun. 28, 2004, Kang et al.
U.S. Appl. No. 10/879,327, filed Jun. 28, 2004, Zitnick et al.
U.S. Appl. No. 10/879,235, filed Jun. 28, 2004, Zitnick et al.
U.S. Appl. No. 10/910,088, filed Aug. 3, 2004, Uyttendaele et al.
Buehler, C., M. Bosse, L. McMillan, S. Gortler, and M. Cohen, Unstructured lumigraph rendering,Proceedings of SIGGRAPH 2001, pp. 425-432.
Carceroni, R. L., and K. Kutulakos, Multi-view scene capture by surfel sampling: From video streams to non-rigid 3D motion, shape and reflectance,Eighth International Conference on Computer Vision, vol. II, pp. 60-67.
Carranza, J., C. Theobalt, M. Magnor, and H.-P. Seidel, Free-viewpoint video of human actors,ACM Transactions on Graphics, vol. 22, No. 3, pp. 569-577.
Chai, B.-B., S. Sethuraman, H. S. Sawhney, P. Hatrack, Depth map compression for real-time view-based rendering,Pattern Recognition Letters, 2004, vol. 25, No. 7, pp. 755-766.
Chang, C.-L., X. Zhu, P. Ramanathan, and B. Girod, Inter-view wavelet compression of light fields with disparity-compensated lifting,SPIE Visual Communications and Image Processing,2003,Invited Paper.
Chuang, Y.-Y., B. Curless, D. Salesin, and R. Szeliski, A Bayesian approach to digital matting,Conf. on Comp. Vision and Pattern Recognition, 2001, vol. II, pp. 264-271.
Debevec, P.E., C. J. Taylor, and J. Malik, Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach,Computer Graphics(SIGGRAPH '96), Aug. 1996, pp. 11-20.
Debevec, P.E., Y. Yu, and G. Borshukov, Efficient view-dependent image-based rendering with projective texture mapping,Ninth Eurographics Rendering Workshop, Vienna, Austria, Jun. 1998.
Gortler, S.J., R. Grzeszczuk, R. Szeliski, and M. F. Cohen, The lumigraph,ACM SIGGRAPH Comp. Graphics Proceedings, Annual Conference Series, pp. 43-54.
Grammalidis, N., M. G. Strintzis, Sprite generation and coding in multiview image sequences,IEEE Transactions on Circuits and Sys. for Video Tech., Mar. 2000, vol. 10, No. 2, pp. 302-311.
Hall-Holt, O., and S. Rusinkiewicz, Stripe boundary codes for real-time structured-light range scanning of moving objects,Eighth Int'l. Conf. on Comp. Vision, vol. II, pp. 359-366.
Heigl, B., R. Koch, M, Pollefeys, J. Denzler, L. Van Gool, Plenoptic modeling and rendering from image sequences taken by hand-held camera,DAGM'99, pp. 94-101.
Kanade, T., P. W. Rander, and P. J. Narayanan, Virtualized reality: constructing virtual worlds from real scenes,IEEE MultiMedia Magazine, Jan.-Mar. 1997, vol. 1, No. 1, pp. 34-47.
Krishnamurthy, R., B.-B. Chai, H. Tao, S.Sethuraman, Compression and transmission of depth maps for image-based rendering,Int'l Conf. on Image Processing, 2001, vol. 3, pp. 828-831.
Levoy, M. and P. Hanrahan, Light field rendering,ACM SIGGRAPH Comp. Graphics Proceedings, Annual Conference Series, Aug. 1996, pp. 31-42.
Lim, J., K. N. Ngan, W. Yang, K. Sohn, A multiview sequence CODEC with view scalability,Signal Processing: Image Communication, 2004, vol. 19, pp. 239-256.
Pulli, K., M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle, View-based rendering,Eurographics Workshop on Rendering, 1997, pp. 23-34.
Scharstein, D., and R. Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms,Int'l. J. of Comp. Vision, vol. 47, No. 1, pp. 7-42.
Seitz, S. M., and C. M. Dyer, Photorealistic scene reconstruction by voxel coloring,CVPR '97, Jun. 1997, pp. 1067-1073.
Shade, J., S. Gortler, L.-W. He, and R. Szeliski, Layered depth images,Comp. Graphics(SIGGRAPH '98) Proceedings, Jul. 1998, pp. 231-242.
Szeliski, R., Scene reconstruction from multiple cameras,Int'l Conf. on Image Processing(ICIP-2000), Vancouver, Sep. 2000, vol. 1, pp. 13-16.
Tao, H., H. Sawhney, and R. Kumar, A global matching framework for stereo computation,Eighth Int'l. Conf. on Comp. Vision, vol. 1, pp. 532-539.
Torr. P., R. Szeliski, and P. Anandan, An integrated Bayesian approach to layer extraction from image sequences,IEEE Trans. on Pattern Analysis and Mach. Intelligence, 2001, vol. 23, No. 3, pp. 297-303.
Vedula, S., S. Baker, S. Seitz, and T. Kanade, Shape and motion carving in 6D,Conf. on Comp. Vision and Pattern Recognition, vol. II, pp. 592-598.
Wexler, Y., A. Fitzgibbon, and A. Zisserman, Bayesian estimation of layers from multiple images,Seventh European Conf. on Comp. Vision, vol. III, pp. 487-501.
Wilburn, B., M. Smulski, H. K. Lee and M. Horowitz, The light field video camera,SPIE Electronic Imaging: Media Processors, vol. 4674, pp. 29-36.
Yang, J. C., M. Everett, C. Buehler, and L. McMillan, A real-time distributed light field camera,Thirteenth Eurographics Workshop on Rendering, 2002, pp. 77-85.
Zhang, L., B. Curless, and S. M. Seitz, Spacetime stereo: Shape recovery for dynamic scenes,Conf. in Comp. Vision and Pattern Recognition, 2003, pp. 367-374.
Zhang, Y., and C. Kambhamettu, On 3D scene flow and structure estimation,Conf. on Comp. Vision and Pattern Recognition, 2001, vol. II, pp. 778-785.
Zhang, Z. A flexible new technique for camera calibration,Technical Report: MSR-TR-98-71, Microsoft Research, Redmond, WA.
Ziegler, G., H. Lensch, N. Ahmed, M. Magnor, and H.-P. Seidel, Multi-video compression in texture space,IEEE International Conference on Image Processing(ICIP'04), 2004, (accepted for publication).
Ziegler, G., H. Lensch, M. Magnor, and H.-P. Seidel, Multi-video compression in texture space using 4D SPIHT,IEEE Int'l. Workshop on Multimedia and Signal Processing, (MMSP'04), 2004, (accepted for publication).
Kang Sing Bing
Szeliski Richard
Uyttendaele Matthew
Winder Simon
Zitnick, III Charles
Chauhan Ulka J.
Lyon Richard T.
Lyon & Harr LLP
Microsoft Corporation
Woods Eric
LandOfFree
Interactive viewpoint video employing viewpoints forming an... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Interactive viewpoint video employing viewpoints forming an..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Interactive viewpoint video employing viewpoints forming an... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3874167