Computer graphics processing and selective visual display system – Computer graphics processing – Three-dimension
Reexamination Certificate
2006-08-03
2008-12-30
Chauhan, Ulka (Department: 2628)
Computer graphics processing and selective visual display system
Computer graphics processing
Three-dimension
C345S419000, C345S426000
Reexamination Certificate
active
07471292
ABSTRACT:
A system that receives a first video stream of a scene having a first viewpoint and a second video stream having a second viewpoint wherein camera calibration between the first viewpoint and the second viewpoint is unknown. A viewer selects a viewer viewpoint generally between the first viewpoint and the second viewpoint, and the system synthesizes the viewer viewpoint based upon the first video stream and the second video stream.
REFERENCES:
patent: 5963664 (1999-10-01), Kumar et al.
patent: 6266068 (2001-07-01), Kang et al.
patent: 6353678 (2002-03-01), Guo et al.
patent: 6571024 (2003-05-01), Sawhney et al.
patent: 6573912 (2003-06-01), Suzuki et al.
patent: 6668080 (2003-12-01), Torr et al.
patent: 6771303 (2004-08-01), Zhang et al.
patent: 6803912 (2004-10-01), Mark et al.
patent: 6853398 (2005-02-01), Malzbender et al.
patent: 6864903 (2005-03-01), Suzuki
patent: 6992702 (2006-01-01), Foote et al.
patent: 7054491 (2006-05-01), McGuinness et al.
patent: 7085409 (2006-08-01), Sawhney et al.
patent: 7277118 (2007-10-01), Foote
patent: 2002/0012459 (2002-01-01), Oh
patent: 2002/0061131 (2002-05-01), Sawhney et al.
patent: 2002/0122113 (2002-09-01), Foote
patent: 2002/0158873 (2002-10-01), Williamson
patent: 2003/0030638 (2003-02-01), Astrom et al.
patent: 2003/0095711 (2003-05-01), McGuinness et al.
patent: 2003/0197779 (2003-10-01), Zhang et al.
patent: 2003/0231179 (2003-12-01), Suzuki
patent: 2004/0239763 (2004-12-01), Notea et al.
patent: 2004/0240725 (2004-12-01), Xu et al.
patent: 2004/0247173 (2004-12-01), Nielsen et al.
patent: 2005/0185711 (2005-08-01), Pfister et al.
patent: 2005/0286756 (2005-12-01), Hong et al.
patent: 2006/0056727 (2006-03-01), Jones et al.
patent: 2006/0066612 (2006-03-01), Yang et al.
patent: 2006/0125921 (2006-06-01), Foote
patent: 2006/0146138 (2006-07-01), Xin et al.
patent: 2006/0146141 (2006-07-01), Xin et al.
patent: 2006/0146143 (2006-07-01), Xin et al.
patent: 1785941 (2007-05-01), None
patent: WO 2007/061495 (2007-05-01), None
Liu, X. et al., “A hybrid method of image synthesis in IBR for novel viewpoints”, Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Seoul, Korea, Oct. 22-25, 2000), VRST '00, ACM Press, NY, NY, pp. 55-60.
Bon-Woo Hwang; Seong-Whan Lee; “Reconstruction of partially damaged face images based on a morphable face model”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, Issue 3, Mar. 2003, pp. 365-372.
Gangyi Jiang et al., “New method of ray-space interpolation for free viewpoint video”, IEEE International Conference on Image Processing, ICIP 2005, vol. 2, Sep. 11-14, 2005, pp. II-1138-1141.
Gong et al., “Camera Field Rendering”, University of Alberta (Canada), Technical Report: TR02-08.pdf, May 23, 2002, pp. 1-22.
Gong, M.; Yee-Hong Yang; “Fast stereo matching using reliability-based dynamic programming and consistency constraints”, Proceedings Ninth IEEE International Conference on Computer Vision, 2003, pp. 610-617.
Minglun Gong; Yee-Hong Yang; “Multi-resolution stereo matching using genetic algorithm”, Proceedings. IEEE Workshop on Stereo and Multi-Baseline Vision, (SMBV 2001), Dec. 9-10, 2001, pp. 21-29.
M. Gong and Y.H. Yang, Camera field rendering for static and dynamic scenes, Graphical Models 67 (Mar. 2005), ACM, pp. 73-99.
Izquierdo, E.; “Computational experiments with area-based stereo for image-based rendering”, Proceedings First International Symposium on 3D Data Processing Visualization and Transmission, Jun. 19-21, 2002, pp. 168-171.
Kimata, H. et al., “System design of free viewpoint video communication”, The Fourth International Conference on Computer and Information Technology, CIT '04, Sep. 14-16, 2004, pp. 52-59.
Liangzhong Fan, et al., “Ray space interpolation based on its inherent characteristics”, 2004 IEEE Region 10 Conference, TENCON 2004, vol. A, Nov. 21-24, 2004, pp. 375-378.
Tanimoto, M.; “FTV (free viewpoint television) creating ray-based iamge engineering”, IEEE International Conference on Image Processing. ICIP 2005, vol. 2, Sep. 11-14, 2005, pp. II-25-28.
Xu, Y. and Yang, Y., “Object representation using 1D displacement mapping”, Proceedings of Graphics interface 2004, May 17-19, 2004, ACM International Conference Proceedings Series, vol. 62, Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, pp. 33-40.
Yong-Suk Kim; Kyu-Phil Han; Eung-Joo Lee; Yeong-Ho Ha; “Robust 3-D depth estimation using genetic algorithm in stereo image pairs”, IEEE Asia Pacific Conference on Circuits and Systems, Nov. 18-21, 1996, pp. 357-360.
Wei Zhang; Quanbing Zhang; Lei Qu; Sui Wei; “A stereo matching algorithm based on multiresolution and epipolar constraint”, Proceedings Third International Conference on Image and Graphics, Dec. 18-20, 2004, pp. 180-183.
M. Pollefeys, “Self-calibration and metric 3D reconstruction from uncalibrated image sequences”, Ph.D. Thesis, Dept. of Electrical Engineering, ESAT-PSI, K.U.Leuven, 1999, Scientific Prize BARCO 1999, 240 pages.
Fusiello, A.; Caldrer, S.; Ceglie, S.; Matthern, N.; Murino, V.; “View synthesis from uncalibrated iamges using parallax”, Proceedings 12th International Conference on Image Analysis and Processing, Sep. 17-19, 2003, pp. 146-151.
Mei Han; Kanade, T.; “Multiple motion scene reconstruction with uncalibrated cameras”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, Issue 7, Jul. 2003, pp. 884-894.
Ito, Y.; Saito, H.; “Free-viewpoint image synthesis from multiple-view images taken with uncalibrated moving cameras”, IEEE International Conference on Image Processing, ICIP 2005, vol. 3, Sep. 11-14, 2005, pp. III-29-32.
Koch, R.; Pollefeys, M.; Van Gool, L.; “Automatic 3D model acquisition from uncalibrated image sequences”, Proceedings Computer Graphics International, Jun. 22-26, 1998, pp. 597-604.
Koch, R.; Pollefeys, M.; Heigl, B.; Van Gool, L.; Niemann, H.; “Calibration of hand-held camera sequences for plenoptic modeling”, The Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 1, Sep. 20-27, 1999, pp. 585-591.
Koch, R.; Pollefeys, M.; Luc Van Gool; “Realistic 3-D scene modeling from uncalibrated image sequences”, Proceedings 1999 International Conference on Image Processing. ICIP 99, vol. 2, Oct. 24-28, 1999, pp. 500-504.
Pollefeys, M.; van Gool, L.; “Stratified self-calibration with the modulus constraint”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, Issue 8, Aug. 1999, pp. 707-724.
Yaguchi, S.; Saito, H.; “Arbitrary viewpoint video synthesis from multiple uncalibrated cameras”, IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 34, Issue 1, Feb. 2004, pp. 430-439.
Lingxiang Zhou; Weikang Gu; “Motion and structure from an uncalibrated moving camera”, 1998 Fourth International Conference on Signal Processing Proceedings, ICSP '98, vol. 2, Oct. 12-16, 1998, pp. 873-876.
Sang Yoon Park et al., “Segmentation based disparity estimation using color and depth information”, 2004 International Conference on Image Processing, ICIP '04, vol. 5, Oct. 24-27, 2004, pp. 3275-3278.
Zokai, et al., “Multiview Paraperspective Projection Model for Diminished Reality”, Proceedings of the 2nd IEEE/ACM international Symposium on Mixed and Augmented Reality, Oct. 7-10, 2003, IEEE Computer Society, Washington, DC, 10 pages.
European Search Report for European Patent Application No. 06023473.9 based on U.S. Appl. No. 11/462,327, Mailed Jan. 30, 2007.
S. Pollard, M. Pilu, S. Hayes and A. Lorusso, “View Synthesis by Trinocular Edge Matching and Transfer”, Applications of Computer Vision, 1988, WACV '98, Proceedings Fourth IEEE Workshop on Princeton, NJ, USA Oct. 19-21, 1998, Los Alamitos, CA, USA, IEEE Comp
Chauhan Ulka
Chernoff Vilhauer & McClung & Stenzel
Prendergast Roberta
Sharp Laboratories of America Inc.
LandOfFree
Virtual view specification and synthesis in free viewpoint does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Virtual view specification and synthesis in free viewpoint, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Virtual view specification and synthesis in free viewpoint will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4035353