Image analysis – Image enhancement or restoration – Artifact removal or suppression
Reexamination Certificate
2007-08-14
2007-08-14
Couso, Yon J. (Department: 2624)
Image analysis
Image enhancement or restoration
Artifact removal or suppression
C358S003260
Reexamination Certificate
active
10826981
ABSTRACT:
Artifacts are detected in a cyclopean virtual image generated from stereo images. A disparity map is generated from the stereo images. Individual projected images are determined based on the disparity map and the corresponding stereo images. A difference map is computed between the individual projected images to indicate the artifacts. A source patch in the virtual image is defined relative to an artifact. A replacement target patch is generated using a split-patch search technique as a composite of a background exemplar patch and a foreground exemplar patch. Each exemplar patch may be identified from an image patch selected from at least one of the stereo images. The source patch of the virtual image is replaced by the replacement target patch to correct the detected artifact.
REFERENCES:
patent: 5359362 (1994-10-01), Lewis et al.
patent: 5917937 (1999-06-01), Szeliski et al.
patent: 5986668 (1999-11-01), Szeliski et al.
patent: 5987164 (1999-11-01), Szeliski et al.
patent: 6009188 (1999-12-01), Cohen et al.
patent: 6009190 (1999-12-01), Szeliski et al.
patent: 6018349 (2000-01-01), Szeliski et al.
patent: 6023523 (2000-02-01), Cohen et al.
patent: 6028955 (2000-02-01), Cohen et al.
patent: 6044181 (2000-03-01), Szeliski et al.
patent: 6072496 (2000-06-01), Guenter et al.
patent: 6084592 (2000-07-01), Shum et al.
patent: 6097854 (2000-08-01), Szeliski et al.
patent: 6137491 (2000-10-01), Szeliski
patent: 6157747 (2000-12-01), Szeliski et al.
patent: 6222937 (2001-04-01), Cohen et al.
patent: 6246412 (2001-06-01), Shum et al.
patent: 6271855 (2001-08-01), Shum et al.
patent: 6301370 (2001-10-01), Steffens et al.
patent: 6304288 (2001-10-01), Hamagishi
patent: 6320978 (2001-11-01), Szeliski et al.
patent: 6348918 (2002-02-01), Szeliski et al.
patent: 6476803 (2002-11-01), Zhang et al.
patent: 6487304 (2002-11-01), Szeliski
patent: 6606404 (2003-08-01), Zhang et al.
patent: 6608923 (2003-08-01), Zhang et al.
patent: 6611268 (2003-08-01), Szeliski et al.
patent: 6639596 (2003-10-01), Shum et al.
patent: 6642924 (2003-11-01), Kang et al.
patent: 6668080 (2003-12-01), Torr et al.
patent: 6674877 (2004-01-01), Jojic et al.
patent: 6806898 (2004-10-01), Toyama et al.
patent: 2005/0129305 (2005-06-01), Chen et al.
Basu, Sumit, Essa, Irfan, Pentland, Alex; “Motion Regularization for Model-Based Head Tracking.” In Proceedings of International Conference on Pattern Recognition, Wien, Austria, 1996 IEEE, pp. 611-616.
Belhumeur, Peter N.; Mumford, David “A Bayesian Treatment of the Stereo Correspondence Problem Using Half-Occluded Regions” IEEE Conference on Computer Vision and Pattern Recognition, 1992, 8pgs.
Black, Michael J., Yacoob, Yaser; “Tracking and Recognizing Rigid and Non-Rigid Facial Motions Using Local Parametric Models of Image Motion”; IEEE Proceedings of International Conference on Computer Vision, Cambridge, MA, 1995, pp. 374-381.
Bobick, Aaron F., Intille, Stephen S.; “Large Occlusion Stereo”; HCV 1999, pp. 1-25.
Chen, Shenchang Eric, Williams, Lance; “View Interpolation for Image Synthesis”; SIGGRAPH, 1993, pp. 1-7.
Choi, Chang Seok, Aizawa, Kiyoharu, Harashima, Hiroshi, Takebe, Tsuyoshi; “Analysis and Synthesis of Facial Image Sequences in Model-Based Image Coding” IEEE Transaction on Circuits and Systems for Video Technology v. 4, n 3 Jun. 1994, pp. 257-275.
Cox, Ingemar J., Hingorani, Sunita L., Rao, Satish B., Maggs, Bruce M.; “A Maximum Likelihood Stereo Algorithm” Computer vision and Image Understanding, May 1996, pp. 542-567 (1-47).
Darrell, Trevor, Baback, Moghaddam, Pentland, Alex P.; “Active Face Tracking and Pose Estimation in an Interactive Room” IEEE Computer Vision and Pattern Recognition, 1996, pp. 67-72 (1-16).
DeCarlo, Douglas, Metaxes, Dimitris; “Optical Flow Constraints on Deformable Models with Applications to Face Tracking” International Journal of computer Vision, 2000, pp. 99-127 (1-42).
Gemmell, Jim, Toyama, Kentaro, Zitnick, C. Lawrence, Kang, Thomas, Seitz, Steven; “Gaze Awareness for Video-Conferencing: A Software Approach” Oct.-Dec. 2000, pp. 26-35.
Horprasert, Thanarat, Yacoob, Yaser, Davis, Larry S.; “Computing 3-D Head Orientation From a Monocular Image Sequence”; Interantional Conference Automatic Face and Gesture Recognition, 1996, pp. 242-247.
Ishikawa, Hiroshi, Geiger, Davi; “Occlusions, Discontinuities, and Epipolar Lines in Stereo” The Fifth European Conference on Computer Vision (ECCV '98) Jun. 1998, Germany pp. 1-14.
Kolmogorov, Vladimir, Zabih, Ramin; “Multi-Camera Scene Reconstruction via Graph Cuts”; Proc. Europ. Conf. Computer Vision, Copenhagen, Denmark, May 2002, pp. 1-16.
Li, Haibo, Roivainen, Pertti, Forchheimer, Robert; “3-D Motion Estimation in Model-Based Facial Image Coding” IEEE Transactions on Pattern Analysis and Machine Intelligence, v. 15, n 6, Jun. 1993, pp. 545-555.
Liu, Zicheng, Zhang, Zhengyou, Jacobs, Chuck, Cohen, Michael; “Rapid Modeling of Animated Faces from Video” Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition Feb. 2000, pp. 58-67.
Loop, Charles, Zhang, Zhengyou; “Computing Rectifying Homographies for Stereo Vision” Technical Report MSR-TR-99-21, 14 pgs.
Lu, Le, Zhang, Zhengyou, Shum, Heung-Yeung, Liu, Zicheng, Chen, Hong; “Model and Exemplar-Based Robust Head Pose Tracking Under Occlusion and Varying Expression” IEEE Computer Soc. Conf. on Computer Vision & Pattern Recog., Dec. 2001, Hawaii, USA, pp. 1-8.
Newman, Rhys, Matsumoto, Yoshio, Rougeaux, Sebastien, Zelinsky, Alexander; “Real-Time Stereo Tracking for Head Pose and Gaze Estimation” IEEE 2000 pp. 122-128.
Ohta, Yuichi, Kanade, Takeo; “Stereo by Intra-and Inter-Scanline Search Using Dynamic Programming” IEEE 1985, 16 pgs.
Roy, Sebastien, Cox, Ingemar J.; “A Maximum-Flow Formulation of the N-Camera Stereo Correspondence Problem” IEEE Proc. of Int. Conference on Computer Vision, Bombai, Jan. 1998, pp. 492-499.
Scharstein, Daniel, Szeliski, Richard, Zabih, Ramin; “A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms”; International Journal of Computer Vision, 2002, 10pgs.
Scharstein, Daniel, “Stereo Vision for View Synthesis” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, Jun. 1996 pp. 852-858.
Shi, Jianbo, Tomasi, Carlo; “Good Features to Track”; IEEE Conference on Computer Vision and Pattern Recognition, Seattle WA, Jun. 1994, 7pgs.
Sun, Jian, Shum, Heung-Yeung, Zheng, Nan-Ning; “Stereo Matching Using Belief Propagation” ECCV 2002, pp. 510-524.
Szeliski, Richard; “Prediction Error as a Quality Metric for Motion and Stereo” Vision Technology Group Microsoft Research, Proceeding of the International Conference on Computer Vision, vol. 2, Corfu, Greece, 1999, 8pgs.
Vetter, Thomas “Synthesis of Novel Views From a Single Face Image” Max-Planck-Institut, Germany, Technical Report No. 26, Feb. 1996, pp. 1-13.
Yang, Ruigang, Zhang, Zhengyou; “Eye Gaze Correction with Stereovision for Video-Teleconferencing” Proceedings from the European Conference of Computer Vision, vol. 2, Copenhagen, Denmark May 2002, pp. 479-494.
Zhang, Zhengyou, Liu, Zicheng, Adler, Dennis, Cohen, Michael F., Hanson, Erik, Shan, Ying; “Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach” Technical Report MSR-TR-2001-101 pp. 1-30.
Birchfield, S. Tomasi, C.; “A Pixel Dissimilarity Measure that is insensitive to Image Sampling” IEEE Transactions on Pattern Analysis and Machine Intelligence 4(20) pp. 40-406, Mar. 1998.
Broadhurst, A. & Cipolla, R.; “A statistical Consistency Check for the Space Carving Algorithm” In Proceedings of ICCV 2001, 10 pages.
Chuang, Y.-Y., Curless, B., Salesin, D. H., Szelis
Blake Andrew
Criminisi Antonio
Couso Yon J.
Microsoft Corporation
LandOfFree
Virtual image generation does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Virtual image generation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Virtual image generation will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3846710