Television – Camera – system and detail – Camera image stabilization
Reexamination Certificate
2006-10-10
2006-10-10
Ho, Tuan (Department: 2622)
Television
Camera, system and detail
Camera image stabilization
Reexamination Certificate
active
07119837
ABSTRACT:
The present invention includes an automatic video enhancement system and method for automatically enhancing video. The automated video enhancement method uses frame-to-frame motion estimation as the basis of the video enhancement. Motion estimation includes the computation of global motion (such as camera motion) and the computation of local motion (such as pixel motion). The automated video enhancement method includes generating global alignment transforms, generating optic flow vectors, and using these global alignment transforms and optic flow vectors to enhance the video. The invention also includes video processing and enhancement techniques that use the frame-to-frame motion estimation. These techniques include a deinterlace process, a denoise process, and a warp stabilization process that performs both damped and locked stabilization.
REFERENCES:
patent: 5430480 (1995-07-01), Allen et al.
patent: 5629988 (1997-05-01), Burt et al.
patent: 5682205 (1997-10-01), Sezan et al.
patent: 5973733 (1999-10-01), Gove
patent: 6115502 (2000-09-01), De Haan et al.
patent: 6151018 (2000-11-01), Webb et al.
patent: 6188444 (2001-02-01), Webb
patent: 6400831 (2002-06-01), Lee et al.
patent: 6628711 (2003-09-01), Mathew et al.
patent: 6809758 (2004-10-01), Jones
patent: 2003/0002746 (2003-01-01), Kusaka
patent: 2004/0146107 (2004-07-01), Sekiguchi et al.
patent: 0 571 121 (1993-11-01), None
patent: WO 02/39737 (2002-05-01), None
Altunbasak, Y. aand A. M. Tekalp. Occlusion-Adaptive, Content-Based Mesh Design and Forward tracking. IEEE Transations on Image Processing, vol. 6, No. 9, Sep. 1997.
Bab-Hadiashar, A. and D. Suter. Robust optic flow estimation using least median of squares. ICIP'96 IEEE International Conference on Image Processing, Sep. 16-19, Switzerland.
Ben-Ezra, M., S. Peleg, and M. Werman. Real-Time Motion Analysis with Linear-Programming. Institute of Computer science. The Hebrew University of Jerusalem, 91904 Jerusalem, Israel.
Borman, S. and R.L. Stevenson. Simultaneous multi-frame MAP super-resolution video enhancement using spatio-temporal priors. Dept. of Electrical Engineering, University of Notre Dame, Notre Dame, IN. USA.
Buehler, C., Bosse, M., and McMillan, L. Non-Metric Image-Based Rendering for Video Stabilization. MIT Laboratory for Computer Science. Cambridge, MA.
Chen, Ting. Video Stabilization Algorithm Using a Block-Based Parametric Motion Model. EE392J Project Report, Winter 2000. Information Systems Laboratory. Dept of Electrical Engineering, Standford University, Ca.
Deame, M. Motion Compensated De-Interlacing: The Key to the Digital Video Transition. Presented at the SMPTE 141stTechnical Conference in NY, Nov. 19-22, 1999.
Dufaux, F. and J. Konrad. Efficient, robust and fast global motion estimation for video coding. IEEE Transactions on Image Processing, vol. 9, No. 3, Mar. 2000.
Hemmendorff, M., M.T. Andersson, and H. Knutsson. Phase-based image motion estimation and registration. Department of Electrical Engineering. Linkoping University, Linkoping, SWEDEN.
Karunaratne, P.V. Compressed video enhancement using regularized iterative restoration algorithms. A thesis sumbitted to the graduate school in partial fulfillment of the requirements for the degree Master of science, Field of electrical and Computer Engineering. Evanston, IL, Dec. 1999.
Mester, R. and M. Muhlich. Improving motion and orientation estimation using an equilibrated total least squares approach. J.W. Goethe-Universitat Frankfurt, Institute for Applied Physics. Frankfurt, Germany.
Neumann, U. and S. You. Adaptive Multi-Stage 2D Image Motion Field Estimation. Computer Science Dept. Integrated Media Systems Center, University of Southern California, CA.
Pollefeys, M., M. Vergauwen, K. Cornelis, J. Tops. f. Verbiest, L. van Gool. Structure and motion from image sequences. Centre for Processing of speech and Images, K.U.Veuven, Kasteelpark Arenberg 10, B-3001 Leuven-Heverlee, Belgium.
Segall, C. A. and A. K. Katsaggelos. A new constraint for the regularized enhancement of compressed video. Dept of Electrical and Computer engineering. Northwestern University, Evanston, IL. USA.
Song, B.C. and J.B. Ra. A fast motion estimation algorithm based on multi-resolution frame structure. Dept of Electrical Engineering. Korea Advanced Institute of Science and Technology. Taejon, Republic of Korea.
Szeliski, R. Prediction error as a quality metric for motion and stereo, in ICCV, vol. 2, pp. 781-788, Kerkyra, Greece, Sep. 1999.
Weickert, J. Application of Nonlinear Diffusion in Image Processing and Computer Vision. Acta Math. Univ. Comeniane vol. LXX, 1(2001), pp. 33-50, Proceedings of Algoritmy 2000.
Zabih, R., J. Miller, and K. Mai. A feature-based algorith for detecting and classifying production effects. Mutimedia Systems 7:119-128 (1999).
Anandan Padmanabhan
Soupliotis Andreas
Fischer Craig S.
Ho Tuan
Lyon & Harr L.L.P.
Microsoft Corporation
LandOfFree
Video processing system and method for automatic enhancement... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Video processing system and method for automatic enhancement..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Video processing system and method for automatic enhancement... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3621767