Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
2003-06-13
2008-08-05
An, Shawn (Department: 2621)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
C375S240160, C375S240290, C375S240260, C348S699000, C348S700000, C382S260000, C382S215000, C382S265000, C382S238000, C382S236000
Reexamination Certificate
active
07408986
ABSTRACT:
Techniques and tools for video frame interpolation and motion analysis are described. The techniques and tools may be implemented separately or in combination in software and/or hardware devices for various applications. For example, a media playback device uses frame interpolation and motion analysis in real time to increase the frame rate of streamed video for playback. The device uses feature/region selection in global motion estimation, local motion estimation to correct the global motion estimation at an intermediate timestamp for a synthesized frame, and vector switching in the local motion estimation.
REFERENCES:
patent: 5473379 (1995-12-01), Horne
patent: 5617144 (1997-04-01), Lee
patent: 5657087 (1997-08-01), Jeong et al.
patent: 5778098 (1998-07-01), Lee et al.
patent: RE35910 (1998-09-01), Nagata et al.
patent: 5835147 (1998-11-01), Florentin et al.
patent: 5929902 (1999-07-01), Kwok
patent: 5933535 (1999-08-01), Lee et al.
patent: 5970173 (1999-10-01), Lee et al.
patent: 6008852 (1999-12-01), Nakaya
patent: 6037988 (2000-03-01), Gu et al.
patent: 6058212 (2000-05-01), Yokohama
patent: 6178205 (2001-01-01), Cheung et al.
patent: 6215496 (2001-04-01), Szeliski et al.
patent: 6369835 (2002-04-01), Lin
patent: 6392705 (2002-05-01), Chaddha
patent: 6400831 (2002-06-01), Lee et al.
patent: 6594313 (2003-07-01), Hazra et al.
patent: 6650705 (2003-11-01), Vetro et al.
patent: 6707854 (2004-03-01), Bonnet et al.
patent: 6728317 (2004-04-01), Demos
patent: 6775326 (2004-08-01), Sekiguchi et al.
patent: 6784942 (2004-08-01), Selby et al.
patent: 6996177 (2006-02-01), Beuker
patent: 7068720 (2006-06-01), Wang et al.
patent: 2003/0138150 (2003-07-01), Srinivasan et al.
patent: 2003/0156646 (2003-08-01), Hsu et al.
patent: 2004/0001705 (2004-01-01), Soupliotis et al.
patent: 2005/0254584 (2005-11-01), Kim et al.
Wu et al., “Joint estimation of forward and backward motion vectors for interpolative prediction of video,”IEEE Transactions on Image Processing3(5):684-687, Sep. 1994.
Reader, “History of MPEG Video Compression—Ver. 4.0,” 99 pp., document marked Dec. 16, 2003.
Anandan et al., “Hierarchical Model-Based Motion Estimation,” Kluwer Academic Publishers, Boston, pp. 1-22 (1993).
Barron et al., “Performance of Optical Flow Techniques,”IJCV, vol. 12, No. 1, pp. 43-77 (1994).
Beauchemin et al., “The Computation of Optical Flow,”ACM Computing Surveys, vol. 27, No. 3, pp. 433-467 (1995).
Bugwadia et al., “Progressive-Scan Rate Up-Conversion of 24/30 Hz Source Materials for HDTV,”IEEE Transactions on Consumer Electronics, vol. 42, No. 3, pp. 312-321 (1996).
Cafforio et al., “Motion Compensated Image Interpolation,”IEEE Transactions on Communication, vol. 38, No. 2, pp. 215-222 (1990).
Chang et al., “Simultaneous Motion Estimation and Segmentation,”IEEE Transactions on Image Processing, vol. 6, No. 9, pp. 1326-1333 (1997).
Efstratiadis et al., “Motion Field Prediction and Restoration for Low Bit-Rate Video Coding,”Proc. 2nd International Conference on Image Processing(ICIP 95), 4 pp. (Oct. 1995).
Ghosal et al., “A Fast Scalable Algorithm for Discontinuous Optical Flow Estimation,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, No. 2, pp. 181-194 (1996).
Guleryuz, “Iterated Denoising for Image Recovery,”IEEE, 10 pp. (marked Apr. 2002).
Hendriks et al., “Recursive Disparity Estimation Algorithm for Real Time Stereoscopic Video Applications,”IEEE International Conference on Image Processing, pp. 891-894 (Sep. 1996).
Ebrahimi, “MPEG-4 Video Verification Model: A Video Encoding/Decoding Algorithm Based on Content Representation,” 30 pp. (1997).
ISO/IEC, “ISO/IEC 11172-2, Information Technology—Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to About 1.5 Mbit/s—Part 2: Video,” 112 pp. (1993).
ISO/IEC, “JTC1/SC29/WG11 N2202, Information Technology—Coding of Audio-Visual Objects: Visual, ISO/IEC 14496-2,” 329 pp. (1998).
ITU-T, “ITU-T Recommendation H.261, Video Codec for Audiovisual Services at p x 64 kbits,” 25 pp. (1993).
ITU-T, “ITU-T Recommendation H.262, Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video,” 205 pp. (1995).
ITU-T, “ITU-T Recommendation H.263, Video Coding for Low Bit Rate Communication,” 162 pp. (1998).
“JPEG Image Coding Standard,” 23 pp. [Downloaded from the World Wide Web on Feb. 23, 2004].
Sullivan et al., “The H.264/AVC Advanced Video Coding Standard: Overview and Introduction to the Fidelity Range Extensions,” 21 pp. (Aug. 2004).
Horn et al., “Determining Optical Flow,”Artificial Intelligence, pp. 185-203 (1980).
Kim et al., “Local motion-adaptive interpolation technique based on block matching algorithms,”Signal Processing: Image Communication, vol. 4, pp. 519-528 (1992).
Krishnamurthy et al., “Frame Interpolation and Bidirectional Prediction of Video using Compactly-Encoded Optical Flow Fields and Label Fields,”IEEE Transactions for Circuits and Systems for Video Technology, 30 pp. (1996).
Lucas et al., “An Iterative Image Registration Technique with an Application to Stereo Vision,”Proceedings of Imaging Understanding Workshop, pp. 121-130 (1981).
Martins, “Real-time Video Frame Rate Adaptation Based on Warping of Edge-Preserving Meshes,”ICIP, pp. 948-952 (1999).
Morimoto et al., “Automatic Digital Image Stabilization,”Proc. of IEEE International Conference on Pattern Recognition, Vienna, Austria, 6 pp. (Aug. 1996).
Ribas-Corbera et al., “Interframe Interpolation of Cinematic Sequences,”Journal of Visual Communication and Image Representation, vol. 4, No. 4, pp. 392-406 (1993).
Simoncelli, “Bayesian Multi-Scale Differential Optical Flow,”Differential Formulation, pp. 397-422 (1998).
Stiller et al., “Estimating Motion in Image Sequences, A tutorial on modeling and computation of 2D motion,”IEEE Signal Processing, 36 pp. (1999).
Thoma et al., “Motion Compensating Interpolation Considering Covered and Uncovered Background,”Signal Processing: Image Communication, vol. 1, pp. 191-212 (1989).
Tubaro et al., “Motion Field Estimators and their Application to Image Interpolation,”Motion Analysis and Image Sequence Processing, Kluwer Academic Publishers, Chapter 6, pp. 153-187 (1993).
Zhang et al., “Piecewise linear motion-adaptive interpolation,”Signal Processing: Image Communication, vol. 4, pp. 93-99 (1991).
DynalPel Systems, Inc., materials downloaded from World Wide Web, 20 pp. (downloaded from World Wide Web on Feb. 18, 2005).
Avid Technology, Inc., materials downloaded from World Wide Web, 11 pp. (downloaded from World Wide Web on Feb. 18, 2005).
An Shawn
Klarquist & Sparkman, LLP
Microsoft Corporation
LandOfFree
Increasing motion smoothness using frame interpolation with... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Increasing motion smoothness using frame interpolation with..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Increasing motion smoothness using frame interpolation with... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4006308