Image analysis – Image transformation or preprocessing
Reexamination Certificate
2006-09-05
2006-09-05
Couso, Yon J. (Department: 2624)
Image analysis
Image transformation or preprocessing
C382S293000, C382S300000
Reexamination Certificate
active
07103231
ABSTRACT:
Two images are analyzed to compute a set of motion vectors that describes motion between the first and second images. A motion vector is computed for each pixel in an image at a time between the first and second images. This set of motion vectors may be defined at any time between the first and second images, such as the midpoint. The motion vectors may be computed using any of several techniques. An example technique is based on the constant brightness constraint, also referred to as optical flow. Each vector is specified at a pixel center in an image defined at the time between the first and second images. The vectors may point to points in the first and second images that are not on pixel centers. The motion vectors are used to warp the first and second images to a point in time of an output image between the first and second images using a factor that represents the time between the first and second image at which the output image occurs. The warped images are then blended using this factor to obtain the output image at the desired point in time between the first and second images. The point in time at which the output image occurs may be different from the time at which the motion vectors are determined. The same motion vectors may be used to determine two or more output images at different times between the first and second images. The images may be warped using a technique in which many small triangles are defined in an image corresponding in time to the point in time between the first and second images at which the motion vectors are determined. A transform for each small triangle from the point in time at which the motion vectors are determined to the desired interpolated image time is determined, e.g., the triangle is warped using the motion vectors associated with its vertices. For each pixel in each triangle in the output image, corresponding points in the first and second images are determined, and the first and second images are spatially sampled at these points. These samples for each pixel are combined to produce a value for that pixel in the output image.
REFERENCES:
patent: 4924310 (1990-05-01), von Brandt
patent: 5182633 (1993-01-01), Antonio et al.
patent: 5353119 (1994-10-01), Dorricott et al.
patent: 5369443 (1994-11-01), Woodham
patent: 5410358 (1995-04-01), Shackleton et al.
patent: 5438423 (1995-08-01), Lynch et al.
patent: 5469226 (1995-11-01), David et al.
patent: 5568200 (1996-10-01), Pearlstein et al.
patent: 5579054 (1996-11-01), Sezan et al.
patent: 5594676 (1997-01-01), Greggain et al.
patent: 5608464 (1997-03-01), Woodham
patent: 5642170 (1997-06-01), Hackett et al.
patent: 5654771 (1997-08-01), Tekalp et al.
patent: 5657402 (1997-08-01), Bender et al.
patent: 5668914 (1997-09-01), Inuiya et al.
patent: 5673207 (1997-09-01), Nomura
patent: 5727080 (1998-03-01), Cox et al.
patent: 5748761 (1998-05-01), Chang et al.
patent: 5802220 (1998-09-01), Black et al.
patent: 5850229 (1998-12-01), Edelsbrunner et al.
patent: 5880788 (1999-03-01), Bregler
patent: 5920657 (1999-07-01), Bender et al.
patent: 5929919 (1999-07-01), DeHaan et al.
patent: 5940145 (1999-08-01), Burl
patent: 5943445 (1999-08-01), Dufaux
patent: 5973733 (1999-10-01), Gove
patent: 5982389 (1999-11-01), Guenter et al.
patent: 5982440 (1999-11-01), Aoki
patent: 5991459 (1999-11-01), Fogel
patent: 5999662 (1999-12-01), Burt et al.
patent: 6005625 (1999-12-01), Yokoyama
patent: 6005626 (1999-12-01), Ding
patent: 6016152 (2000-01-01), Dickie
patent: 6026195 (2000-02-01), Eifrig et al.
patent: 6037988 (2000-03-01), Gu et al.
patent: 6075818 (2000-06-01), Thomson
patent: 6081606 (2000-06-01), Hansen et al.
patent: 6088393 (2000-07-01), Knee et al.
patent: 6157747 (2000-12-01), Szeliski et al.
patent: 6160586 (2000-12-01), Justiss et al.
patent: 6246961 (2001-06-01), Sasaki et al.
patent: 6250928 (2001-06-01), Poggio et al.
patent: 6262776 (2001-07-01), Griffits
patent: 6292589 (2001-09-01), Chow et al.
patent: 6370196 (2002-04-01), Griessl et al.
patent: 6477279 (2002-11-01), Go
patent: 6480670 (2002-11-01), Hatano et al.
patent: 6526183 (2003-02-01), Bonnet et al.
patent: 6570624 (2003-05-01), Cornog et al.
patent: 6628715 (2003-09-01), Iu et al.
patent: 6665450 (2003-12-01), Cornog et al.
patent: 6728312 (2004-04-01), Whitford et al.
patent: 6937659 (2005-08-01), Nguyen et al.
patent: 2002/0154792 (2002-10-01), Cornog et al.
patent: 2002/0159749 (2002-10-01), Kobilansky et al.
Agrawala, Maneesh, et al., “Model-Based Motion Estimation for Synthetic Animations”, ACM Multimedia 95 Electroni Proceedings, Nov. 5-9, 1995, pp. 1-25.
Barron, J.L., et al., “Performance of Optical Flow Techniques”, IJCV 12:1, 1994, pp. 1-60.
Beauchemin, S.S., et al., “The Computation of Optical Flow”, ACM Computing Surveys, vol. 27, No. 3, Sep. 1995, pp. 433-467.
Bergen, James R., et al., “Hierarchial Model-Based Motion Estimation”, Proc. Euro. Conf. on Comp. Vision, Springer-Verlag, 1992, pp. 237-252.
Bergen, James R., et al., “Hierarchial Motion-Based Frame Rate Conversion”, David Sarnoff Research Center, Princeton, NJ, Apr. 1990, pp. 1-15.
Buxton, B.F., et al., “Computation of optic flow from the motion of edge features in image sequences”, Image and Vision Computing, vol. 2, No. 2, May 1984, pp. 59-75.
Chen, Shenchange Eric., et al., “View Interpolation for Image Synthesis”, Proc. SIGGRAPH 1993, pp. 279-288.
Ezzat, Tony et al., “Visual Speech Synthesis by Morphing Visemes”, Massachusetts Institute Of Technology, A.I. Memo No. 1658, CBCL Paper no. 173, May 1999, pp. 1-12.
Flomo Data Sheet, Time-warping software, Aug. 2000, 2 pages.
Gomes et al., “Time Warping of Audio Signals”, in Proc. Comp. Graph. International (CGI 99), Jul. 1999, pp. 52-57.
Liu, Hongehe, et al., Accuracy vs. Efficiency Trade-offs in Optical Flow Algorithms:, Proc. 4thEur. Conf. on Comp. Vision, Apr. 1996, vol. II, pp. 174-183.
Louchet, Jean, et al. “Building new tools for Synthetic Image Animation by using Evolutionary Techniques”, Artificial Evolution '95. Proc. of the EA95 Workshop in Brest, France, Sep. 1995.
Lucas, Bruce, et al., “an Iterative image Registration Technique with an Application to Stereo Vision”, Proc. 7thInt'l. Jt.Conf. on A1, 1981, pp. 674-679.
Teodosio, Laura, et al., “Salient Video Stills: Content and Context Preserved”, Proc. 1stInt'l Conf. on Multimedia, Aug. 1993, pp. 39-46.
Schodl, Arno, et al., “Video Textures”, Proc. SIGGRAPH 2000, 2000, pp. 489-498.
Bouthemy, P., “A Maximum Likelihood Framework for Determining Moving Edges”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. II, May 1989, pp. 499-511.
Marshall, David, “Optical Flow Printout”, http://www.cs.cf.ac.uk/Dave/Vision—lecture
ode45.html.
Cornog Katherine H.
Dickie Garth A.
Fasciano Peter J.
Fayan Randy M.
Gonsalves Robert A.
Avid Technology Inc.
Couso Yon J.
Gordon Peter J.
LandOfFree
Interpolation of a sequence of images using motion analysis does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Interpolation of a sequence of images using motion analysis, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Interpolation of a sequence of images using motion analysis will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3553003