Image analysis – Image transformation or preprocessing – Combining image portions
Reexamination Certificate
2005-08-04
2008-12-02
Ahmed, Samir A (Department: 2624)
Image analysis
Image transformation or preprocessing
Combining image portions
C382S276000, C382S294000, C707SE17028
Reexamination Certificate
active
07460730
ABSTRACT:
A “Keyframe Stitcher” provides an efficient technique for building mosaic panoramic images by registering or aligning video frames to construct a mosaic panoramic representation. Matching of image pairs is performed by extracting feature points from every image frame and matching those points between image pairs. Further, the Keyframe Stitcher preserves accuracy of image stitching when matching image pairs by utilizing ordering information inherent in the video. The cost of searching for matches between image frames is reduced by identifying “keyframes” based on computed image-to-image overlap. Keyframes are then matched to all other keyframes, but intermediate image frames are only matched to temporally neighboring keyframes and neighboring intermediate frames to construct a “match structure.” Image orientations are then estimated from this match structure and used to construct the mosaic. Matches between image pairs may be compressed to reduce computational overhead by replacing groups of feature points with representative measurements.
REFERENCES:
patent: 5594676 (1997-01-01), Greggain
patent: 5649032 (1997-07-01), Burt et al.
patent: 6011558 (2000-01-01), Hsieh
patent: 6097854 (2000-08-01), Szeliski et al.
patent: 6157747 (2000-12-01), Szeliski et al.
patent: 6246413 (2001-06-01), Teo
patent: 6259826 (2001-07-01), Pollard et al.
patent: 6393054 (2002-05-01), Altunbasak
patent: 6559846 (2003-05-01), Uyttendaele
patent: 6597801 (2003-07-01), Cham et al.
patent: 6636216 (2003-10-01), Silverbrook
patent: 6677981 (2004-01-01), Mancuso
patent: 6701030 (2004-03-01), Uyttendaele
patent: 6813391 (2004-11-01), Uyttendaele
patent: 6985620 (2006-01-01), Sawhney et al.
patent: 2002/0113805 (2002-08-01), Li
patent: 2002/0140829 (2002-10-01), Colavin
patent: 2003/0194149 (2003-10-01), Sobel et al.
patent: 2004/0114799 (2004-06-01), Xu
patent: 2004/0233274 (2004-11-01), Uyttendaele
patent: 2006/0120624 (2006-06-01), Jojic et al.
patent: WO9739420 (1997-10-01), None
Brown; Lowe. Recognizing panoramas. In Ninth International Conference on Computer Vision (ICCV'03), pp. 1218-1225, Nice, France, Oct. 2003.
Brown; Szeliski; Winder. Multi-Scale Oriented Patches. Microsoft Technical Report MSR-TR-2004-133, Dec. 2004.
Szeliski. Image alignment and stitching. In N. Paragios et al., editors, Handbook of Mathematical Models in Computer Vision, pp. 273-292. Springer, 2005.
Debevec; Malik. Recovering high dynamic range radiance maps from photographs. pp. 369-378, Aug. 1997.
Irani; Anandian. Video indexing based on mosaic representations. Proceedings of IEEE, May 1998.
Li; Randhawa. 2004. Improved video mosaic construction by selecting a suitable subset of video images. In Proceedings of the 27th Australasian Conference on Computer Science—vol. 26 (Dunedin, New Zealand). Estivill-Castro, Ed. ACM International Conference Proceeding Series, vol. 56. Australian Computer Society; Darlinghurst, Australia, 143-149.
Irani; Hsu; Anandan. “Mosaic Based Representation of Video Sequences and Their Applications,” IEEE Proc. Int'l Conf. Computer Vision, pp. 605-611, Jun. 1995.
Irani, Peleg. Improving resolution by image registration. Graphical Models and Image Proc., May 1991.
Irani; Rousso; Peleg. Recovery of ego-motion using image stabilization. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 454-460, Jun. 1994.
Kang; Uyttendaele; Winder; Szeliski. High dynamic range video. ACM Trans. Graph., 22(3):319-325, 2003.
Kang; Weiss. Characterization of errors in compositing panoramic images. Computer Vision and Image Understanding, 73(2):269-280, Feb. 1999.
Koch; Pollefeys; Heigl; Gool; Niemann. Calibration of Hand-held Camera Sequences for Plenoptic Modeling. In Proceedings of the 7th International Conference on Computer Vision (ICCV), pp. 585-591, Corfu, Sep. 1999. IEEE Computer Society Press.
Mann; Picard. Virtual bellows: Constructing high-quality images from video. In First IEEE International Conference on Image Processing (ICIP-94),Austin, TX, pp. 363-367, 1994.
Massey; Bender. Salient stills: Process and practice. IBM Systems Journal, 35(3&4):557-573, 1996.
Nistér. Frame decimation for structure and motion. In Proc. 2nd Workshop on Structure from Multiple Images of Large Environments (SMILE2000) Springer Lecture Notes on Computer Science, 2018:17-34, 2001.
Peleg; Herman. Panoramic mosaics by manifold projection. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'97), pp. 338-343, San Juan, Puerto Rico, Jun. 1997.
Sawhney; Gendel, Bergen; Dixon; Paragano. Videobrush: Experiences with consumer video mosaicing. Proc. IEEE Work-shop on Applications Computer Vision (WACV), pp. 56-62, 1998.
Sawhney; Hsu; Kumar. Robust video mosaicing through topology inference and local to global alignment. In Fifth European Conference on Computer Vision (ECCV'98), pp. 103-119, Freiburg, Germany, Jun. 1998. Springer-Verlag.
Schödl; Szeliski; Salesin; Essa. Video textures. In Computer Graphics (SIGGRAPH'2000 Proceedings), pp. 489-498, New Orleans, Jul. 2000. ACM SIGGRAPH.
Szeliski. Video mosaics for virtual environments. IEEE Computer Graphics and Applications, 16(2):22-30, 1996.
Szeliski; Shum. Creating full view panoramic image mosaics and environment maps. In Proc. of SIGGRAPH, pp. 251-258, 1997.
Triggs; McLauchlan; Hartley; Fitzgibbon. Bundle adjustment—a modern synthesis. In International Workshop on Vision Algorithms, pp. 298-372, Kerkyra, Greece, Sep. 1999. Springer.
Zhu; Hanson; Schultz; Stolle; Riseman. Stereo mosaics from a moving video camera for environmental monitoring, Int. Workshop on Digital and Computational Video, 1999, Tampa, Florida, pp. 45-54.
Pal Chris
Steedly Drew
Szeliski Richard
Ahmed Samir A
Koziol Stephen R
Lyon & Harr LLP
Microsoft Corporation
Watson Mark A.
LandOfFree
Video registration and image sequence stitching does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Video registration and image sequence stitching, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Video registration and image sequence stitching will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4039413