Video structuring by probabilistic merging of video segments

Details Video structuring by probabilistic merging of video segments Video structuring by probabilistic merging of video segments

2007-11-13

2007-11-13

Lo, Weilun (Department: 2179)

Data processing: presentation processing of document, operator i

Operator interface

On screen video or audio system interface

C348S584000, C348S598000, C382S236000, C382S272000, C382S284000

Reexamination Certificate

active

09927041

ABSTRACT:
A method for structuring video by probabilistic merging of video segments includes the steps of obtaining a plurality of frames of unstructured video; generating video segments from the unstructured video by detecting shot boundaries based on color dissimilarity between consecutive frames; extracting a feature set by processing pairs of segments for visual dissimilarity and their temporal relationship, thereby generating an inter-segment visual dissimilarity feature and an inter-segment temporal relationship feature; and merging video segments with a merging criterion that applies a probabilistic analysis to the feature set, thereby generating a merging sequence representing the video structure. The probabilistic analysis follows a Bayesian formulation and the merging sequence is represented in a hierarchical tree structure.

REFERENCES:
patent: 5664227 (1997-09-01), Mauldin et al.
patent: 5805733 (1998-09-01), Wang et al.
patent: 5821945 (1998-10-01), Yeo et al.
patent: 5828809 (1998-10-01), Chang et al.
patent: 5956026 (1999-09-01), Ratakonda
patent: 5963653 (1999-10-01), McNary et al.
patent: 5969755 (1999-10-01), Courtney
patent: 5995095 (1999-11-01), Ratakonda
patent: 6008847 (1999-12-01), Bauchspies
patent: 6249285 (2001-06-01), Madden et al.
patent: 6263103 (2001-07-01), Freeman et al.
patent: 6373979 (2002-04-01), Wang
patent: 6489989 (2002-12-01), Shapiro et al.
patent: 6535639 (2003-03-01), Uchihachi et al.
patent: 6616529 (2003-09-01), Qian et al.
patent: 6642940 (2003-11-01), Dakss et al.
patent: 6721454 (2004-04-01), Qian et al.
patent: 2002/0157116 (2002-10-01), Jasinschi
patent: 1 067 800 (2001-01-01), None
patent: WO 98/21688 (1998-05-01), None
“Image Analysis and Mathematical Morphology”, Serra, Jean, vol. 1, Academic Press, 1982.
“AutoAlbum: Clustering Digital Photographs using Probabilistic Model Merging”, Platt, John, Microsoft, (c) 2000, IEEE.
“Video Object Model and Segmentation for Content-Based Video Indexing”, Zhong, D. and Chang, S.-F. Jun. 1997, IEEE Intern. Conf. on Circuits and Systems.
“Bayesian Modeling of Video Edting and Structure: Semantic Features for Video Summarization and Browising”, Vasoncelos, Nuno and Lippman, Andrew. 1998, CiteSeer.IST Home.
“Abstracting Home Video Automatically” by Rainer Lienhart. ACM Multimedia Conference, Orlando, Oct. 1999, pp. 37-41.
“Content-Based Browsing and Editing of Unstructured Video” by Giridharan Iyengar and Andrew B. Lippman. IEEE ICME, New York City, Aug. 2000.
“Maximum Likelihood from Incomplete Data via the EM Algorithm” by A.P. Dempster, N. M. Laird and D.B. Rubin. Journal of the Royal Statistical Society, Series B, 39:1-38, 1977.
“A Unified Framework for Video Browsing and Retrieval” by Y. Rui and T.S. Huang in A.C. Bovic, Ed.,Handbook of Image and Video Processing, Academic Press, 1999.
“Extensive Operators in Partition Lattices for Image Sequence Analysis” by L. Garrido, P. Salembier, D. Garcia. Sign. Proc., 66(2): 157-180, 1998.
“The Theory and Practice of Bayesian Image Labeling”, by C. Chou and C. Brown, IJCV, 1, pp. 185-210, 1990.
“Binary Partition Tree as an Efficient Representation for Filtering, Segmentation, and Information Retrieval” by P. Salembier and L. Garrido, IEEE Intl. Conference on Image Processing, ICIP 098, Chicago, Illinois, Oct. 4-7, 1998.
“Modeling by Shortest Data Description” by J. Rissanen,Automatica, 14: 465-471, 1978.
“Binary Partition Tree as an Efficient Representation for Filtering, Segmentation, and Information Retrieval” by P. Salembier and L. Garrido. IEEE Intl. Conference on Image Processing, ICIP '98, Chicago, Illinois, Oct. 4-7, 1998.
“Performance Characterizaiton of Video-Shot-Change Detection Methods” by Ullas Gargi, Rangachar Kasturi, and Susan H. Strayer, IEEE CSVT, vol. 10, No. 1, Feb. 2000, pp. 1-13.
“A Bayesian Video Modeling Framework for Shot Segmentation and Content Characterization” by Nuno Vasconcelos and Andrew Lippman. Proc. CVPR, 1997, pp. 59-66.

Affiliated with

Also associated with

Rating

Video structuring by probabilistic merging of video segments does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Video structuring by probabilistic merging of video segments, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Video structuring by probabilistic merging of video segments will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3873139