Patent
1995-02-03
1998-01-13
Jankus, Almis R.
395155, G06T 900
Patent
active
057087679
ABSTRACT:
A new technique for extracting a hierarchical decomposition of a complex video selection for browsing purposes, combines visual and temporal information to capture the important relations within a scene and between scenes in a video, thus allowing the analysis of the underlying story structure with no a priori knowledge of the content. A general model of hierarchical scene transition graph is applied to an implementation for browsing. Video shots are first identified and a collection of key frames is used to represent each video segment. These collections are then classified according to gross visual information. A platform is built on which the video is presented as directed graphs to the user, with each category of video shots represented by a node and each edge denoting a temporal relationship between categories. The analysis and processing of video is carried out directly on the compressed videos. Preliminary tests show that the narrative structure of a video selection can be effectively captured using this technique.
REFERENCES:
patent: 5231487 (1993-07-01), Hurley et al.
patent: 5329596 (1994-07-01), Sakou et al.
Arman et al. "Image Processing on Compressed Data For Large Video Databases".
B. Liu, W. Wolf, S. Kulkarni, A. Wolfe, H. Kobayashi, F. Greenstein, I. Fuschs, A. Hsu, F. Arman, and Y. Liang, "The Princeton video library of politics", in Proceedings, Digital Libraries '94, pp. 215-216, Texas A&M University, 1994.
S. Gauch, R. Aust, J. Evans, J. Gauch, G. Minden, D. Niehaus, and J. Roberts, "The digital video library system: Vision and design", in Proceedings, Digital Libraries '94,pp. 47-52, Texas A&M University, 1994.
H.J. Zhang, A. Kankanhalli, and S.W. Smoliar, "Automatic partitioning of full-motion video", Multimedia Systems, vol. 1, pp. 10-28, Jul. 1993.
F. Arman, A. Hsu, and M.Y. Chiu, "Image processing on compressed data for large video databases", in Proceedings of First ACM International Conference on Multimedia, pp. 267-272, Aug. 1993.
B.L. Yeo and B. Liu, "Rapid scene analysis on compressed videos", submitted to IEEE Transactions on Circuits and Systems for Video Technology, (Unpublished).
F. Arman, R. Depommier, A. Hsu, and M.Y. Chiu, "Content-based browsing of video sequences", in ACM Multimedia 94, pp. 97-103, Aug. 1994.
D. Swanberg, C.F. Shu, and R. Jain, "Knowledge guided parsing in video databases", in Storage and Retrieval for Image and Video Databases, vol. SPIE 1908, pp. 13-25, 1993.
S.W. Smoliar and H.J. Zhang, "Content-based video indexing and retrieval", IEEE Multimedia, pp. 62-72, 1994.
M.J. Swain and D.H. Ballard, "Color Indexing", International Journal of Computer Vision, vol. 7, pp. 11-32, 1991.
N.K. Hu, "Visual pattern recognition by moment invariants", IRE Transactions on Information Theory, pp. 179-187, 1962.
A.K. Jain and R. C. Dubes, Algorithms for Clustering Data, Prentice Hall, pp. 71-89, 1988.
Laszlo Szirmay-Kalos, "Dynamic layout algorithm to display general graphs", in Paul Heckbert, editor, Graphics Gems IV, pp. 505-517. Academic Press, Boston, 1994.
Liu Bede
Wolf Wayne
Yeo Boon-Lock
Yeung Minerva M.
Jankus Almis R.
The Trustees of Princeton University
LandOfFree
Method and apparatus for video browsing based on content and str does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for video browsing based on content and str, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for video browsing based on content and str will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-332771