Motion video signal processing for recording or reproducing – Local trick play processing – With randomly accessible medium
Reexamination Certificate
2000-07-18
2004-10-19
Tran, Thai (Department: 2615)
Motion video signal processing for recording or reproducing
Local trick play processing
With randomly accessible medium
C386S349000, C386S349000, C360S015000
Reexamination Certificate
active
06807362
ABSTRACT:
BACKGROUND OF THE INVENTION
Video cameras are becoming increasing popular for both home and office use. Video is commonly used to document family events such as vacations, weddings, and graduations. In the office, video cameras are used to record presentations and user studies, and are often taken on business trips to record people, places, and meetings. Further, the use of Digital Video (DV), a digital camcorder format, is burgeoning due to the combination of high-quality digital video, inexpensive video capture cards and hard disk drives, and public interest in creating video content for the World Wide Web.
However, the problem is that it is difficult to make use of this video after it has been recorded. While people may view the video they recorded once or twice, it is typically left “in the bag,” since interesting portions are often intermixed with longer, less interesting portions. The video is often of poor quality stemming from, for example, abrupt camera movements or video segments that are too long to hold the viewer's interest. Further, interesting portions may be difficult to find using only fast forward and rewind, particularly when the desired portion is short relative to the rest of the video or when different portions of the video are of interest to different peoples
While video editing tools exist (e.g., Adobe Premier or In-Sync's Speed Razor) these tools are quite difficult for an amateur to use. Simpler video editing tools, such as Apple's iMovie, Ulead Systems' VideoStudio, or JavuNetwork, make it easy to select video takes and arrange them in a storyboard. However, none of these systems perform video analysis in order to provide intelligent editing assistance. In particular, most of these systems provide no assistance for selecting the in and out points necessary to trim the takes and, thus, a user must manually examine the video on a frame-by-frame basis and manually trim undesirable material from the takes. This task is difficult even with the simpler editing tools.
Accordingly, there is a need for an interactive video creation system and method for analyzing and composing video that does not require manual selection of the start and end points for each video clip. There is a further need for a simple, intuitive user interface for adjusting the total length of the edited video and for modifying the length of individual video clips by the application of a set of heuristic editing rules that emphasizes high quality video clips over low quality video clips.
SUMMARY OF THE INVENTION
The present invention, roughly described, provides a system and method for editing recorded video to produce a final output video that automatically determines the video in and out points required for cutting while automatically lengthening or shortening the lengths of individual clips in response to user-specified changes to the final length of the final output video in such a way that high quality video clips having low unsuitability scores are emphasized over low quality video clips having high unsuitability scores.
The method for editing recorded video that automatically determines the video in and out points required for cutting while automatically lengthening or shortening the lengths of individual clips in response to user-specified changes to the final length of the final output video comprises the steps of (1) computing an unsuitability score for time intervals of the recorded video; (2) segmenting the recorded video into video clips having in out clip boundaries based on the suitability score; and (3) trimming the clips, wherein respective clips are associated with a metaphorical spring having a spring strength.
The heuristically derived unsuitability score is computed and used as an input for metaphorical springs in which each selected video clip of the recorded video is associated with a metaphorical spring that maintains the selected clip at an optimal length while being responsive to a global system spring whose spring strength determines the final length of the final output video.
These and other objects and advantages of the invention will appear more clearly from the following detailed description in which the preferred embodiment of the invention has been set forth in conjunction with the drawings.
REFERENCES:
patent: 5521841 (1996-05-01), Arman et al.
patent: 6327418 (2001-12-01), Barton
patent: 6553178 (2003-04-01), Abecassis
patent: 6567980 (2003-05-01), Jain et al.
patent: 6631522 (2003-10-01), Erdelyi
patent: 2003/0189588 (2003-10-01), Girgensohn
patent: 2003/0190143 (2003-10-01), Girgensohn
Lienhart, R., “Dynamic Video Summarization of Home Video,”SPIE 3972: Storage and Retrieval for Media Databases 2000, pp. 378-389, 2000.
Smith, J.M., Stotts, D. and Kum, S.-U., “An Orthogonal Taxanomy For Hyperlink Anchor Generation in Video Streams Using OvalTine,”Proc. Of ACM Hypertext 2000, pp. 11-18, 2000.
Uchihashi, S., Foote, J., Girgensohn, A. and Boreczky, J., “Video Manga: Generating Semantically Meaningful Video Summaries,”Proceedings of ACM Multimedia '99, pp. 383-392.
Boissière, G., “Automatic creation of hypervideo news libraries for the World Wide Web,”Hypertext '98 Proceedings, ACM, Pittsburgh, PA, 1998.
Yeung, M.M., and Yeo, B.-L., “Video Visualization for Compact Presentation and Fast Browsing of Pictorial Content,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, No. 5, Oct. 1997.
Zhang, H.J., et al., “Automatic Parsing and Indexing of News Video,”Multimedia Systems, 2 (6), pp. 256-266, 1995.
Avrahami, G., Brooks, K.P., and Brown, M.H. “A Two-View Approach to Constructing User Interfaces,” ACM SIGGRAPH '89.
Boreczky, J. and Wilcox L. “A Hidden Markov Model Framework for Video Segmentation Using Audio and Image Features,” inProc ICASSP '98, IEEE, May 1998, Seattle.
Boreczky, J. and Rowe, L. “Comparison of Video Shot Boundary Detection Techniques,” Proc. SPIE Storage and Retrieval for Image and Video Databases IV, San Jose, CA, 1996.
Christal, M., Smith, M., Taylor, C. and Winkler, D., “Evolving Video Skims into Useful Multimedia Abstractions,” in Human Factors in Computing Systems, CHI 98 Conference Proceedings (Los Angeles, CA), New York: ACM, pp. 171-178, 1998.
Girgensohn, A. and Boreczky, J. “Time-Constrained Keyframe Selection Technique,” in IEEE Multimedia Systems '99, IEEE Computer Society, vol. 1, pp. 756-761, 1999.
He, L., Sanocki, E., Gupta, A., Grudin, J. “Auto-Summarization of Audio-Video Presentation,” ACM Multimedia, Nov. 1999.
Knuth, D.,The TEXbook , Addison Wesley, 1984.
Pfeiffer, S., Lienhart, R., Fischer, S. and Effelsberg, W., “Abstracting Digital Movies Automatically,” in Journal of Visual Communication and Image Representation 7(4), pp. 345-353, Dec. 1996.
Russell, D. “A Design Pattern-Based Video Summarization Technique: Moving from Low-Level Signals to High-Level Structures” HICCS 2000.
Smith, M. and Kanade, T., “Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques,” in Proc. Computer Vision and Pattern Recognition, pp. 775-781, 1997.
Uchihashi, S. and Foote, J., “Summarizing Video Using a Shot Importance Measure and a Frame-Packing Algorithm,” in Proc. ICASSP '99, vol. 6, pp. 3041-3044, 1999.
Webster, B.F.The NeXT Book, Addison-Wesley, 1989.
Boreczky John S.
Chiu Patrick
Doherty John J.
Girgensohn Andreas
Wilcox Lynn D.
Fliesler & Meyer LLP
Fuji 'Xerox Co., Ltd.
Onuaku Christopher
Tran Thai
LandOfFree
System and method for determining video clip boundaries for... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for determining video clip boundaries for..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for determining video clip boundaries for... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3266088