Motion video signal processing for recording or reproducing – Local trick play processing – With randomly accessible medium
Reexamination Certificate
1999-12-30
2004-07-20
Boccio, Vincent (Department: 2615)
Motion video signal processing for recording or reproducing
Local trick play processing
With randomly accessible medium
C348S700000, C386S349000
Reexamination Certificate
active
06766098
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention is in general related to an apparatus that detects scene changes in a source video and selects representative keyframes from each scene. The present invention in particular relates to determining whether a detected scene change is in actuality a scene change or whether a fast motion scene caused a false detection of a scene change.
2. Description of the Prior Art
Users will often record home videos or record television programs, movies, concerts, sports events, etc. on a tape, hard disk or other storage medium for later or repeated viewing. Often, a video will have varied content or be of great length. However, a user may not write down what is recorded on a storage medium and may not remember what she recorded or where on the storage medium particular scenes, movies, events are recorded. Thus, a user may have to sit and view, for example, an entire tape to remember what is on the tape.
Video content analysis uses automatic and semi-automatic methods to extract information that describes content of the recorded material. Video content indexing and analysis extracts structure and meaning from visual cues in the video. Generally, a video clip is taken from a TV program, the Internet or a home video by selecting frames which reflect the different scenes in a video.
In a video indexing scene change detection system described in PHA 23,252, U.S. Ser. No. 08/867,140 a video indexing system is described wherein frames are compared to one another to detect large differences between the frames. If a large difference exists, it is assumed that a scene change has occurred between the two frames. Once the scene change is found, a keyframe is chosen from each scene and the keyframes are arranged to provide a video index. The problem with this system is that during a scene where there is fast motion, such as a car chase scene, the object moving across the scene (e.g. the car) may move from the left hand portion of the frame to the right hand portion of the frame during a plurality of sequential frames. When these frames are compared to each other the prior art system detects a scene change after each frame and selects each frame as a keyframe, when in fact, all frames are from the same scene.
Similarly in PHA 23,477, U.S. Ser. No. 09/123,444 a commercial detection system is disclosed which detects commercials by counting the number of scene changes detected within a time period (“cut rate”). Typically commercials have high cut rates and therefore the cut rate can be used to locate and delete commercials from video. If it is determined that the number of scene changes detected during a certain time period is above a certain threshold then it is assumed that a commercial has been detected. The problem with such a system is that a fast motion scene will also have a high cut rate and will be detected as a commercial and possibly deleted from the video.
SUMMARY OF THE PRESENT INVENTION
Accordingly, a system is desired which will create a visual index for a video source that was previously recorded or while being recorded, which is useable and more accurate in selecting significant keyframes, while providing a useable amount of information for a user. This system will detect scene changes and select a key frame from each scene but ignore the detection of scene changes and the selection of key frames where scene changes are detected consecutively after each frame.
It is an object of the invention to compare two frames of a video to detect a scene change, if consecutive scene changes are detected after each frame for a plurality of frames then it is determined that these scene changes are due to fast motion in the video rather than being true scene changes.
It is another object of the invention to count the number of consecutive scene changes to keep track of the length of the sequence of frames having scene cringes detected after each consecutive frame. At the end of this sequence which contains consecutive scene changes, it is determined that all frames within the sequence are part of the same fast motion scene and only one key frame is selected from the sequence.
It is another object of the invention to distinguish fast motion scenes from commercials by analyzing high cut rate video to determine if scene changes occur after each frame.
REFERENCES:
patent: 4409615 (1983-10-01), McMann, Jr. et al.
patent: 5508750 (1996-04-01), Hewlett et al.
patent: 5642294 (1997-06-01), Taniguchi et al.
patent: 5708480 (1998-01-01), Bromba et al.
patent: 5719643 (1998-02-01), Nakajima
patent: 5731835 (1998-03-01), Kuchibholta
patent: 5732146 (1998-03-01), Yamada et al.
patent: 5751378 (1998-05-01), Chen et al.
patent: 5767922 (1998-06-01), Zabih et al.
patent: 5835163 (1998-11-01), Liou et al.
patent: 6055025 (2000-04-01), Shahraray
patent: 6137544 (2000-10-01), Dimitrova et al.
patent: 6252975 (2001-06-01), Bozdagi et al.
patent: 6415056 (2002-07-01), Boon
patent: 6417887 (2002-07-01), Yamaji
patent: 6466697 (2002-10-01), Boon
patent: 0472806 (1992-03-01), None
patent: 9823085 (1998-05-01), None
“Motion Analysis and Image Sequence Processing”, by M. Ibramin Sezal et al., Kluwer Academic Publishers, Boston/London 1993, pp. 1-52 and 89-124.
Dimitrova Nevenka
McGee Thomas
Boccio Vincent
Fletcher James A
Gathman Laurie E.
Koninklijke Philip Electronics N.V.
LandOfFree
Method and apparatus for detecting fast motion scenes does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for detecting fast motion scenes, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for detecting fast motion scenes will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3217479