Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
2001-03-29
2004-05-04
Diep, Nhon (Department: 2613)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
C348S699000
Reexamination Certificate
active
06731684
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates to video compression, and more particularly to a method and apparatus for detecting scene changes and adjusting the picture coding type to optimize the coding efficiency of a video encoder. The invention is particularly useful for picture coding type decision and scene change detection in a digital HDTV encoder.
Aligning intra-coded (I) frames with scene changes can significantly improve the coding efficiency of an MPEG (Moving Picture Expert's Group) video encoder. In the past, such scene change detection has been provided, for example, by detecting variations in luminance values.
In some existing scene change detection proposals, the coding of an I-frame is avoided until the scene change is over and a new GOP (group of pictures) is started. However, scene change detection is performed on a frame-by-frame basis. Therefore, this approach can yield incorrect results where there are bad edits, special effects or camera flashes, where the scene change might occur on the odd/even field boundary of the same frame.
Accordingly, it would be advantageous to provide a system for detecting scene changes, including flashes, or bad fields that result from improper editing, and adjusting the picture coding type without the aforementioned problems encountered by the prior art. It would be further advantageous to better optimize the coding efficiency of a video encoder during scene changes. It would also be desirable to provide an efficient system for scheduling a new GOP based on the detection of a scene change. Moreover, the system should detect scene changes between successive fields.
The system should make use of an encoding processing pipeline architecture that provides the required lookahead delay to avoid issuing a scheduled I-frame at the proximity of a scene change, while minimizing the amount of frame buffer memory required to provide the lookahead capability.
The scheme should be compatible with different HDTV modes/pixel resolutions, including 1920×1080 I (interlaced scan), 1440×1080 I, and 1280×720 p (progressive scan), as well as standard definition (SDTV) video.
The system should be compatible with any digital video coding scheme, including MPEG-2.
The system should inhibit the encoding of I-frames when an encoder buffer level is too high.
The system should provide a watchdog counter that resets the scene change indication to avoid a perpetual scene change state for transitions from still to motion.
For an MPEG film mode frame picture that is determined to be a scene change frame, to improve coding accuracy and efficiency, the system should deactivate the MPEG-recommended frame-based Discrete Cosine Transform (DCT) and prediction encoding when a scene change may have occurred on a field boundary.
The present invention provides a scene change and adjustment scheme having the aforementioned and other advantages.
SUMMARY OF THE INVENTION
The present invention relates to an efficient video compression scheme that detects scene changes between successive fields, including flashes, or bad fields that result from improper editing, and adjusts the picture coding type and GOP boundaries in response thereto. The term “scene change” is thus used generally herein to encompass events including a normal scene change (at a frame boundary), a scene change at a field boundary of the same frame, a bad edit or flash, or any other sudden change in a sequence of video images.
In accordance with the present invention, scene change detection is performed at a preprocessing stage of a video encoder. The final decision to encode a frame as an I- or P-frame is not made until a final encoding stage. That is, the encoder's processing pipeline is used as a lookahead buffer to minimize the amount of required frame buffer memory.
In particular, the preprocessing stage of the video encoder calculates a change in the sum of pixel differences between consecutive odd fields, or consecutive even fields, for every consecutive input field. A scene change is then detected by looking for a large positive value (exceeding a positive threshold) in the change in sum, followed by a large negative value (less than a negative threshold) I-frames are inhibited at the encoding stage of the processing pipeline as soon as a scene change is detected. A new GOP is started when a scene change frame arrives at the encoding stage of the pipeline, and there is no other scene change frame in the pipeline.
A scene change counter is used to keep track of the number of uncoded scene change frames currently in the processing pipeline. I-frames are prohibited for as long as the scene change counter has a value greater than zero, except for the last scene change frame in a burst (succession) of scene change frames.
Additionally, a, scene change countdown counter, or “watchdog” counter, is used to account for a transition from a still frame to a motion frame to ensure that a scene change is not set permanently.
Moreover, for an MPEG film mode picture that is determined to be a scene change frame, the MPEG-recommended frame-based Discrete Cosine Transform (DCT) and prediction encoding is deactivated when a scene change is indicated at a field boundary (e.g., when there is no redundant field in the picture). Upon such deactivation, either frame- or field-based DCT and prediction can be use on a macroblock-by-macroblock basis in the picture. This allows field prediction to be used to handle bad edits where a scene change may occur at the odd/even field boundary of the same frame.
The invention is suitable for use with both high definition television (HDTV) encoders and standard definition television (SDTV) encoders.
REFERENCES:
patent: 5343248 (1994-08-01), Fujinami
patent: 5500689 (1996-03-01), Lam
patent: 5508750 (1996-04-01), Hewlett
patent: 5686963 (1997-11-01), Uz et al.
patent: 5734419 (1998-03-01), Botsford, III et al.
patent: 5751378 (1998-05-01), Chen et al.
patent: 5771316 (1998-06-01), Uz
patent: 5832121 (1998-11-01), Ando
patent: 5899575 (1999-05-01), Okayama
patent: 5909252 (1999-06-01), Ueda et al.
patent: 5923376 (1999-07-01), Pullen et al.
patent: 6044115 (2000-03-01), Horiike et al.
patent: 6084641 (2000-07-01), Wu
patent: 6091776 (2000-07-01), Linzer
patent: 6408024 (2002-06-01), Nagao et al.
patent: 6434196 (2002-08-01), Sethuraman et al.
patent: 6587506 (2003-07-01), Noridomi et al.
patent: 0554086 (1993-08-01), None
patent: 0708564 (1996-04-01), None
patent: 9739577 (1997-10-01), None
“Scene change detection in GA encoder”, published in digitalHDTV Grand Alliance System Record of Test Results, Jun. 28, 1995.
Advanced Television Systems Committee Standard A/54, “Guide to the Use of the ATSC Digital Television Standard”, Oct. 4, 1995.
ISO/IEC 13818-2, “Generic Coding of Moving Picutures and Associated Audio: Video”, (MPEG2 Standard) 1995 E.
Diep Nhon
General Instrument Corporation
Lipsitz Barry R.
McAllister Douglas M.
LandOfFree
Method and apparatus for detecting scene changes and... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for detecting scene changes and..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for detecting scene changes and... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3234871