Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
2001-01-26
2004-11-30
An, Shawn S. (Department: 2613)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
C375S240020, C375S240040, C375S240050, C375S240120, C375S240200, C382S232000, C382S236000, C382S238000, C382S239000, C382S250000
Reexamination Certificate
active
06826228
ABSTRACT:
TECHNICAL FIELD
The present invention relates to a method and apparatus for encoding video sequences. In particular, the present invention relates to a method and apparatus for quantization step size determination for compression of video signals.
BACKGROUND ART
Methods for encoding moving pictures or video had been developed for efficient transmission and storage. A current art of such encoding methods is found in MPEG2 Test Model 5, ISO/IEC JTC1/SC29/WG11/NO400, April 1993, and the disclosure of that document is hereby expressly incorporated herein by reference. In this method, an input video sequence is organized into sequence layer, group-of-pictures, pictures, slices, macroblocks, and finally block layer. Each picture in a group-of-pictures will be coded according to its determined picture coding type.
The picture coding types used in the MPEG2 Test Model 5 include intra-coded picture (I-picture), predictive-coded picture (P-picture), and bi-directionally predictive-coded picture (B-picture). The I-pictures are used mainly for random access or scene update. The P-pictures use forward motion predictive coding with reference to previously coded I- or P-pictures (anchor pictures), and the B-pictures use both forward and backward motion predictive/interpolative coding with reference to previously coded I- or P-pictures. A group of pictures (GOP) is formed in encoded order starting with an I-picture and ending with the picture before the next I-picture in the sequence.
A picture is partitioned into smaller and non-overlapping blocks of pixel data called macroblocks (MB) before encoding. Each MB from a P- or B-picture is subjected to a motion estimation process in which forward motion vectors, and backward motion vectors for the case of a B-picture MB, are determined using reference pictures from a frame buffer. With the determined motion vectors, motion compensation is performed where in the intra- or inter-picture prediction mode of the MB is first determined according to the accuracy of the motion vectors found, followed by generating the necessary predicted MB.
The predicted MB is then subjected to discrete cosine transform (DCT) and quantization of the DCT coefficients based on quantization matrices and quantization step-size. The quantized DCT coefficients of the MB is then run-length encoded with variable length codes (VLC) and multiplexed with additional information such as selected motion vectors, MB coding modes, quantization step-size, and/or picture and sequence information, to form the output bitstream.
Local decoding is performed by inverse quantizing the quantized DCT coefficients, followed by inverse DCT, and motion compensation. Local decoding is performed such that the reference pictures used in the motion compensation are identical to those used by any external decoder.
The quantization step-size (QS) used for quantizing the DCT coefficients of each MB has direct impact on the number of bits produced at the output of run-length VLC encoding process, and therefore the average output bit rate. It has also a direct impact on the encoding quality, which represents the output picture quality at the corresponding decoder. In general, larger QS generates lower output bit rate and lower encoding quality. In order to control output bit rate and picture quality so that the resulting bitstream can satisfy channel bandwidth or storage limitation as well as quality requirements, rate control and quantization control algorithms are used.
Some methods for rate control and quantization control can be found in the above mentioned MPEG-2 Test Model 5. These methods comprise generally a bit allocation process, a rate control process, and an adaptive quantization process. In the bit allocation process, a target number of bits is assigned for a new picture to be coded according to a number of previously determined and pre-set parameters. The rate control step then calculates a reference quantization step-size for each MB based on the target bits for the picture and the number of bits already used from the target bits in encoding MBs from that picture. In the adaptive quantization process, the calculated reference quantization step-size is scaled according to local activities of the MB, and an average MB activity determined from the current or a previously coded picture. This scaling is done according to a level of masking effects of coding noise by human perception for MB with high or low activities within a picture. A video buffer verifier (VBV) may also be employed in such a way that underflow and overflow of the decoder input buffer are prevented as required by the MPEG standard to ensure a target bit rate is maintained.
Coding efficiency, which can be measured in terms of bit-rate saving or encoding picture quality improvement, is a key design issue for video encoder systems. An improvement in coding efficiency will have a large impact in communication or storage costs saving in a long run.
While various methods for enhancing coding efficiency may be developed, it is necessary to consider their impacts on implementation cost in particular when the systems are to be broadly used. Furthermore, it is desired that such methods for encoding should not introduce incompatibility problems inter-operating with decoders that are known to date (for example the MPEG video decoders).
SUMMARY OF THE INVENTION
It is therefore an object of the present invention to provide a method or apparatus for use in a video encoder to enhance its coding efficiency.
In accordance with the present invention, there is provided a video encoder for encoding sequences of images comprising intra-coding pictures and predictive-coding pictures into an encoded output bitstream, including:
an encoding processor for encoding each image of a sequence by partitioning, the image in to a plurality of macroblocks, performing necessary motion compensation and estimation and an orthogonal transform on each macroblock, and quantizing the transform coefficients according to a quantization step-size for incorporation in the output bitstream;
a conditional masking processor which is adapted to process macroblocks of predictive coding pictures to determine if each macroblock belongs to a significant motion or scene update region of the corresponding image based upon a comparison of a prediction activity of the macroblock and an average prediction activity for a previously coded picture, and determine a conditional masking factor based on the determination, the conditional masking processor including a prediction activity averaging processor for determining an average prediction activity for a previously encoded image; and
a quantization step-size processor coupled to receive the conditional masking factor from the conditional masking processor and generate a quantization step-size value, based on a reference quantization step-size and the conditional masking factor, for use by the encoding processor in encoding each macroblock;
wherein the predictive-coding pictures of the pictures of the image sequence include mono-directional predictive coding pictures (P-pictures) and bi-directional predictive coding pictures (B-pictures), and wherein the prediction activity averaging processor determines an average prediction activity for each type of predictive coding picture and wherein for a macroblock from a P-picture, a value for the conditional masking factor is selected by said conditional masking processor from between first and second values according to a comparison between the macroblock prediction activity and the P-picture average prediction activity, and wherein for a macroblock from a B-picture, a value for the conditional masking factor is selected by said conditional masking processor from between third and fourth values according to a comparison between the macroblock prediction activity and the B-picture average prediction activity.
The present invention also provides a method for use in video encoding for encoding sequences of images comprising intra-coding pictures and predictive-coding pictures into an encoded output
An Shawn S.
Iannucci Robert
Jorgenson Lisa K.
Seed IP Law Group PLLC
STMicroelectronics Asia Pacific (PTE) Ltd.
LandOfFree
Conditional masking for video encoder does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Conditional masking for video encoder, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Conditional masking for video encoder will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3329599