Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
2000-04-19
2002-12-10
Lee, Richard (Department: 2613)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
Reexamination Certificate
active
06493388
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates to rate control and buffer management during coding of digital video programs. In particular, the invention discusses rate control and buffer protection issues for transmitting multiple VBR (variable bit rate) video programs over a constant-rate channel.
In a multi-program transmission environment, several programs (e.g., channels) are coded, multiplexed and transmitted over a single communication channel. Since these programs share a limited channel capacity, the aggregate bit rate of the programs must be no greater than the communication channel rate. This can be achieved by controlling either each individual program bit rate using independent coding, or the aggregate bit rate using statistical multiplexing, also known as joint coding.
Moreover, video materials such as films and the like may be pre-compressed and stored for subsequent transmission. This presents difficulties when the stat mux attempts to integrate the pre-compressed program bit streams with the raw, uncompressed digital video sequences.
Additionally, it is necessary to ensure that the encoder and decoder buffers do not overflow or underflow.
Accordingly, it would be desirable to have a rate control and buffer protection system that addresses the above and other concerns. The system should be compatible with dynamic bit allocation strategies for joint coding of multiple video programs which assign a target bit rate for each program on a frame-by-frame basis according to the program's relative complexity. The system should pre-determine the transmission rates of future frames so that the average input rate of each individual video stream to the respective decoder buffer is equal to the average output rate, and the total transmission rate of all programs is equal to the channel rate. The system should enable the upper and lower bonds of the encoder and decoder buffers to be measurable at the encoding end at the current frame instant.
The present invention provides a rate control and buffer protection system that provides the above and other advantages.
SUMMARY OF THE INVENTION
The present invention relates to rate control and buffer management during coding of digital video programs.
A system is presented for rate control and buffer management during coding of multiple variable bit rate digital video programs over a constant bit rate channel. Buffer fullness is modeled on a frame-by-frame basis. Buffer protection is achieved by applying additional constraints on the target rates. For encoder buffer protection, we set the upper and lower bounds for the aggregate rate of programs. For decoder buffer protection, we limit the dynamic range of each individual program rate. Both the upper and lower bounds are time-varying functions (i.e., on a frame-by-frame basis). We also pre-set the future transmission rates so that the average input rate of each individual video stream to the respective decoder buffer is equal to the average output rate, and the total transmission rate of programs is equal to the channel rate. With the pre-settings of future transmission rates for the above two conditions, the upper and lower bounds for decoder buffer protection become measurable at the current frame instant, which allows decoder buffer protection to be managed at the encoding end. The system is suitable for use in a hierarchical bit allocation scheme that includes a super group of pictures (GOP) level, a super frame level, and a frame level.
A particular method for coding a plurality L of variable bit rate video programs includes the step of allocating bits for coding the video programs according to a hierarchical scheme that includes at least: (a) a super group of pictures (GOP) level, wherein a super GOP comprises at least one GOP from each of the video programs, and has a length of N frames, and (b) a frame level. For each lth program, a transmission rate is set for the respective current nth frame according to an average number of compressed bits for at least N previous frames, including a frame starting at N′+N−1 frames before the current frame, a frame ending at N′ frames before the current frame, and intermediate frames therebetween. N′ is a decoding delay of a modeled decoder that receives a respective video program.
As an example, with a super GOP length of N=45 frames, and a decoding delay of N′=15 frames, the transmission rate may be set based on an average number of compressed bits for 45 previous frames, including a frame starting at 59 frames before the current frame, and a frame ending at 15 frames before the current frame.
A corresponding apparatus is also presented.
REFERENCES:
patent: 5216503 (1993-06-01), Paik et al.
patent: 5502494 (1996-03-01), Auld
patent: 5506844 (1996-04-01), Rao
patent: 5708664 (1998-01-01), Budge et al.
patent: 5805220 (1998-09-01), Keesman et al.
patent: 5963256 (1999-10-01), Tahara
patent: 6038256 (2000-03-01), Linzer et al.
patent: 6151362 (2000-11-01), Wang
patent: 6167084 (2000-12-01), Wang et al.
patent: 6208759 (2001-03-01), Wells
patent: 6243417 (2001-06-01), Obikane et al.
patent: WO 97/47128 (1997-12-01), None
patent: WO 00/13419 (2000-03-01), None
Wang, Limin et al., “Bit Allocation for Joint Coding of Multiple Video Programs,” SPIE VCIP, vol. 3024, pp. 149-158, Feb. 1997.
Test Model 5, ISO/IECJTC1/SC29/WG11, Document AVC-491, Apr. 1993, pp. 61-65.
Wang, Limin et al., “Bit Allocation and Constraints for Joint Coding of Multiple Video Programs,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 6, Sep. 1999, pp. 949-959.
Hong, Sung-Hoon et. al., “Joint Video Coding of MPEG-2, Video Programs for Digital Broadcasting Services,” IEEE Transactions on Broadcasting, vol. 44, No. 2, Jun. 1998, pp. 153-164.
Koo, Irene et al., “Joint MPEG-2 Coding for Multi-Program Broadcasting of Per-Recorded Video,” 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing, Mar. 1999, XP-02180780, pp. 2227-2230.
Sorial, Hani Z. et al., “Joint Transcoding of Multiple MPEG Video Bitstreams,” IEEE International Symposium on Circuits and Systems, May 30-Jun. 2, 1999, XP-002174270, pp. 251-254.
General Instrument Corporation
Lee Richard
Lipsitz Barry R.
LandOfFree
Rate control and buffer protection for variable bit rate... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Rate control and buffer protection for variable bit rate..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Rate control and buffer protection for variable bit rate... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2932469