Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
2000-06-09
2003-10-28
Le, Vu (Department: 2613)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
C375S240190
Reexamination Certificate
active
06639943
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention generally relates to video coding, and more particularly to a fine granular coding technique that includes both quality and temporal scalability.
Fine-granular-scalability (FGS) has been used to compress video for transmission over networks that have a varying bandwidth such as the Internet. Examples of such FGS structures are shown in
FIGS. 1A-1B
and
2
A-
2
B. As can be seen, these structures consist of a base-layer coded at a bit-rate R
BL
and a single fine-granular enhancement layer coded at R
EL
However, in
FIGS. 1A-1B
, the base layer has been encoded to include just I and P frames, while in
FIGS. 2A-2B
the base layer has been encoded to include I, P and B frames.
Due to the fine granularity of the enhancement layer, a FGS video stream can be transmitted over any network session with an available bandwidth ranging from B
min
=R
BL
to B
max
=R
BL
+R
EL
. For example, if the available bandwidth between the transmitter and the receiver is B=R, then the transmitter sends the base-layer at the rate R
BL
and only a portion of the enhancement layer at the rate R
e
=R−R
BL
. As can be seen from
FIGS. 1B and 2B
, portions of the enhancement layer can be selected in a fin granular manner for transmission. Therefore, the total transmitted bit-rate is R=R
BL
+R
e
.
Due to its flexibility in supporting a wide range of transmission bandwidth with a single enhancement layer, the FGS framework has been adopted by the ISO MPEG-4 standard. An example a system utilizing a FGS-based encoder is shown in FIG.
3
. The system includes a network
6
with a variable available bandwidth in the range of (B
min
=R
min
, B
max
=R
max
). A calculation block
4
is also included for estimating or measuring the current available bandwidth (R). A base layer (BL) video encoder
8
compresses the signal from the video source
2
using a bit-rate (R
BL
) in the range (R
min
, R). Typically, the base layer encoder
8
compresses the signal using the minimum bit-rate (R
min
). This is especially the case when the BL encoding takes place off-line prior to the time of transmitting the video signal. As can be seen, a unit
10
is also included for computing the residual images
12
. Further, an enhancement layer (EL) encoder
14
compresses the residual signal with a bit-rate R
EL
, which can be in the range of R
BL
to R
max
−R
BL
. It is important to note that the encoding of the video signal (both enhancement and base layers) can take place either in real-time (as implied by the figure) or off-line prior to the time of transmission. In the latter case, the video can be stored and then transmitted (or streamed) at a later time using a real-time rate controller
16
, as shown. The real time controller
16
selects the best quality enhancement layer signal taking into consideration the current (real-time) available bandwidth R. Therefore, the output bit-rate of the EL signal from the rate controller equals, R−R
BL
.
SUMMARY OF THE INVENTION
The present invention is directed to fine granular scalability coding technique that includes both quality and temporal scalability. In one example of coding the video data according to the present invention, a portion of the video data is coded to produce base layer frames. Motion compensated residual images are produced from the video data and the base layer frames. The motion compensated residual images are coded using a fine granular coding technique to produce temporal enhancement frames. Further, residual images are generated from the video data and the base layer frames. The residual images are then coded also using a fine granular coding technique to produce quality enhancement frames. The temporal enhancement frames and the quality enhancement frames-also can be combined into an enhancement layer.
In another example of coding video data according to the present invention, a portion of the video data is coded to produce base layer frames. Motion compensated residual images are generated from the video data and the base layer frames. The motion compensated residual images are coded to produce temporal enhancement frames. Residual images are generated from the video data, the base layer frames and the temporal enhancement frames. The residual images are then coded using a fine granular coding technique to produce quality enhancement frames. Further, the temporal enhancement frames form a temporal enhancement layer and the quality enhancement frames form a quality enhancement layer.
In one example of decoding a video signal including a base layer and an enhancement layer according to the present invention, the base layer is decoded to produce video frames. The enhancement layer is also decoded to produce motion vectors. Motion compensation is then performed on the video frames according to the motion vectors to produce additional video frames. The video frames and the additional video frames are the combined into a video sequence. Further, the enhancement layer is decoded to produce enhanced video frames. Each of the enhanced video frames is added to one of the video frames and additional video frames.
REFERENCES:
patent: 5001561 (1991-03-01), Haskell et al.
patent: 5218435 (1993-06-01), Lim et al.
patent: 5742892 (1998-04-01), Chaddha
patent: 5852565 (1998-12-01), Demos
patent: 5963257 (1999-10-01), Katata et al.
patent: 5973755 (1999-10-01), Gabriel
patent: 6057884 (2000-05-01), Chen et al.
patent: 6173013 (2001-01-01), Suzuki et al.
patent: 6229850 (2001-05-01), Linzer et al.
patent: 6263022 (2001-07-01), Chen et al.
patent: 6292512 (2001-09-01), Radha et al.
patent: 6480547 (2002-11-01), Chen et al.
patent: 6501797 (2002-12-01), van der Schaar et al.
patent: 6501860 (2002-12-01), Charrier et al.
patent: 2001/0024470 (2001-09-01), Radha et al.
patent: 2002/0051488 (2002-05-01), Shipeng
patent: 2002/0118750 (2002-08-01), Yagasaki et al.
patent: 0644695 (1995-03-01), None
patent: 0644695 (1995-03-01), None
patent: 0771119 (1997-05-01), None
patent: 0771119 (1997-05-01), None
patent: 0579395 (1998-09-01), None
patent: 0869620 (1998-10-01), None
patent: 0884850 (1998-12-01), None
patent: WO9933274 (1999-07-01), None
patent: 0005898 (2000-02-01), None
Morrison et al., “Two-layer video coding for ATM networks”, Signal Processing: Image Communications 3, pp. 179-195, 1991.*
Radha H et al.: “Scalable Internet Video Using MPEG-R”, Sep. 1999, pp. 95-126.
Vial J.F.: “Motion Compensation in DCT-Domain for Scalable Coding with Fine Granularity”, ITG Fachberichte, VDE Verlag, Berlin, DE, No 143, 1997, pp. 485-489, XP000965452.
Van Der Schaar M et al.: “Scalable MPEG-4 Video Coding Graceful Packet-Loss Resilience over Bandwidth-Varying Networks” Jul. 30, 2000, pp. 1487-1490 vol. 3, XP000981416.
Chen Yingwei
Radha Hayder
Van Der Schaar Mihaela
Gross Russell
Le Vu
LandOfFree
Hybrid temporal-SNR fine granular scalability video coding does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Hybrid temporal-SNR fine granular scalability video coding, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Hybrid temporal-SNR fine granular scalability video coding will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3135833