Signal processor

Details Signal processor Signal processor

2000-08-25

2003-03-04

Diep, Nhon (Department: 2613)

Pulse or digital communications

Bandwidth reduction or expansion

Television or motion video signal

C386S349000, C348S705000

Reexamination Certificate

active

06529555

ABSTRACT:

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a signal processor. The invention concerns joining, referred to herein as splicing, digital bit streams which are compressed. Embodiments of the invention described herein are concerned with splicing digital video bitstreams which are compressed according to the MPEG-2 standard.
2. Description of the Prior Art
The invention and its background will be discussed by way of example with reference to MPEG-2 video bitstreams. However the invention is not limited to MPEG-2.
MPEG-2 is well known from for example ISO/IEC/13818-2, and will not be described in detail herein. Splicing of video is well known. Splicing analogue signals is relatively straight forward and can be done at the boundary between adjacent frames, because each analogue frame contains the whole of the video information of that frame independently of other frames. Splicing can be done similarly in the digital domain for both compressed and uncompressed video data if all frames contain the whole video information of the frame.
MPEG-2 compressed video comprises groups of I, P and/or B frames known as GOPs, Groups of Pictures. I, P and B frames are well known. An I or Intra-encoded frame contains all the information of the frame independently of any other frame. A P frame in a GOP ultimately depends on an I frame and may depend on other P frames. A B frame of a GOP ultimately depends on an I-frame and may depend on P frames in the GOP. A B frame must not depend on another B frame.
A GOP typically comprises 12 or 15 frames comprising at least one I frame and several P and B frames. To correctly decode a GOP requires all the frames of the GOP, because a large part of the video information required to decode a B frame in the GOP is in a preceding and/or succeeding frame of the GOP. Likewise a large part of the video information required to decode a P frame is in a preceding frame of the GOP.
Thus if two different bit streams are spliced together in the compressed domain, the information necessary to decode frames each side of the splice point is likely to be lost.
Many papers have been written concerning the splicing of compressed bitstreams,.which is a well known problem in MPEG. A paper “Flexible Switching and editing of MPEG-2 Video Bitstreams” by P. J. Brightwell, S. J. Dancer and M. J. Knee was published in “Atlantic Technical Papers 1996/1997” the preface to which is dated September 1997.
The paper discusses the problems of splicing MPEG-2 Video Bitstreams. Two bitstreams A and B to be spliced are decoded in respective decoders. A coder is switched from the decoder of A to the decoder of B at the splicing point. It discloses that near a splicing point where a bitstream A is replaced by a bitstream B, the following modifications are made. “The picture type may be changed to provide a more suitable refresh strategy around the switch point. In the example below, the first P-frame in bitstream B after the switch is converted to an I-frame to provide a full refresh early in the new scene. Also, bitstream A contains an I-frame just before the switch point—as this is unnecessary, it is recoded as a P-frame to save bits.
Switch point
bitstream A:
P
B
B
I
|
—
bitstream B:
—
|
B
P
B
B
P
B
B
P
modified
P
B
B
P
|
B
I
B
B
P
B
B
P
Prediction modes and motion vectors may require modification to take into account any changes in the picture type on recoding, or to prevent any predictions being made across the switch on recoding. In the example above, macroblocks that originally used forward or bi-directional prediction for the B-frame following the switch point will be recoded using intra mode and backward prediction respectively. In addition, vectors are required for the I-frame that is recoded as a P-frame—these can be estimated from the vectors in surrounding frames, or taken from I-frame concealment vectors that many MPEG-2 bitstreams carry.
The quantisation parameters will be changed as part of the recoder's rate control strategy. As in a conventional coder, this aims to control the buffer trajectory of a downstream decoder to prevent under- or overflow, and to maintain the picture quality as high as possible. In addition, the rate control algorithm for the ATLANTIC switch uses the vbv_delay values in bitstreams A an B (which are carried in the info-bus) to make the buffer trajectory for the switched bitstream identical to that for bitstream B (i.e. the one being switched to) at some future time. Depending on the relative vbv_delay values, this may happen soon after the switch, or a recovery period of a few GOPs may be required. When it has been achieved, the recoder's quantisation parameters are locked to those of bitstream B, and the switch becomes transparent.
The quantisation parameters may also be changed to take advantage of effect know as temporal masking. This refers to the eye's inability to see moderate or even large amounts of noise around a scene change—typically 5 dB of degradation in the frame after the switch cannot be seen—and allows the number of bits used for the frames very close to the switch point to be reduced, allowing a shorter recovery period.”
“Vbv-delay values” are measures of the number of bits in the buffer of the down stream decoder. The manner in which the “buffer trajectory” for the switched bitstream is made identical to that for bitstream B is not disclosed in the paper. Also the time scale over which that happens may be “soon after the switch” or after a few GOPs.
As mentioned above, splicing can be done in the digital domain for a compressed bitstream if all frames contain the whole video information of the frame. Thus for MPEG, it has been proposed to edit compressed bitstreams containing only I frames: that is becoming standard practice in studios for ease of editing.
The present invention proposes converting two bit streams to be spliced, and comprising for example GOPs of 12 or 15 frames, to all I-frames, splicing the I-frames of the two bitstreams; and then re-encoding the spliced bitstreams as GOPs of I and P and/or B frames.
Converting all frames whether I, P and/or B to I frames for splicing and reconverting them to I, P and B frames after splicing results in a loss of picture quality.
It is desired to maintain picture quality as high as possible.
SUMMARY OF THE INVENTION
In accordance with the present invention, there is provided a signal processor for splicing a compressed video bitstream A
0
to a compressed video bitstream B
0
to form a compressed bitstream C, the bitstreams A
0
, B
0
and C having GOPs including I frames and P and/or B frames, the processing comprising first and second inputs (A
0
, B
0
) for receiving the bitstreams A
0
and B
0
respectively, first means for re-encoding the GOPs of the bitstreams A
0
and B
0
, re-encoded bitstreams A
I
and B
I
, respectively having GOPs including only I frames, the transcoding parameters of the frames of the bitstreams A
0
and B
0
being retained unchanged in association with the corresponding I frames of the bitstreams A
I
and B
I
,
means for splicing bitstream B
I
to bitstream A
I
at a splice point (SPLICE), to produce a spliced I-frame bitstream, (A
I
/B
I
)
second means for re-encoding the spliced I-frame bitstream (A
I,
/B
I
) as the compressed bitstream for supply to a downstream decoder having a downstream buffer wherein the value of occupancy of the downstream buffer by the bitstream C is controlled over a transition region having a transitional GOP including the splice point (SPLICE) so that the said value of occupancy changes over the duration of the transition region from that of stream A
0
to that of stream B
0
, and
wherein the frames of the bitstream A
I
before the transition region are re-encoded re-using the transcoding parameters of the corresponding frames of the bitstream A
0
, and the frames of the bitstream B
I
after the transition region are re-encoded re-using the transcoding parameters of the corresponding frames of the bitstreams B
0
.
By reusing the encoding parameters of

Affiliated with

Also associated with

Rating

Signal processor does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Signal processor, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Signal processor will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3025029