Television – Two-way video and voice communication – Conferencing
Reexamination Certificate
2000-01-13
2001-10-09
Chan, Wing F. (Department: 2758)
Television
Two-way video and voice communication
Conferencing
C348S014120, C379S202010
Reexamination Certificate
active
06300973
ABSTRACT:
BACKGROUND
In video communication, e.g., video conferencing, Multipoint Control Units (“MCU's”) serve as switches and conference builders for the network. The MCU's receive multiple audio/video streams from the various users' terminals, or codecs, and transmit to the various users' terminals audio/video streams that correspond to the desired signal at the users' stations. In some cases, where the MCU serves as a switchboard, the transmitted stream to the end terminal is a simple stream from a single other user. In other cases, it is a combined “conference” stream composed of a combination of several users' streams.
An important function of the MCU is to translate the input streams into the desired output streams from all and to all codecs. One aspect of this “translation” is a modification of the bit-rate between the original stream and the output stream. This rate matching modification can be achieved, for example, by changing the frame rate, the spatial resolution, or the quantization accuracy of the corresponding video. The output bit-rate, and thus the modified factor used to achieve the output bit rate, can be different for different users, even for the same input stream. For instance, in a four party conference, one of the parties may be operating at 128 Kbps, another at 256 Kbps, and two others at T1. Each party needs to receive the transmission at the appropriate bit rate. The same principles apply to “translation,” or transcoding, between parameters that vary between codecs, e.g., different coding standards like H.261/H263; different input resolutions; and different maximal frame rates in the input streams.
Another use of the MCU can be to construct an output stream that combines several input streams. This option, sometimes called “compositing” or “continuous presence,” allows a user at a remote terminal to observe, simultaneously, several other participants in the conference. The choice of these participants can vary among different users at different remote terminals of the conference. In this situation, the amount of bits allocated to each participant can also vary, and may depend on the on screen activity of the users, on the specific resolution given to the participant, or some other criterion.
All of this elaborate processing, e.g., transcoding and continuous presence processing, must be done under the constraint that the input streams are already compressed by a known compression method, usually based on a standard like ITU's H.261 or H.263. These standards, as well as other video compression standards like MPEG, are generally based on a Discrete Cosine Transform (“DCT”) process wherein the blocks of the image (video frame) are transformed, and the resulting transform coefficients are quantized and coded.
One prior art method first decompresses the video streams; performs the required combination, bridging and image construction; and finally re-compresses for transmission. This method requires high computation power, leads to degradation in the resulting video quality and suffers from large propagation delay. One of the most computation intensive portions of the prior art methods is the encoding portion of the operation where such things as motion vectors and DCT coefficients have to be generated so as to take advantage of spatial and temporal redundancies. For instance, to take advantage of spatial redundancies in the video picture, the DCT function can be performed. To generate DCT coefficients, each frame of the picture is broken into blocks and the discrete cosine transform function is performed upon each block. In order to take advantage of temporal redundancies, motion vectors can be generated. To generate motion vectors, consecutive frames are compared to each other in an attempt to discern pattern movement from one frame to the next. As would be expected, these computations require a great deal of computing power.
In order to reduce computation complexity and increase quality, others have searched for methods of performing such operations in a more efficient manner. Proposals have included operating in the transform domain on motion compensated, DCT compressed video signals by removing the motion compensation portion and compositing in the DCT transform domain.
Therefore, a method is needed for performing the “translation” operations of an MCU, such as modifying bit rates, frame rates, and compression algorithms in an efficient manner that reduces propagation delays, degradation in signal quality, video bandwidth use within the MCU and computational complexity.
SUMMARY
The present invention relates to an improved method of processing multimedia/video data in an MCU. By reusing information embedded in a compressed video stream received from an endpoint, the MCU can reduce the total computations needed to process the video data before resending it to the endpoint.
REFERENCES:
patent: 5408274 (1995-04-01), Chang et al.
patent: 5453780 (1995-09-01), Chen et al.
patent: 5563882 (1996-10-01), Bruno et al.
patent: 5600646 (1997-02-01), Polomski
patent: 5680392 (1997-10-01), Semaan
patent: 5684527 (1997-11-01), Terui et al.
patent: 5708732 (1998-01-01), Merhav et al.
patent: 5751338 (1998-05-01), Ludwig, Jr.
patent: 5796434 (1998-08-01), Lempel
patent: 5832135 (1998-11-01), Bhaskaran
patent: 5862329 (1999-01-01), Aras et al.
patent: 5872922 (1999-02-01), Hogan et al.
patent: 5951637 (1999-09-01), Kuzma
patent: 5961589 (1999-10-01), Hansen
patent: 5963547 (1999-10-01), O'Neil et al.
EZENIA—Encounter™—Innovative technology, award-winning products.
Eisenberg Aviv
Elbaz Moshe
Eshkoli Noam
Feder Meir
Yona Ilan
LandOfFree
Method and system for multimedia communication control does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and system for multimedia communication control, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for multimedia communication control will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2580195