Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
2000-07-31
2001-05-15
Britton, Howard (Department: 2613)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
C348S700000, C348S701000, C375S240260, C386S349000, C386S349000
Reexamination Certificate
active
06233278
ABSTRACT:
The present invention relates to an apparatus and concomitant method for optimizing video encoding. More particularly, this invention relates to a method and apparatus that performs pre-processing on an incoming or pre-recorded image sequence to extract “side information” that is then used to improve the subsequent coding of the incoming or prerecorded image sequence.
BACKGROUND OF THE INVENTION
The increasing demand for digital video/audio information presents an ever increasing problem of transmitting and/or storing an enormous amount of information. With limited transmission bandwidth, codecs (coder/decoders) are often employed to cleverly compress the input data into encoded bitstreams, thereby increasing the overall amount of transmitted information.
For example, the Moving Picture Experts Group (MPEG) created the ISO/IEC international Standards 11172 and 13818 (generally referred to as MPEG-1 and MPEG-2 format respectively) to establish a standard for various coding/decoding strategies. Although these MPEG standards specify a general coding methodology and syntax for generating an MPEG compliant bitstream, many variations are permitted to accommodate a plurality of different applications and services such as desktop video publishing, video conferencing, digital storage media and television broadcast.
As such, various novel MPEG codec inventions have been developed to address the needs of different applications. These inventions generally address different coding parameters such as coding mode decisions, rate control, motion estimation/compensation, selection of frame type and the like. These inventions can incorporate very powerful coding methods with capability to analyze the content of the image sequence to deduce various information about the image sequence, e.g., motion information, scene changes and the like. Thus, the resulting codecs are often complex and computationally expensive to implement.
With the implementation of video-on-demand applications, the video source, e.g., a movie, may be repeatedly transmitted to different viewers. Each transmission of the movie often requires the use of an encoder to compress the movie for efficient transmission via a communication channel having a predefined transmission bandwidth. Since the transmission bandwidth and other transmission parameters may change in real time, e.g., high viewing time period versus low viewing time period, the encoder may have to encode the same movie differently for each transmission, i.e., adjusting various coding parameters to accommodate the current transmission parameters.
Unfortunately, some encoders may not be able to adjust the coding parameters properly in light of changing transmission parameters or unusual video content, e.g., scene changes or a series of very complex frames. Furthermore, it would be desirable to reduce the computational cycles of an encoder which is used repeatedly to code the same image sequence, e.g., a movie.
Thus, if information concerning the image sequence (“side information”), e.g., the location of scene cuts, the complexity of a particular frame, the motion information for the frames and the like, can be deduced in advance, such side information can be made available to the encoder to assist the encoder in adjusting a set of coding parameters that will best address a particular transmission or storage environment.
Therefore, a need exists in the art for an apparatus and method that provides “side information” that can be inserted with the image sequence or forwarded directly to the encoder to assist in optimizing the coding of the image sequence.
SUMMARY OF THE INVENTION
The present invention is a method and apparatus for pre-processing an image sequence to extract side information concerning the image sequence. In one embodiment, the side information is then inserted into the image sequence, such that upon being encoded at a later time, the encoder can utilize the side information to best select one or more coding parameters.
Alternatively, the side information can be stored on a storage device instead of being inserted into the image sequence. The stored side information is then made available to an encoder that is tasked with encoding the image sequence.
The availability of advance information concerning the image sequence allows the encoder to best select one or more coding parameters in view of a particular coding environment and in view of the content of the image sequence. Furthermore, by extracting the side information “off line”, while the encoding of the image sequence may not be necessary at the present time, it is possible to implement a more powerful pre-processing section up front, where the increase in computational cycles is not a criticality. This allows the implementation of a less complex encoder to use the side information at a later time to quickly code the image sequence, where the decrease in computational cycles is advantageous, e.g., during period of high demand.
REFERENCES:
patent: 5504585 (1996-04-01), Funjinami et al.
patent: 5512942 (1996-04-01), Otsuki
patent: 5530483 (1996-06-01), Cooper et al.
patent: 5532833 (1996-07-01), Hong et al.
patent: 5724100 (1998-03-01), Kuchihbhotla
patent: 5751364 (1998-05-01), Yasuda et al.
patent: 5796436 (1998-08-01), Shioi et al.
patent: 5835163 (1998-11-01), Liou et al.
patent: 6100940 (2000-08-01), Dieterich
Britton Howard
Burke William J.
Sarnoff Corporation
LandOfFree
Apparatus and method for using side information to improve a... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Apparatus and method for using side information to improve a..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Apparatus and method for using side information to improve a... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2494530