Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
1999-07-21
2001-10-02
Kelley, Chris (Department: 2713)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
Reexamination Certificate
active
06298089
ABSTRACT:
The writing, the subject matter, and the description presented herein is protected under the provisions of United States Copyright laws by the Assignee, Viewgraphics, Inc., except only to any extent required by law in order to obtain and to continue all patent protection that is available during the term of any patent that issues hereon.
BACKGROUND OF THE INVENTION
Field of the Invention
The present invention relates generally to multimedia data stream processing and, more particularly, to apparatus and method for processing digitally encoded multimedia data streams.
A multimedia data stream refers to a binary stream that represents multimedia data, by which is meant video, opional audio streams, and optional other streams (such as subtitles, private data, etc.).
A digitally encoded multimedia data stream refers to a compressed version of a multimedia data stream. MPEG-2 is an example of a standard that defines compressed multimedia data formats. A multimedia data stream that has been formatted according to the MPEG-2 standard is referred to as a “MPEG-2 encoded data stream”.
The term “transport stream” is defined in ISO/IEC 13818-1:1996(e) page ix. The term “single program transport stream” (SPTS) is defined in ISO/IEC 13818-1:1996(E) page xi. A single program transport stream can also be abbreviated as SPTS; which is an example of a “MPEG-2 encoded data stream”.
MPEG-2 is one particular system of digitally encoding multimedia data streams, and since this system is regarded as an industry standard by many, it will be used in the following detailed description of the present invention. MPEG-2 prescribes specific protocols and capabilities, while allowing essentially unrestricted ways of implementing the prescribed protocols.
MPEG-2 encoded data streams are constructed so as not to exceed any of the limitations of the decoder buffer. Splicing involves appending a new data stream to a selected point in an existing data stream, thereby replacing the existing data stream at the splice point.
The MPEG-2 system of digitally encoding data streams usually involves a specification that has been regarded as an industry standard and, among other features, its encoding and decoding specifications prescribe an array of data stream format, timing, synchronization, and device capability parameters essentially independent of hardware and software system implementations.
However, the MPEG-2 specification, as is the specification of other systems, is deficient with regard to applications and contingencies that were unforeseen at the time the specification was first proposed. For example, it failed to anticipate the growing requirements for digitally encoded data stream splicing support with standard encoders.
The term “existing data stream” refers to an old data stream, which is a present data stream. A stream replacing the existing data stream is referred to as a “new data stream”, which is the stream that plays after a splice in.
A digitally encoded data stream is encoded such that, during decoding, a decoder buffer will continuously contain a sufficient number of frames for continuous decoding but not so many frames as to overflow the decoder buffer. Such a data stream contains a variable amount of reference data for recreating a video image.
Over time, the buffer levels in a decoder will fluctuate depending on which frames and frame types have been transmitted to the buffer and which frames have been processed for display by the decoder.
Typically, video frames of a digitally encoded data stream are received by a decoder in a different order from the order they are displayed. Decoders are required to buffer data streams so that video frames can be reconstructed and re-ordered readily.
Non-video data typically consists of audio data and other data private to the stream. Since audio is decoded separately from video, the time base of an audio packet can vary widely with respect to the time base in nearby video packets multiplexed on the same transport stream. Also, an audio buffer in a decoder is small relative to the video buffer.
Consequently, if the video and audio frames have similar time stamps, video is sent much earlier (e.g., about 100 milliseconds) before the audio. For this reason, the ideal splice-in and the ideal splice-out points with respect to video do not necessarily address the splice-in and splice-out points relative to non-video data. If audio is not spliced homogeneously with video, audio packets from the old data stream may be played with video from the new stream, or audio from the new stream may be played with video from the old stream.
Standardization efforts proposed by the Society of Motion Pictures and television suggest abandonment of conventional splicing methodologies in favor of a new extension to the MPEG-2 specification. The proposed standard contains a new integrated protocol directed specifically at performing seamless splicing of a data stream pair.
The proposed standard provides for incorporation of splice points and related splicing support information directly into the data stream at the time of encoding. Unfortunately, the proposed standard will require the expense of at least replacing a very large number of existing encoders in production today. Moreover, the proposed standard does not address splicing at arbitrary frames within an MPEG-2 encoded data stream.
Methods have been suggested recently for seamlessly splicing MPEG-2 digitally encoded data streams using the large install base of encoders without requiring new encoding protocols. However, these methods do not specifically address how to preserve the seam between two data streams for the audio and non-video components of the data stream.
Therefore, the problem persists for splicing two data streams while preserving the seam between them. Clearly, what is needed is a new and completely different approach to solving the problem, such a solution is provided by the present invention, which is described in detail hereinafter.
OBJECTS AND SUMMARY OF THE INVENTION
It is a principal object of the present invention to provide a new and improved method of processing digitally encoded-data streams.
It is a further object of the present invention to provide a method for determining splice-in and splice-out points for audio and non-video data.
Another object of the present invention is to provide a new and improved method for seamlessly splicing MPEG-2 digitally encoded data streams while preserving the seam between them.
Briefly a method in accordance with the present invention involves splicing audio and non-video data with a digitally encoded data stream. When a splicing point is identified in a program transport stream, the present invention will permit a near seamless splice-in and splice-out of data streams at these points for audio and other non-video data.
Other features, objects and advantaged of the present invention will become more readily apparent from the following detailed description of the presently preferred embodiment.
REFERENCES:
patent: 5859660 (1999-01-01), Perkins et al.
patent: 5917830 (1999-06-01), Chen et al.
patent: 6038000 (2000-03-01), Hurst, Jr.
patent: 6049569 (2000-04-01), Radha et al.
patent: 6137834 (2000-10-01), Wine et al.
patent: 6141358 (2000-10-01), Hurst, Jr. et al.
patent: 6154496 (2000-11-01), Radha
patent: 6195368 (2001-02-01), Gratacap
patent: 6208691 (2001-03-01), Balakrishnan et al.
Donovan et al., Pharse splincing and variable substitution using the IBM trainable speech synthesis system, Acoustics, Speech, and Signal Processing, 1999. Proceedings., 1999 IEEE International Conference on, vol.: 1 1999, pp. 373-376.*
Radha et al., Compressed video seamless switching using variable prarameters, Image Processing, 1998. CIP 98. Proceedings. 1998 Iternational Conference vol.: 1 1998, pp. 862-865.*
Balakrishnan et al., Rate and buffer regulation in a video encoder for seamless splicing, Image Processing, 1998.ICIP 98. Proceedings, 1998 International Conference vol.: 1 1998, pp. 880-883.*
Wee et al., Splicing MPEG video streams in the compressed domain, Multimedia Sig
Kelley Chris
Latham Roy W.
Viewgraphics, Inc.
Vo Tung T.
LandOfFree
Method for seamless and near seamless audio and non-video... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for seamless and near seamless audio and non-video..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for seamless and near seamless audio and non-video... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2572740