Interactive video distribution systems – Video distribution system with upstream communication – Receiver
Reexamination Certificate
1999-08-02
2003-09-30
Faile, Andrew (Department: 2611)
Interactive video distribution systems
Video distribution system with upstream communication
Receiver
C725S089000, C725S131000, C725S142000, C714S746000, C714S748000, C714S749000, C714S750000, C370S394000, C370S486000, C370S487000, C375S240260, C375S240280, C348S419100, C348S423100
Reexamination Certificate
active
06629318
ABSTRACT:
TECHNICAL FIELD OF THE INVENTION
The present invention is directed, in general, to video processing systems and, more specifically, to a decoder buffer for use in a streaming video receiver.
BACKGROUND OF THE INVENTION
Real-time streaming of multimedia content over Internet protocol (IP), networks has become an increasingly common application in recent years. A wide range of interactive and non-interactive multimedia Internet applications, such as news con-demand, live TV viewing, video conferencing, and many others rely on end-to-end streaming solutions. Unlike a “downloaded” video file, which may be retrieved first in “non-real” time and viewed or played back later, streaming video applications require a video source to encode and to transmit a video signal over a network to a video receiver, which must decode and display the video signal in real time. The receiver relies on a decoder buffer to receive encoded video data packets from the network and to transfer the packets to a video decoder.
Two problems arise when a streaming video signal is transmitted across a non-guaranteed Quality-of-Service (QoS) network, such as the Internet. First, end-to-end variations in the network (e.g., delay jitter) between the streaming video transmitter and the streaming video receivers mean that the end-to-end delay is not constant. Second, there is usually a significant packet loss rate across non-QoS networks, often requiring re-transmission. The lost data packet must be recovered prior to the time the corresponding frame must be decoded. If not, an underflow event occurs. Furthermore, if prediction-based compression is used, an underflow due to lost data packets may not only impact the current frame being processed, but may affect many subsequent frames.
It is well-known that re-transmission of lost packets is a viable means of recovery for continuous media communication over packet networks. Many applications use a negative automatic repeat request (NACK) in conjunction with re-transmission of the lost packet. These approaches take into consideration both the round-trip delay and the delay jitter between the sender and the receiver(s).
For example, an end-to-end model with re-transmission for packet voice transmission has been developed. This model takes advantage of the fact that voice data consists of periods of silence separated by brief talk-spurt segments. The model also assumes that each talk-spurt consists of a fixed number of fixed-size packets. However, this model is not general enough to capture the characteristics of compressed video (which can have variable number of bytes or packets per video frame).
There is therefore a need in the art for improved streaming video receivers that compensate for variations inherent in a non-QoS network. In particular, there is a need for an improved receiver decoder buffer that takes into consideration both transport delay parameters (e.g., end-to-end delay and delay jitter) and video encoder buffer constraints. More particularly, there is a need for an improved decoder buffer that eliminates the separation between the network transport buffer, which is typically used to remove delay jitter and to recover lost data, and the video decoder buffer.
SUMMARY OF THE INVENTION
The present invention is embodied in an Integrated Transport Decoder (ITD) buffer model. One key advantage of the ITD model is that it eliminates the separation of a network-transport buffer, which is typically used for removing delay jitter and recovering lost data, from the video decoder buffer. This can significantly reduce the end-to-end delay, and optimize the usage of receiver resources (such as memory).
It is a primary object of the present invention to provide, for use with a video decoder capable of decoding streaming video, a decoder buffer capable of receiving from a streaming video transmitter data packets comprising the streaming video and storing the data packets in a plurality of access units. Each of the, access units is capable of holding at least one data packet associated with a selected frame in the streaming video. The decoder buffer comprises: 1) a first buffer region comprising at least one access unit capable of storing data packets that are less immediately needed by the video decoder; and 2) a re-transmission region comprising at least one access unit capable of storing data packets that are most immediately. needed by the video decoder, wherein the decoder buffer, in response to a detection of a missing, data packet in the re-transmission region requests that the streaming video transmitter retransmit the missing packet.
In one embodiment of the present invention, at least one of the data packets are stored in the first buffer region for a period of time equal to a start-up delay time of the decoder buffer.
In another embodiment of the present invention, the data packets are first stored in the first buffer region and are shifted into the re-transmission region.
In still another embodiment of the present invention, the first buffer region is separate from the re-transmission region.
In yet another embodiment of the present invention, the first buffer region overlaps at least a portion of the re-transmission region.
In a further embodiment of the present invention, the first buffer region overlaps all of the re-transmission region.
In a further embodiment of the present invention, the first buffer region is separated from the re-transmission region by a second buffer region in which a late data packet is late with respect to an expected time of arrival of the late data packet, but is not sufficiently late to require a re-transmission of the late data packet.
The foregoing has outlined rather broadly the features and technical advantages of the present invention so that those skilled in the art, may better understand the detailed description of the invention that follows. Additional features and advantages of the invention will be described hereinafter that form the subject of the claims of the invention. Those skilled in the art should appreciate that they may readily use the conception and the specific embodiment disclosed as a basis for modifying or designing other structures for carrying out the same purposes of the present invention. Those skilled in the art should also realize that such equivalent constructions do not depart from the spirit, and scope of the invention in its broadest form.
Before undertaking the DETAILED DESCRIPTION, it may be advantageous to set forth definitions of certain words and phrases used throughout this patent document: the terms “include” and “comprise,” as well as derivatives thereof, mean inclusion without limitation; the term “or,” is inclusive, meaning and/or; the phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like; and the term “controller” means any device, system or part thereof that controls at least one operation, such a device may be implemented in hardware, firmware or software, or some combination of at least two of the same. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely. Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases.
REFERENCES:
patent: 5109384 (1992-04-01), Tseung
patent: 5550847 (1996-08-01), Zhu
patent: 5652627 (1997-07-01), Allen
patent: 5666484 (1997-09-01), Orimo et al.
patent: 5680322 (1997-10-01), Shinoda
patent: 5751883 (1998-05-01), Ottesen et al.
patent: 5768527 (1998-06-01), Zhu et al.
patent: 5768533 (1998-06-01), Ran
patent: 5918002 (1999-06-01), Klemets et al.
patent: 5930480
Parthasarathy Kavitha
Radha Hayder
Faile Andrew
Huynh Son P.
Koninklijke Philips Electronics , N.V.
LandOfFree
Decoder buffer for streaming video receiver and method of... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Decoder buffer for streaming video receiver and method of..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Decoder buffer for streaming video receiver and method of... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3015335