Electrical computers and digital processing systems: multicomput – Computer-to-computer protocol implementing – Computer-to-computer data transfer regulating
Reexamination Certificate
1998-12-30
2003-12-16
Jaroenchonwanit, Bunjob (Department: 2143)
Electrical computers and digital processing systems: multicomput
Computer-to-computer protocol implementing
Computer-to-computer data transfer regulating
C370S229000
Reexamination Certificate
active
06665728
ABSTRACT:
FIELD OF THE INVENTION
This invention relates generally to multimedia, and more particularly to data streaming applications that use data packets.
BACKGROUND OF THE INVENTION
In many network-based multimedia applications, data is sent from a first point to a second point in packets, which are then decoded when received at the second point, and played back on playback hardware. For example, in the case of streaming audio or video multicasting, a server sends to a number of clients over a network the packets of data that make up the desired audio or video, which are received at the clients, decoded, and played back. In another example, in a two- or multi-party video or audio conference, the parties send back and forth data packets over a network, which are then decoded at the receiving parties and played back. Such streaming applications are especially popular over the Internet, intranets, and extranets.
A difficulty with such applications, however, is that the transmittal and receipt of the data packets through the network may become hampered. Packets may be held up, or lost, for example, throughout the network. Or, the bandwidth at which a given party can receive or send packets may be limited. The practical effect of these problems is that the parties may find their audio and/or video streams broken up—that is, the resulting multimedia stream when played may be choppy, such that the perceptual quality of the playback may be degraded.
A limited solution to this problem is to introduce a predetermined latency in the data stream, via a buffer or other mechanism. In this way, if packets are held up in the network, playback at the receiving end is not affected because other packets still may be stored in the buffer. This solution has some success in one-way multicast situations, where a server is transmitting data for playback on multiple clients. This is because the clients only receive data packets, and are not expected to send responsive data packets to the server or the other clients.
However, in other situations, introduction of a predetermined latency is less than optimal. For example, in the case of audio or video conferences, where communication is two-way among the parties of the conference, introduction of a predetermined latency may affect the quality of the conference, especially where the latency is larger than required. The parties may find, for example, that their ability to respond in a timely manner to parties is affected. That is, because the parties may assume that the conference is occurring in real-time, when in reality the conference is being buffered, it may be difficult for parties to interrupt another in a manner that resembles a normal, in-person conference.
For these and other reasons, there is a need for the present invention.
SUMMARY OF THE INVENTION
The invention provides for latency in streaming applications that use data packets. In one embodiment, a system includes an under-run forecasting mechanism, a statistics monitoring mechanism, and a playback queuing mechanism. The under-run forecasting mechanism determines an estimate of when a supply of data packets will be exhausted. The statistics monitoring mechanism measures the arrival time characteristics of the supply of data packets. The playback queuing mechanism builds latency in the supply of data packets based upon input from the under-run forecasting mechanism and arrival fluctuations measured by the statistics monitoring mechanism. In one embodiment, the supply of data packets relates to audio.
REFERENCES:
patent: 4942553 (1990-07-01), Dalrymple et al.
patent: 4945548 (1990-07-01), Iannarone et al.
patent: 5038209 (1991-08-01), Hang
patent: 5159447 (1992-10-01), Haskell et al.
patent: 5285442 (1994-02-01), Iwamura et al.
patent: 5365552 (1994-11-01), Astle
patent: 5434845 (1995-07-01), Miller
patent: 5434872 (1995-07-01), Petersen et al.
patent: 5465348 (1995-11-01), Amemiya et al.
patent: 5534937 (1996-07-01), Zhu et al.
patent: 5537446 (1996-07-01), Lakshman et al.
patent: 5543853 (1996-08-01), Haskell et al.
patent: 5565924 (1996-10-01), Haskell et al.
patent: 5602537 (1997-02-01), Dalrymple
patent: 5619341 (1997-04-01), Auyeung et al.
patent: 5664044 (1997-09-01), Ware
patent: 5668841 (1997-09-01), Haskell et al.
patent: 5703877 (1997-12-01), Nuber et al.
patent: 5717464 (1998-02-01), Perkins et al.
patent: 5734432 (1998-03-01), Netravali et al.
patent: 5754241 (1998-05-01), Okada et al.
patent: 5793937 (1998-08-01), Chura et al.
patent: 5812526 (1998-09-01), Chang et al.
patent: 5835691 (1998-11-01), Matsunoshita
patent: 5852719 (1998-12-01), Fishler et al.
patent: 5949792 (1999-09-01), Yasuda et al.
patent: 5978356 (1999-11-01), Elwalid et al.
patent: 6061404 (2000-05-01), Yonemitsu et al.
patent: 6075768 (2000-06-01), Mishra
patent: 6075770 (2000-06-01), Chang et al.
patent: 6105086 (2000-08-01), Doolittle et al.
patent: 6138189 (2000-10-01), Kalkunte
patent: 6151359 (2000-11-01), Acer et al.
patent: 6167032 (2000-12-01), Allison et al.
patent: 6169747 (2001-01-01), Sartain et al.
patent: 6192032 (2001-02-01), Izquierdo
patent: 6198878 (2001-03-01), Blawat et al.
patent: 6233226 (2001-05-01), Gringeri et al.
patent: 6272566 (2001-08-01), Craft
patent: 6301258 (2001-10-01), Katseff et al.
patent: 6366704 (2002-04-01), Ribas-Corbera et al.
patent: 406152648 (1994-05-01), None
Yang et el., “Focus of Attention: Towards Low Bitrate Video Tele-Conferencing”, 1996, IEEE, pp. 97-100.*
Christopoulos et al., “Hierarchical Segmentation Methods for Region-Based Video Coding”, 1998 , IEEE, pp. 309-313.*
David et al., “A Unified Data Model for Representing Multimedia, Timeline, and Simulation Data”, 1998, IEEE, pp. 746-767.*
Wang et al., “Zero waiting-Cycle Hierarchical block Matching algorithm and its Array architectures”, IEEE, 1994, pp. 18-28.*
Som et al., “Strategeies for Predictability in Real-Time Data Flow Architectures”, IEEE, 1990, pp. 226 235.*
Fujii et al., “A Load Balancing Technique for Video Signal Processing on a Multicomputer Type DSP”, ICASSP-88, 1988, pp. 1981-1984.
Graumann David L.
Henry Claudia M.
LandOfFree
Establishing optimal latency in streaming data applications... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Establishing optimal latency in streaming data applications..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Establishing optimal latency in streaming data applications... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3121429