Electrical computers and digital processing systems: multicomput – Computer-to-computer protocol implementing – Computer-to-computer data streaming
Reexamination Certificate
1998-09-15
2002-07-02
Luu, Le Hien (Department: 2152)
Electrical computers and digital processing systems: multicomput
Computer-to-computer protocol implementing
Computer-to-computer data streaming
C709S246000, C725S032000
Reexamination Certificate
active
06415326
ABSTRACT:
TECHNICAL FIELD
This invention relates to techniques of storing and rendering streaming multimedia content at different speeds, and for correlating timelines of media streams that have been timeline-altered by varying techniques and degrees.
BACKGROUND OF THE INVENTION
Multimedia streaming-the continuous delivery of synchronized media data like video, audio, text, and animation-is a critical link in the digital multimedia revolution. Today, streamed media is primarily about video and audio, but a richer, broader digital media era is emerging with a profound and growing impact on the Internet and digital broadcasting.
Synchronized media means multiple media objects that share a common timeline. Video and audio are examples of synchronized media—each is a separate data stream with its own data structure, but the two data streams are played back in synchronization with each other. Virtually any media type can have a timeline. For example, an image object can change like an animated .gif file: text can change and move, and animation and digital effects happen over time. This concept of synchronizing multiple media types is gaining greater meaning and currency with the emergence of more sophisticated media composition frameworks implied by MPEG-4, Dynamic HTML, and other media playback environments. The term “streaming” is used to indicate that the data representing the various media types is provided over a network to a client computer on a realtime, as-needed basis, rather than being pre-delivered in its entirety before playback. Thus, the client computer renders streaming data as it is received from a network server, rather than waiting for an entire “file” to be delivered.
The widespread availability of streaming multimedia enables a variety of informational content that was not previously available over the Internet or other computer networks. Live content is one significant example of such content. Using streaming multimedia, audio, video, or audio/visual coverage of noteworthy events can be broadcast over the Internet as the events unfold. Similarly, television and radio stations can transmit their live content over the Internet.
A U.S. Patent Application entitled “Multimedia Timeline Modification in Networked Client/Server Systems,” filed Sep. 15, 1998, Ser. No. 09/153,664, by inventors Anoop Gupta and Nosa D. Omoigui, describes a system that allows a user to vary the playback speed of streaming multimedia content using time-scale modification technology. It was noted that both linear and non-linear timeline alteration techniques might be used.
When using linear techniques, time modification is applied consistently in times and across all individual streams of a composite media stream. With non-linear techniques, on the other hand, some segments of an individual or composite stream might be more highly expanded or compressed (in time) than other segments. This presents problems in switching and synchronizing between different versions of streams that have been non-linearly altered by different amounts or through the use of different non-linear techniques. These problems are addressed by the invention.
SUMMARY OF THE INVENTION
The invention utilizes time-scale modification so that a user can vary the speed of streaming content without destroying its intelligibility. In accordance with the invention, a user selects multimedia content from a menu presented at a network client computer. In addition, the user selects a playback speed, indicating the speed at which the multimedia should be rendered relative to its default speed. In the case of non-linearly altered streams, the user selects from available levels of alteration, such as “normal,” “pauses removed,” and “summary” levels of non-linear time compression.
Multiple versions of the requested multimedia content are stored at a server. In response to the selected playback speed or selected level of non-linear compression, the appropriate version is streamed to the client computer.
In addition to storing multiple versions of the multimedia content, the server maintains data structures that indicate timeline correlations between the various stored versions. The client refers to these stored timeline correlations when changing between the versions in response to client requests, so that playback can be started anew with a new stream at the point in the content where the change was requested by the client.
In the embodiment described herein, one version of the multimedia stream is considered to be a primary or reference version. This is usually the version having an unaltered timeline, corresponding to a 1.0 speed factor. Associated with this primary media stream is a table or other data object that is indexed by the presentation times of the primary media stream. For each presentation time of the primary media stream, the table indicates the timeline-correlated presentation times of the other, timeline-altered, media streams.
In addition, further data objects or elements are provided in conjunction with the timeline-altered media streams. These data objects are indexed by the presentation times of the timeline-altered media stream, and map such presentation times to the time-correlated presentation times of the primary media stream. One way to index these data objects is to associate and send them with the actual data units of the time-altered media streams.
When switching playback from a first time-altered media stream to a second time-altered media stream, the client stops the first media stream and notes the presentation time (in the first media stream) at which playback was stopped. The client then refers to the table associated with the first media stream and from it determines the timeline-correlated presentation time in the primary media stream. With that information, the client refers to the table associated with the primary media stream, and determines the time-correlated presentation time in the second media stream. The client then initiates playback of the second media stream at or before this time-correlated presentation time.
REFERENCES:
patent: 4931950 (1990-06-01), Isle et al.
patent: 5050161 (1991-09-01), Golestani
patent: 5119474 (1992-06-01), Beitel et al.
patent: 5274758 (1993-12-01), Beitel et al.
patent: 5309562 (1994-05-01), Li
patent: 5313454 (1994-05-01), Bustini et al.
patent: 5341474 (1994-08-01), Gelman et al.
patent: 5414455 (1995-05-01), Hooper et al.
patent: 5434848 (1995-07-01), Chimento, Jr. et al.
patent: 5455910 (1995-10-01), Johnson et al.
patent: 5481542 (1996-01-01), Logston et al.
patent: 5490252 (1996-02-01), Macera et al.
patent: 5504744 (1996-04-01), Adams et al.
patent: 5519701 (1996-05-01), Colmant et al.
patent: 5521630 (1996-05-01), Chen et al.
patent: 5533021 (1996-07-01), Branstad et al.
patent: 5537408 (1996-07-01), Branstad et al.
patent: 5541955 (1996-07-01), Jacobsmeyer
patent: 5559942 (1996-09-01), Gough et al.
patent: 5566175 (1996-10-01), Davis
patent: 5574724 (1996-11-01), Bales et al.
patent: 5614940 (1997-03-01), Cobbley et al.
patent: 5617423 (1997-04-01), Li et al.
patent: 5623690 (1997-04-01), Palmer et al.
patent: 5625405 (1997-04-01), DuLac et al.
patent: 5640320 (1997-06-01), Jackson et al.
patent: 5664227 (1997-09-01), Mauldin et al.
patent: 5692213 (1997-11-01), Goldberg et al.
patent: 5717691 (1998-02-01), Dighe et al.
patent: 5717869 (1998-02-01), Moran et al.
patent: 5719786 (1998-02-01), Nelson et al.
patent: 5721829 (1998-02-01), Dunn et al.
patent: 5742347 (1998-04-01), Kandlur et al.
patent: 5768533 (1998-06-01), Ran
patent: 5786814 (1998-07-01), Moran et al.
patent: 5794210 (1998-08-01), Goldhaber et al.
patent: 5794249 (1998-08-01), Orsolini et al.
patent: 5799292 (1998-08-01), Hekmatpour
patent: 5801685 (1998-09-01), Miller et al.
patent: 5808662 (1998-09-01), Kinney et al.
patent: 5818510 (1998-10-01), Cobbley et al.
patent: 5822537 (1998-10-01), Katseff et al.
patent: 5828848 (1998-10-01), MacCormack et al.
patent: 5835495 (1998-11-01), Ferriere
patent: 5835667 (1998-11-01), Wactlar et al.
patent: 5838906 (1998-11-01), Doyle et al.
patent: 5859641 (1
Gupta Anoop
He Li-Wei
Omoigui Nosakhare D.
Lee & Hayes PLLC
Luu Le Hien
Microsoft Corporation
Thompson Marc D.
LandOfFree
Timeline correlation between multiple timeline-altered media... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Timeline correlation between multiple timeline-altered media..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Timeline correlation between multiple timeline-altered media... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2913987