Accessing annotations across multiple target media streams

Details Accessing annotations across multiple target media streams Accessing annotations across multiple target media streams

1999-09-15

2002-11-19

Shah, Sanjiv (Department: 2172)

Data processing: database and file management or data structures

Database design

Data structure types

C707S793000

Reexamination Certificate

active

06484156

ABSTRACT:

A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
TECHNICAL FIELD
This invention relates to networked client/server systems and to methods of delivering and rendering multimedia content in such systems. More particularly, the invention relates to systems and methods of selecting and providing such content.
BACKGROUND OF THE INVENTION
The advent of computers and their continued technological advancement has revolutionized the manner in which people work and live. An example of such is in the education field, wherein educational presentations (such as college lectures, workplace training sessions, etc.) can be provided to a computer user as multimedia data (e.g., video, audio, text, and/or animation data). Today, such presentations are primarily video and audio, but a richer, broader digital media era is emerging. Educational multimedia presentations provide many benefits, such as allowing the presentation data to be created at a single time yet be presented to different users at different times and in different locations throughout the world.
These multimedia presentations are provided to a user as synchronized media. Synchronized media means multiple media objects that share a common timeline. Video and audio are examples of synchronized media—each is a separate data stream with its own data structure, but the two data streams are played back in synchronization with each other. Virtually any media type can have a timeline. For example, an image object can change like an animated gif file, text can change and move, and animation and digital effects can happen over time. This concept of synchronizing multiple media types is gaining greater meaning and currency with the emergence of more sophisticated media composition frameworks implied by MPEG-4, Dynamic HTML, and other media playback environments.
The term “streaming” is used to indicate that the data representing the various media types is provided over a network to a client computer on a real-time, as-needed basis, rather than being pre-delivered in its entirety before playback. Thus, the client computer renders streaming data as it is received from a network server, rather than waiting for an entire “file” to be delivered.
Multimedia presentations may also include “annotations” relating to the multimedia presentation. An annotation is data (e.g., audio, text, video, etc.) that corresponds to a multimedia presentation. Annotations can be added by anyone with appropriate access rights to the annotation system (e.g., the lecturer/trainer or any of the students/trainees). These annotations typically correspond to a particular temporal location in the multimedia presentation and can provide a replacement for much of the “in-person” interaction and “classroom discussion” that is lost when the presentation is not made “in-person” or “live”. As part of an notation, a student can comment on a particular point, to which another student (or lecturer, assistant, etc.) can respond in a subsequent annotation. This process can continue, allowing a “classroom discussion” to occur via these annotations. Additionally, some systems allow a user to select a particular one of these annotations and begin playback of the presentation starting at approximately the point in the presentation to which the annotation corresponds.
However, current systems typically allow a user to retrieve annotations based only on a per-media stream basis. In other words, a user is typically not able to quickly, with a single request, access annotations related to different media streams. This limitation can be very cumbersome for a user, requiring him or her to painstakingly make multiple requests in order to access the desired annotations. By way of example, assume that a professor is teaching a course with forty lectures during the semester, each of which is available as an annotated media stream. A teaching assistant may need to check the annotations daily for student questions. However, requiring the teaching assistant to access the annotations for the media streams independently, and thereby requiring a separate search of each of the forty different media stream annotation groups, is particularly burdensome on the assistant.
The invention described below addresses this and other disadvantages of annotations, providing a way to improve access and retrieval of annotations.
SUMMARY OF THE INVENTION
Annotations correspond to multiple different multimedia streams. An annotation server uses a hierarchical annotation storage structure to maintain a correspondence between the annotations and a hierarchically higher group identifier. Thus, annotations corresponding to the different multimedia streams can easily be accessed concurrently by using the group identifier.
According to one aspect of the invention, uniform resource locators (URLs) are used to identify the different multimedia streams. Each of the multimedia steams is identified by a different URL having a common prefix. This prefix is then used to identify all of the multimedia streams and their corresponding annotations.


REFERENCES:
patent: 5333266 (1994-07-01), Boaz et al.
patent: 5524193 (1996-06-01), Covington et al.
patent: 5526407 (1996-06-01), Russell et al.
patent: 5600775 (1997-02-01), King et al.
patent: 5633916 (1997-05-01), Goldhagen et al.
patent: 5699089 (1997-12-01), Murray
patent: 5732216 (1998-03-01), Logan et al.
patent: 5838313 (1998-11-01), Hou et al.
patent: 5893087 (1999-04-01), Wlaschin et al.
patent: 5903892 (1999-05-01), Hoffert et al.
patent: 5923848 (1999-07-01), Goodhand et al.
patent: 5991365 (1999-11-01), Pizano et al.
patent: 6009462 (1999-12-01), Birrell et al.
patent: 6081829 (2000-06-01), Sidana
patent: 6105055 (2000-08-01), Pizano et al.
patent: 6173287 (2001-01-01), Eberman et al.
patent: 6173317 (2001-01-01), Chaddha et al.
patent: 6230172 (2001-05-01), Purnaveja et al.
patent: O 650 126 (1995-04-01), None
patent: 2 301 260 (1996-11-01), None
patent: WO 97/49251 (1997-12-01), None
Abowd et al., “Teaching and Learning as Multimedia Authoring: The Classroom 2000 Project”, Proceedings of the Multimedia '96, boston, MA, USA, Nov. 1996, ACM Press, pp. 187-198.
Bessler et al., DIANE: A Multimedia Annotation System, Proceedings of the ECMAST '97, Milan, Italy, May 1997.
Carrer et al., “An Annotation Engine for Supporting Video Database Population”, Multimedia Tools and Applications 5, 1997, Kluwer Academic Publishers, pp. 233-258.
Chalfonte et al., “Expressive Richness: A Comparison of Speech and Text as Media for Revision”, Proceedings of the CHI' 91, 1991, ACM Press, pp. 21-26.
Davis et al., CoNote System Overview, 1995, Available at http://www.cs.cornell.edu/home/dph/annotation/annotations.html.
Gaines et al., “Open Architecture Multimedia Documents”, Proceedings of the Multimedia '93, Anaheim, CA, Aug. 1993, ACM Press, pp. 137-146.
“Mastering Microsoft Office 97”, Mosely and Boodey, Sybex, Inc., 1996, pp. 755-763 and pp. 811-816.
Gould et al., “Relativity Controller: Reflecting User Perspective in Document Spaces,” Adjunct Proceedings of INTERCHI '93, 1993, ACM Press, pp. 125-126.
Kim et al., “VIRON: An Annotation-Based Video Information Retrieval System,” Proceedings of COMPSAC '96, Seoul, South Korea, Aug. 1996, IEEE Press, pp. 298-303.
Laliberte et al., “A Protocol for Scalable Group and Public Annotations”, 1997 NCA Technical Proposal, available at http://union.ncsa.uiuc.edu/~liberte/www/scalable-annotations.html.
Lawton et al., “The Knowledge Weasel Hypermedia Annotation System”, Proceedings of the HyperText '93, Nov. 1993, ACM Press, pp. 106-117.
Lee et al., “Video Indexing—An Approach Based on Moving Object and Track”, Proceedings of the SPIE, vol. 1908, 1993, pp. 25-36.
Marshall, “Toward and Ecology of Hypertext Annotation

Affiliated with

Also associated with

Rating

Accessing annotations across multiple target media streams does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Accessing annotations across multiple target media streams, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Accessing annotations across multiple target media streams will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2973117