Data processing: database and file management or data structures – Database design – Data structure types
Reexamination Certificate
1998-04-28
2001-09-18
Von Buhr, Maria N. (Department: 2171)
Data processing: database and file management or data structures
Database design
Data structure types
C707S793000, C707S793000
Reexamination Certificate
active
06292805
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of Invention
The invention relates to information processing, and more particularly to advanced storage and retrieval of audiovisual data objects according to the MPEG-4 standard, including utilization of an expanded physical object table including a list of local object identifiers.
2. Description of Related Art
In the wake of rapidly increasing demand for network, multimedia, database and other digital capacity, many multimedia coding and storage schemes have evolved. Graphics files have long been encoded and stored in commonly available file formats such as TIF, GIF, JPG and others, as has motion video in Cinepak, Indeo, MPEG-1 and MPEG-2, and other file formats. Audio files have been encoded and stored in RealAudio, WAV, MIDI and other file formats. These standard technologies have advantages for certain applications, but with the advent of large networks including the Internet the requirements for efficient coding, storage and transmission of audiovisual (AV) information have only increased.
Motion video in particular often taxes available Internet and other system bandwidth when running under conventional coding techniques, yielding choppy video output having frame drops and other artifacts. This is in part because those techniques rely upon the frame-by-frame encoding of entire monolithic scenes, which results in many megabits-per-second data streams representing those frames. This makes it harder to reach the goal of delivering video or audio content in real-time or streaming form, and to allow editing of the resulting audiovisual scenes.
In contrast with data streams communicated across a network, content made available in random access mass storage facilities (such as AV files stored on local hard drives) provide additional functionality and sometimes increased speed, but still face increasing needs for capacity. In particular, taking advantage of the random access characteristics of the physical storage medium, it is possible to allow direct access to, and editing of, arbitrary points within a graphical scene description or other audiovisual object information. Besides random access for direct playback purposes, such functionality is useful in editing operations in which one wishes to extract, modify, reinsert or otherwise process a particular elementary stream from a file.
In conjunction with the development of MPEG-4 coding and storage techniques, it is desirable to provide an improved ability to perform random access of audiovisual objects within video sequences. The opportunity to streamline random access would highlight and strengthen the potential of advanced capabilities provided by MPEG-4, and relieve the demands that those capabilities may impose on resources.
Part of the approach underlying MPEG-4 formatting is that a video sequence consists of a sequence of related scenes separated in time. Each picture is comprised of a set of audiovisual objects that may undergo a series of changes such as translations, rotations, scaling, brightness in color variations, etc., from one scene to the next. New objects can enter a scene and existing objects can depart, leaving certain objects present only in certain pictures. When scene changes occur, the entire scene and all the objects comprising the picture may be reorganized or initialized.
One of the identified functionalities of MPEG-4 is improved temporal random access, with the ability to efficiently perform random access of data within an audiovisual sequence in a limited time, and with fine resolution parts (e.g., frames or objects). Improved temporal random access techniques compatible with MPEG-4 involve content based interactivity requiring not only the ability to perform conventional random access, accessing individual pictures, but also the ability to access regions or objects within a scene.
While the MPEG-4 file format described in U.S. application Ser. No. 09/055,933 now U.S. Pat. No. 6,079,566, entitled “System and Method for Processing Object-Based Audiovisual Information” realizes such advantages, that approach includes at least two disadvantages prompted in part on that file format's reliance on a standard physical object table (POT) and segment object table (SOT) structure.
The first problem occurs when multiple instances of the same object exist in the same data segment. In the SOT, different instances of the same object use the same object identification (OBID). Therefore, there is no way using mainstream MPEG-4 to access the different object instances from the POT because the data field used as an access key, i.e., the OBID, is identical.
A second problem is that the POT/SOT structure does not recognize the possibility that object identifiers, OBIDs, can be reused. The POT does not include a list of temporal changes that the OBID assumes. Therefore, while MPEG-4 represents a powerful and flexible object-based standard for audiovisual processing, enhancements are desirable.
SUMMARY OF THE INVENTION
The invention overcomes these and other problems in the art and relates to an enhanced audiovisual coding and storage technique, related to MPEG-4, by introducing enhanced formatting including an expanded physical object table which utilizes an “ordered” list of unique identifiers for a particular object for every object instance. Therefore, using the invention, two object instances of the same object in the same segment can be separately identified. Thus, among other advantages, different instances of the identical object may be differentiated from one another.
The term “ordered” herein denotes that all adaptation layer protocol data (AL PDUs) of the same object instance are placed in the file in their natural order of occurrence, or coding order.
An additional benefit of the invention is that a given object instance can change its local identifier in time and still be randomly accessed by means of an improved POT/SOT mechanism.
The invention in one aspect relates to a method of composing data in a file, and a medium for storing that file, the file including a file header containing physical object information and logical object information, and generating a sequence of audiovisual segments, each including a plurality of audiovisual objects. The physical object information and the physical object information contains pointers to access the audiovisual segments.
In another aspect the invention provides a corresponding method of extracting data from a file, including by accessing a file having a header which contains physical object information and logical object information, and accessing audiovisual segments contained therein.
In another aspect the invention provides a system for processing a data file including a processor unit and a storage unit connected to the processor unit, the storage unit storing a file including a file header and a sequence of audiovisual segments. The file header contains physical object information and logical object information, and the physical object information contains pointers to access the audiovisual segments.
REFERENCES:
patent: 5563648 (1996-10-01), Menand et al.
patent: 5574905 (1996-11-01), de Carmo
patent: 5596565 (1997-01-01), Yonemitsu et al.
patent: 5694334 (1997-12-01), Donahue et al.
patent: 5696500 (1997-12-01), Diem
patent: 5732256 (1998-03-01), Smith
patent: 5737595 (1998-04-01), Cohen et al.
patent: 5737599 (1998-04-01), Rowe et al.
patent: 5754242 (1998-05-01), Ohkami
patent: 5794250 (1998-08-01), Cariño, Jr. et al.
patent: 5848410 (1998-12-01), Walls et al.
patent: 5894310 (1999-04-01), Arsenault et al.
patent: 5928330 (1999-07-01), Goetz et al.
patent: 5940840 (1999-08-01), Eshel et al.
patent: 5956729 (1999-09-01), Goetz et al.
patent: 0 684 570 A1 (1995-11-01), None
J. Laier et al., “Content-Based Multimedia Data Access in Internet Video Communication”,First International Workshop on Wireless Image/Video Communications,Sep. 1996, pp. 126-133.
A. Eleftheriadis et al., “Stored File Format for Object-based Audio Visual Representation”, pp. 1-8, No Date.
J. Heid, “Watch This: Streaming Video on Your We
Basso Andrea
Eleftheriadis Alexandros
Kalva Hari
Puri Atul
Schmidt Robert Lewis
AT&T Corp.
Von Buhr Maria N.
LandOfFree
System and method for processing object-based audiovisual... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for processing object-based audiovisual..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for processing object-based audiovisual... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2452638