Data processing: presentation processing of document – operator i – Presentation processing of document – Layout
Reexamination Certificate
1999-01-25
2003-11-25
Hong, Stephen S. (Department: 2178)
Data processing: presentation processing of document, operator i
Presentation processing of document
Layout
Reexamination Certificate
active
06654931
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of Invention
This invention relates to systems and methods for decoding and presenting encoded audio and visual data. More specifically, this invention relates to systems and methods for playing, browsing and interacting with MPEG-4 coded scenes including one or more audio and/or visual objects.
2. Description of Related Art
MPEG-1 and MPEG-2 encoding and decoding standards are frame-based encoding and decoding techniques. That is, in MPEG-1 and MPEG-2, audio-visual data, such as a video recording, is organized into separate frames, where each frame is a complete image. In MPEG-1 and MPEG-2, the human-recognizable objects within each image are not distinguished from each other in encoding and decoding the data defining the image. Thus, while each frame can be treated independently from any other frame, each frame is itself a unitary element of the audio-visual data.
FIG. 1
is an exemplary embodiment of an MPEG-2 playback system.
The Virtual Reality Modeling Language, or VRML, is a computer language that is used to create text descriptions defining three-dimensional synthetic images. That is, VRML is used to define the three-dimensional objects that appear in a synthetic, e.g., computer-generated, image, including shapes and sizes of the objects, the appearance of each object, including, material, color, shading and texture, and the location of each objects, including position and orientation. The objects are generally synthetic, e.g., computer-generated, objects. VRML is also used to define the lighting in the synthetic image, including the type and position of one or more light sources.
SUMMARY OF THE INVENTION
MPEG-4 is a new audio-visual data encoding and decoding standard. In particular, MPEG-4, in contrast to MPEG-1 and MPEG-2, is not a frame-based encoding and decoding technique. MPEG-4 is an object-based encoding and decoding technique. Objects can be synthetic or natural objects, and further, can be audio, video or graphics objects. In MPEG-4, each frame is decomposed into a plurality of different objects and a scene description graph that indicates where each object appears in that frame. The object-based nature of MPEG-4, along with requirements of flexible composition and user interactivity, requires using some scene description mechanism.
Each object resides in its own video object plane that defines at least that object's shape, motion, opaqueness and color, including surface texture. The scene description graph defines the spatial location of each object within the bounds of the frame. The scene description graph also defines the position of each object within the depth of the frame, i.e., which objects are “in front of” which other objects.
These features allow new kinds of flexibilities not offered by simply decoding and presenting a video frame as in MPEG-2. MPEG-4 players can be flexible, and the systems and methods for playing, browsing and interacting with MPEG-4 coded scenes of this invention allows users the ability to browse two-dimensional (2D) or three-dimensional (3D) MPEG-4 scenes typically composed from synthetic and natural media elements. Furthermore, the systems and methods for playing, browsing and interacting with MPEG-4 coded scenes of this invention allow users the ability to interact with and customize such scenes. This invention further describes systems and methods for constructing MPEG-4 based multimedia players and browsers to facilitate these flexibilities, such as programmatic control via JavaScript and Java, and to enhance the user's experience, while, at the same time, remaining compatible with the MPEG-4 standards.
These and other features and advantages of this invention are described in or are apparent from the following detailed description of the systems and methods according to this invention.
REFERENCES:
patent: 5499358 (1996-03-01), Nevarez
patent: 5563648 (1996-10-01), Menand et al.
patent: 5574905 (1996-11-01), deCarmo
patent: 5586121 (1996-12-01), Moura et al.
patent: 5596565 (1997-01-01), Yonemitsu et al.
patent: 5684804 (1997-11-01), Baronetti et al.
patent: 5694334 (1997-12-01), Donahue et al.
patent: 5696500 (1997-12-01), Diem
patent: 5708659 (1998-01-01), Rostoker et al.
patent: 5732256 (1998-03-01), Smith
patent: 5737595 (1998-04-01), Cohen et al.
patent: 5737599 (1998-04-01), Rowe et al.
patent: 5754242 (1998-05-01), Ohkami
patent: 5774664 (1998-06-01), Hidary et al.
patent: 5794250 (1998-08-01), Carino, Jr. et al.
patent: 5818845 (1998-10-01), Moura et al.
patent: 5848410 (1998-12-01), Walls et al.
patent: 5852714 (1998-12-01), Tseng et al.
patent: 5875303 (1999-02-01), Huizer et al.
patent: 5886743 (1999-03-01), Oh et al.
patent: 5893091 (1999-04-01), Hunt et al.
patent: 5894310 (1999-04-01), Arsenault et al.
patent: 5905865 (1999-05-01), Palmer et al.
patent: 5928330 (1999-07-01), Goetz et al.
patent: 5940840 (1999-08-01), Eshel et al.
patent: 5946487 (1999-08-01), Dangelo
patent: 5956729 (1999-09-01), Goetz et al.
patent: 5961603 (1999-10-01), Kunkel et al.
patent: 6044397 (2000-03-01), Eleftheriadis et al.
patent: 6070167 (2000-05-01), Qian et al.
patent: 6081278 (2000-06-01), Chen
patent: 6092107 (2000-07-01), Eleftheriadis et al.
patent: 6269394 (2001-07-01), Kenner et al.
patent: 6320623 (2001-11-01), Cavallerano et al.
patent: 6452598 (2002-09-01), Rafey et al.
J. Heid, “Watch This: Streaming Video on Your Web Site”,MACWORLD, Apr. 1998, pp. 109-112.
A. Griffin, “Video on the Net”,Popular Mechanics, Mar. 1998, pp. 51-53.
L. Chiariglione, “MPEG and Multimedia Communications”,IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, No. 1, Feb. 1997, pp. 5-18.
Y. Fang et al., “Adding Bitstream Imput/Output Library in Java”,International Organization for Standardization, ISO/IEC JTCI/SC29/WG11 MPEG97/M2063, Apr. 1, 1997, pp. 1-6.
A. Puri et al., “APIs for MPEG-4 Systems”,International Organization for Standardization, ISO/IEC JTC1/SC29/WG11 MPEG97/2133, Apr. 1997.
A. Basso et al., “MPEG-4 Integrated Intermedia Format (IIF): Basic Specification”,International Organization for Standardization, ISO/IEC JTC1/SC29/WG11 MPEG98/M2978, Jan. 16, 1998, pp. 1-22.
J. Laier et al., “Content-Based Multimedia Data Access in Internet Video Communication”,First International Workshop on Wireless Image/Video Communications, Sep. 1996, pp. 126-133.
Haskell Barin Geoffry
Puri Atul
Schmidt Robert Lewis
AT&T Corp.
Hong Stephen S.
LandOfFree
Systems and methods for playing, browsing and interacting... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Systems and methods for playing, browsing and interacting..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Systems and methods for playing, browsing and interacting... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3177055