Television – Basic receiver with additional function – For display of additional information
Reexamination Certificate
1999-07-12
2002-07-02
Hsia, Sherrie (Department: 2614)
Television
Basic receiver with additional function
For display of additional information
C348S566000, C348S568000, C348S589000, C348S600000
Reexamination Certificate
active
06414722
ABSTRACT:
FIELD OF THE INVENTION
The invention relates to the formation of digital images from auxiliary graphical elements which form auxiliary graphical images or sub-images (“sub-pictures”). In particular, the invention relates to the decoding of these sub-images which are intended to be inset into a predetermined area of a display screen and superimposed on main images.
BACKGROUND OF THE INVENTION
Images to be decoded, for example, according to the MPEG standards (“Motion Pictures Experts Group”) are stored as compressed data on, for example, a multifunction digital disc (DVD: “Digital Versatile Disk”). Furthermore, auxiliary images or sub-images which result from auxiliary data or sub-image data (sub-picture data) are stored in a compressed manner on a such a disk.
One of the uses of these auxiliary graphical images or sub-images relates to the display of menus on the screen of a television. Also, these images can be used to inset small moving sequences on the main images depicted on the screen of a television set. Additionally, these images can be used for the depicting of texts of songs in karaoke applications.
A current method used for forming auxiliary graphical images includes decoding the auxiliary graphical data, compressed and stored on the digital disk, with software to store the decoded auxiliary graphical images in a dynamic memory. In this way, the auxiliary graphical images are ready to be extracted from the memory, as many times as necessary, to be displayed each time pixel by pixel. However, such a method requires a substantial memory size, especially when the size of the auxiliary graphical images is substantial.
SUMMARY OF THE INVENTION
An object of this invention is to solve this problem by proposing an approach for the decoding and forming of these auxiliary graphical images, and for the forming of the images resulting from being superimposed on the stream of main images. The invention therefore proposes a process for forming digital images resulting from auxiliary graphical elements inset on the main images.
Generally, the invention includes a process which comprises the receipt of at least one auxiliary stream comprising a set of compressed graphical data corresponding to graphical elements forming at least one auxiliary graphical image intended to be inset into a predetermined area on a display screen. The auxiliary graphical image, superimposed on a main image, is displayed at the occurrence of a predetermined initial main image and for a predetermined elementary duration. Furthermore, the process comprises the storage of the auxiliary stream in a memory, and successive decodings of the compressed graphical data. These successive decodings are respectively performed during the display of the successive main images from the display of the initial main image up to the expiration of the predetermined elementary duration. Also, these successive decodings are performed to deliver in the course of each decoding, at the rate of display of the pixels on the screen and for each pixel of the auxiliary image, luminance and chrominance values as well as a mixing coefficient. The process also comprises the pixel-by-pixel mixing, in the predetermined screen area, of the chrominance and luminance values corresponding to the current main image being displayed and to the decoded auxiliary graphical image, having the mixing coefficients.
In other words, the process according to the invention provides for an on the fly decoding of the compressed graphical data of a graphical image, during the display of a main image (in practice and for example, during the display of each frame of the main image). Furthermore, the process provides for the redecoding of the same data corresponding to the same graphical image for each main image, i.e. in the course of the display of each main image, and for as long as necessary. Thus, for example, if an auxiliary graphical image needs to be inset on the display screen superimposed on an initial main image and superimposed on the next 99 main images, the compressed graphical data corresponding to each frame of this auxiliary image will be decoded 100 times in succession. Each decoding taking place in real time during the display of the current main image so that the mixer receives in a synchronized manner, for each pixel, the luminance and chrominance values of the main image intended to be displayed. And, the mixer receives the luminance and chrominance values of the decoded auxiliary graphical image likewise intended to be displayed and superimposed on this main image being displayed.
The invention therefore has the notable advantage of reducing the necessary memory size as well as the memory passband used because the auxiliary graphical data of each graphical image may be kept in the memory in a compressed form. The decoding of this data does not require storage of the decoded auxiliary graphical image in the memory before its display.
The auxiliary stream generally comprises a header, the compressed graphical data, and at least one set of parametrization data, making it possible to parametrize the decoding of the graphical image. Moreover, according to one embodiment of the invention in which the main images are displayed line by line in two successive frames corresponding to lines of different parities, a process is performed for analyzing the parametrization data between each display of a frame. This being so, it would also be possible in another embodiment of the invention, to perform this process for analyzing the parametrization data during each line flyback. In fact, generally, the process for analyzing the parametrization data is performed during a period when there is no pixel display on the screen, so as not to disturb this display.
The set of compressed graphical data can correspond to several successive auxiliary graphical images each intended to be superimposed in succession with the main images for a respective elementary duration. The auxiliary stream thus comprises several sets of parametrization data each making it possible to parametrize the decoding of an auxiliary graphical image. And, so long as the elementary duration corresponding to an auxiliary graphical image has not elapsed, the set of parametrization data corresponding to this image is analyzed between each display of a frame. Then the compressed graphical data of this image is decoded on the basis of the parametrization data. And, when the corresponding elementary duration has elapsed, there is an automatic transfer to the analysis of the set of parametrization data corresponding to the next auxiliary graphical image. Then compressed graphical data of this next image is decoded on the basis of these new parametrization data.
According to a particular embodiment of the invention, on receiving the auxiliary stream, a temporal counter is initialized to a predetermined initial value (for example the time of display of the first auxiliary graphical image). Each set of parametrization data comprises a temporal indication, linked to the predetermined initial value (for example the start time of display of each of these auxiliary graphical images), and representative of the start instant of the first decoding of the corresponding auxiliary graphical image. Before commencing the decoding of the compressed data corresponding to the first auxiliary graphical image, the temporal indication of the next auxiliary graphical image is stored in a register and the successive decodings of the auxiliary graphical image are performed. These decodings are parametrized by the corresponding set of parametrization data so long as the value of the counter is less than the content of the register. And, when the value of the counter becomes greater than or equal to the content of the register, then it is time to carry out the decoding and displaying of the next auxiliary graphical image.
According to one embodiment of the invention, the processing for analyzing a set of parametrization data comprises the storing of different groups of color/mixing coefficient pairs in different respective ele
Allen Dyer Doppelt Milbrath & Gilchrist, P.A.
Hsia Sherrie
Jorgenson Lisa K.
STMicroelectronics S.A.
LandOfFree
Process and system for formulating digital images resulting... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Process and system for formulating digital images resulting..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Process and system for formulating digital images resulting... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2855841