Computer graphics processing and selective visual display system – Display peripheral interface input device – Light pen for fluid matrix display panel
Reexamination Certificate
1998-04-28
2001-01-09
Wu, Xiao (Department: 2774)
Computer graphics processing and selective visual display system
Display peripheral interface input device
Light pen for fluid matrix display panel
C345S504000, C345S156000, C345S156000
Reexamination Certificate
active
06172669
ABSTRACT:
FIELD OF THE INVENTION
The present invention is directed to computer systems that are capable of displaying both video and graphic information, particularly computer systems of this type in which the video and graphic data are stored in a shared memory.
BACKGROUND OF THE INVENTION
Computers with so-called multimedia capabilities offer the user the ability to process and display a variety of different types of information. Some computers within this general category have the ability to display a video presentation, as well as graphical information. In the context of the present invention, the term “graphic” refers to computer-generated pixel data that is displayed on a computer's monitor, whereas the term “video” refers to pixel data that is originally generated from an external source, such as an NTSC broadcast or a video tape, although it could be currently stored within the computer. Typically, the video presentation might be displayed in a window within the display area of the monitor. The frame of the window represents graphical information, whereas the contents of the window comprise the video presentation itself. In addition to the frame for the video presentation, other graphical elements might appear on the display screen. For example, additional windows, icons, and menu bars may be present on the screen.
For those portions of the display in which the video information appears, the display system determines whether the video data or the graphical data is to be displayed, based on color keying information contained within the display data, typically the graphical data. Normally, the video information will be displayed, so that the user can view an incoming video presentation in real time. However, if the user actuates a pulldown menu which overlaps the video window, for example, it is preferable to have the graphical data, i.e., the menu, displayed in the overlapping area, in lieu of the video information. As such, both the graphical and video data must be presented to the display system from memory, so that it can choose the proper information to display.
In the past, the video data and the graphical data were stored in separate memories, from which each could be simultaneously retrieved and presented to the display system. For more efficient memory utilization, and to reduce cost, it is desirable to employ a single memory buffer to store both the graphical and video information. For example, in one implementation of such an arrangement, a single memory device can be divided into three frame buffers. One of the frame buffers stores the graphical information, while the other two buffers store alternate frames of the video data. An incoming video frame is stored in one of the video buffers, while the immediately preceding frame is retrieved from the other video buffer and forwarded to the display.
Although the use of a single memory reduces the costs associated with storing graphical and video information, it also presents practical problems with respect to the retrieval of information. More particularly, in the portion of the display in which both the video and graphical data are presented to the display system, twice as much data must be retrieved from the memory. In other words, the memory must operate with sufficient speed, i.e., have enough bandwidth, to supply all of the data at the required rate. Otherwise, a single memory device cannot be practically employed to store both the graphical and the video information.
Another consideration associated with the use of a single memory for both graphical and video data relates to the addressing of the memory to retrieve the data. For maximum memory utilization, many computer systems store graphical data in a packed pixel format. In this approach, pixel data for a given scan line begins at the first byte following the byte containing the last pixel data for the immediately preceding line. In other words, there are no “unused addresses” in the memory between the data bytes for adjacent scan lines. This approach provides the advantage that there is a consistent, readily determined address offset between any two pixels of the display.
Video data might not be stored in the same manner, however. Generally speaking, it is desirable to store video data for a given scan line as a contiguous block, and not divide it over natural byte boundaries, such as different rows of the memory, for example. Thus, if the amount of data for an integer number of scan lines is not equal to the length one row of data in the memory, there will be unused address locations in each row of the video buffer. Because of this, the address offset between various pixels of the video information will not be consistent, making the retrieval of video data by the central processing unit of the computer more difficult.
A further consideration when both video and graphical information is displayed relates to the processing of data which defines each type of information. Typically, a color imaging system includes a color look-up table (CLUT) that maps pixel data into red, green and blue (RGB) component values for controlling the display monitor to generate desired colors. The CLUT is designed in accordance with the format of the pixel data, as well as the particular color palette designated by a user or an application program. If the video data is not in the same format as the graphical pixel data, the resulting video display can be adversely affected. For example, if the video data is in a format which employs 16 bits per pixel, but the graphical data only contains 8 bits per pixel, one-half of the color information for the video presentation will be lost if it is processed in a CLUT that is based on an 8-bit per pixel format.
Accordingly, it is desirable to provide a computer system in which video and graphic data can be stored in the same memory without the need to increase the bandwidth capacity of the memory, and to provide an address translator that enables both video data and graphical data to be easily retrieved from the memory. It is further desirable to provide a color processing system in which the video data is not constrained by the format of the graphical data.
SUMMARY OF THE INVENTION
In accordance with the present invention, the first one of these objectives is achieved by interleaving the transfer of video and graphic data from a frame buffer to a display system in a manner which permits operation with a reduced memory bandwidth. For those scan lines of the display in which the video information appears, video data is retrieved from the frame buffer during the horizontal blanking time of the scan. Graphical data is retrieved from the memory during the active portion of each horizontal scan line. By alternating the retrieval of data in this manner, rather than attempting to retrieve video and graphic data simultaneously, a lower bandwidth operation can be employed, thereby reducing the expenses of the memory.
In accordance with another aspect of the invention, an address translator is provided which makes the address locations of the video data appear to have the same format as a packed pixel approach, and thereby provide a consistent addressing scheme to the computer. The address translator comprises a look-up table which contains information pertaining to the storage format for the video data, and an adder which converts virtual addresses generated by the computer into physical addresses for the video buffer. With this feature, the computer can use the same addressing scheme to retrieve graphical data and video data, even though they are stored in different formats.
As a further feature of the invention, separate color look-up tables are employed for the graphic and video data. With this approach, the tables can be tailored to the individual formats of the respective types of data, and each type of data can be processed without loss of information or compromising the resulting display. In addition, different color look-up tables can be swapped for the graphical data, in response to the activation of different application programs, without af
Baker Paul A.
Murphy Michael W.
Apple Computer Inc.
Burns Doane , Swecker, Mathis LLP
Wu Xiao
LandOfFree
Method and apparatus for translation and storage of multiple... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for translation and storage of multiple..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for translation and storage of multiple... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2439700