Optical: systems and elements – Optical modulator – Light wave temporal modulation
Reexamination Certificate
2002-12-19
2004-06-15
Ben, Loha (Department: 2873)
Optical: systems and elements
Optical modulator
Light wave temporal modulation
C359S224200, C348S750000, C348S755000, C348S758000, C348S771000, C355S032000, C382S298000, C345S032000, C345S215000
Reexamination Certificate
active
06751006
ABSTRACT:
FIELD OF THE INVENTION
This invention relates primarily to electronic projection of images and more particularly to techniques and equipment for processing sub-images prior to their projection onto a screen or other surface for the purpose of superimposing one or more sub-images onto one or more other sub-images.
BACKGROUND OF THE INVENTION
U.S. Pat. No. 5,490,009 to Venkateswar, et al., incorporated herein in its entirety by this reference, discusses a display system in which two sub-images generated using spatial light modulators (SLMs) are partially superposed (with a spatial offset) and displayed simultaneously. As described in the Venkateswar patent, the system purportedly provides enhanced resolution of a projected image by merely increasing the number of SLMs. Either horizontal or vertical resolution, or both, can be enhanced. For example, to approximate a twofold increase in horizontal resolution, the system uses two SLMs, each having x pixels per row and y rows. Each of the two SLMs provides a “sub-image,” generated from alternating samples of data, with the sampling rate providing 2(x) samples per row. The two images are partially superposed, with a horizontal offset of ½ the center-to-center horizontal spacing of the pixels of the SLM. The resulting image has a perceived quality approaching that of a system that generates a single image from a SLM having 2(x) pixels per row.
See Venkateswar, col. 2, ll.
32
-
43
.
FIG. 1
of this application illustrates exemplary spatial superimposition of two imagers; one offset one-half pixel diagonally from the other. Stated differently, the display of
FIG. 1
may be made by offsetting the pixels of Imager A (as compared to those of Imager B) by one-half their size in both the horizontal and vertical dimensions. To permit this type of superimposition, a base image “I” must be processed so as to divide it into two diagonally-offset components, sub-images “I
A
” (associated with Imager A) and “I
B
” (associated with Imager B).
Shown in
FIG. 2
of the Venkateswar patent is a block diagram of a system for displaying superimposed sub-images. Although the illustrated system includes a block designated “processor system” (element
23
of the drawing), the sole recitation of its function is as follows:
Processor system
23
prepares the data for display by performing various pixel data processing tasks. Processor system
23
includes whatever processing memory is useful for such tasks, such as field and line buffers. The tasks performed by processor system
23
may include linearization (to compensate for gamma correction), colorspace conversion, and line generation.
See id. col. 4, ll. 36-42. Thus, absent from the Venkateswar patent is any disclosure of specific techniques for processing base images to obtain any resolution-enhancing benefits of superimposition.
SUMMARY OF THE INVENTION
The present invention addresses such techniques for pre-processing of images to be superimposed for display. In general, the techniques, which utilize signal-processing algorithms, create from a higher resolution image a selected number of components, which components subsequently will be combined through superimposition of multiple imagers. The ultimate result of using these techniques is projection of images with higher resolution than that obtainable through use of each single imager.
Superimposition may be achieved within a projector by combining multiple imagers before the composite image is passed to the projection lens. Alternatively, superimposition may occur by overlaying multiple precisely-aligned projectors. Those skilled in the art will understand that techniques of the present invention are useful in either situation, however, and may be applicable in many cases without regard to the types of SLMs and light valves, sources, or engines employed. In particular, any SLMs utilized in the projection system may—but need not be—the deformable mirror devices (DMDs) referenced in the Venkateswar patent.
Generally speaking, any display based on imagers with a discrete pixel array where the number of pixels for the horizontal and vertical dimensions of the image are fixed has a certain maximum spatial frequency that it can display. It is convenient to convert the spatial frequency of the display from pixels per unit area to a more common imaging dimension such as lines per millimeter which can be done by assuming a reference image size and dividing the number of pixels by that size in millimeters. When such displays are used to show images that are derived from photographic film, for example, such a relationship is particularly useful as it helps to describe how well a photographic image with a certain modulation transfer function (MTF) will be reproduced by the display. MTF is commonly expressed as a graph showing depth of modulation in percent versus lines per millimeter.
For a given reference image size, doubling the number of pixels of the imager will double the maximum spatial frequency that the display can represent. Unfortunately, such a doubling in each direction increases the number of pixels by four (2×2) times, and the difficulty of fabrication of pixel array imagers such as DMDs is greatly increased by such large increases in pixel count.
It is also essential that for a given pixel count, the spatial frequency content of image data to be displayed must be limited so that the spatial frequency capability of the display is not exceeded. If this is not done higher frequencies will be incorrectly displayed as lower ones; a phenomenon commonly called aliasing.
By using the technique of superimposition one can simulate the effect of doubling the number of imager pixels. This requires that a starting image have at least the spatial frequency content from sampling that is two times the spatial frequency limit of either of the two rasters that will be superimposed. This increased spatial frequency content can then be subdivided between the two rasters using suitable re-sampling techniques.
Because the resulting display is composed of superimposed pixels of twice the size (offset by ½ pixel diagonally), there is a summation that takes place at the projection screen. This summation reduces the MTF available above the spatial frequency limit of a single imager, so that the MTF of a display with two superimposed imagers is not exactly equal to that of a single imager with twice as many pixels, but the improvement is still significant. The summation has the additional benefit that the visibility of subraster pitch artifacts in the display (such as the gaps between the mirrors of a DMD device) is reduced by the summation of two offset rasters. Additionally, it is necessary to take into account the fact that pixels are adding together at the display by compensating for the increased black level and the effective stretching of the dynamic range that will occur.
REFERENCES:
patent: 4843381 (1989-06-01), Baron
patent: 5086341 (1992-02-01), Tamada et al.
patent: 5386253 (1995-01-01), Fielding
patent: 5490009 (1996-02-01), Venkateswar et al.
patent: 5612753 (1997-03-01), Poradish et al.
patent: 5668611 (1997-09-01), Ernstoff et al.
patent: 5796442 (1998-08-01), Gove et al.
patent: 5809182 (1998-09-01), Ward et al.
patent: 5844663 (1998-12-01), Holley et al.
patent: 5990982 (1999-11-01), Gove et al.
patent: 0 606 162 (1994-07-01), None
patent: 0 751 683 (1997-01-01), None
Patent Abstracts of Japan, vol. 1995, No. 08, Sep. 29, 1995 & JP 07 134275 A (Mitsubishi Electric Corp), May 23, 1995 abstract.
Patent Abstracts of Japan, vol. 013, No. 587 (P-983) Dec. 25, 1989 & JP 01 251081 A (Toshiba Corp) Oct. 6, 1989.
Takahashi et al., “A Highly Realistic Video Display Based on the Interleave Projection Method,”NTT Review, 5(6):66-68 (Nov. 1993).
Adkins Sean
Zhou Samuel Z.
Ben Loha
Imax Corporation
Kilpatrick & Stockton LLP
Russell Dean W.
Turton Michael J.
LandOfFree
Processing techniques for superimposing images for image... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Processing techniques for superimposing images for image..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Processing techniques for superimposing images for image... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3351444