Bandwidth reduction for stereoscopic imagery and video signals

Details Bandwidth reduction for stereoscopic imagery and video signals Bandwidth reduction for stereoscopic imagery and video signals

2001-01-24

2004-01-13

Diep, Nhon (Department: 2613)

Pulse or digital communications

Bandwidth reduction or expansion

Television or motion video signal

C375S240030

Reexamination Certificate

active

06678323

ABSTRACT:

BACKGROUND OF THE INVENTION
Stereoscopic image sequences are preferred over standard monoscopic image sequences because they provide an additional dimension that can significantly enhance a viewing experience. Not only is perceived depth enhanced, but so is perceived sharpness. However, the advantage of stereoscopic image sequences over monoscopic sequences is obtained with a cost in bandwidth and/or processing. Without extra compression, the bandwidth required to transmit stereoscopic sequences is twice that required for monoscopic sequences, because two streams of images or video signals must be transmitted, one for the left eye and one for the right eye, compared to the single stream required in monoscopic image sequences.
It has been proposed that asymmetrical coding can be used to reduce the required bandwidth for stereoscopic imagery and video signals. One such method has been proposed by M. G. Perkins, in “The Compression of Stereoscopics,
IEEE Transaction in Communications,
40, pp. 644-692, 1992, and by T. Mitsuhashi, “Subjective image position in stereoscopic TV system—Consideration on comfortable stereoscopic images,
Human Vision, Visual Processing and Digital Display V.
2179, pp. 259-266, 1994. Therein it is suggested that by providing a high quality picture to one eye and a reduced quality picture to the other eye, the fused-picture appreciated by the eyes would have a high quality, being dominated by the higher quality picture; this phenomenon has been reported before by visual scientists, e.g., B. Julesz, in Foundations of Cyclopean Perception, University of Chicago Press, p. 96, 1971. Thus, the viewer receives, or appears to receive, a high quality picture even though one eye is seeing a reduced quality picture. However, with the above systems, particularly with respect to the system of Perkins, bandwidth reduction is obtained by showing an image having lower quality consistently to one eye. Thus, although stereoscopic images can be of acceptable perceived quality with this method, it produces an imbalance of quality between the two eyes.
SUMMARY OF THE PRESENT INVENTION
As explained above, bandwidth reduction for stereoscopic video signals can be obtained by having one image of a stereoscopic pair of lower quality. Such reduction in image quality to one eye is compensated for by the image quality presented to the other eye, and the perceptually combined stereoscopic images can appear to have high quality. However, the purposeful introduction of an imbalance of quality between the eyes is not desirable for several reasons, including concerns for health, usage, and comfort. Specifically, effects of a sustained imbalance in the two eyes on children, whose visual system may still be developing, can be a safety and health concern, and its usage may give rise to potential liability for 3-D television broadcasters. An imbalance in the two eyes is also not good for people who have a strong dominance in one eye because the lower quality image may end up being presented consistently to the dominant eye, leading to perceived image quality that is worse than intended. Furthermore, this method may lead to visual fatigue especially with sustained viewing, because of a constant imbalance of image quality between the eyes.
The present invention overcomes the above disadvantages by balancing image quality between the two eyes over time. Broadly, the present invention comprises a step of interleaving high-quality images with reduced-quality images for each eye. This methodology spreads the reduced-quality images over the two eyes while maintaining benefits of perceived high image quality and savings in resources required for processing, storage, distribution, transmission, and display of stereoscopic images.
An important feature of the preferred embodiment of this invention is that the inter-leaving is controlled in such a way that reversals in image quality within a stream of images for one eye are yoked to the reversals in image quality in the stream to the other eye. Effectively, there is a cross-switch in image quality between the two streams so that high quality images are alternated between the left and right eyes; one eye always receives a high quality image. By switching, or reversing, the quality of the image between the two eyes, a more balanced effect on the eyes is obtained.
Another novel and key aspect of an embodiment of the invention is that the switching of image quality between the two streams of images occur at significant changes in image contents or features along the streams, so as to render the cross-switching unnoticeable by viewers. The switching need not occur at regular or identical periods; an important aspect of the switching in this embodiment is that it is activated only when a significant change in the picture content occurs. Significant changes are known to occur at scene changes for example, or during a high level of movement within images. Switching is optionally carried out at a significant change in picture luminance. The switching intervals typically vary considerably, eye to eye, there being an overall equalization of the time periods. By switching at significant changes in picture content, the switching is not as noticeable by the viewer, who continues to see a high quality stereoscopic images while disadvantages of possible ill effects on children, problems of a dominant eye and visual fatigue are overcome. Further, reduction in the bandwidth is also achieved. When switching occurs absent a significant change in the image content, the switch is noticeable by the viewer though the advantages of the invention remain supported.


REFERENCES:
patent: 5453787 (1995-09-01), Hancock et al.
patent: 5596321 (1997-01-01), Hekstra et al.
patent: 5727078 (1998-03-01), Chupeau
patent: 6191772 (2001-02-01), Mical et al.
patent: 6476850 (2002-11-01), Erbey
Meegan et al., “Is monocular degradation visible in fused stereo images?”, SPIE vol. 3639, pp. 12-17, Jan. 1999, San Jose California, USA.
Perkins, “Transactions Papers—Data Compression of Stereopairs”, IEEE Transactions on Communications, vol. 40, No. 4, pp. 684-696, Apr. 1992.
Stelmach et al., “Perceptual Basis of Stereoscopic Video”, SPIE vol. 3639, pp. 260-265, Jan. 1999, San Jose California, USA.
Stelmach et al., “Stereo Image Coding Based on Human Visual Characteristics: Mixed Resolution and Unequal Bit-Allocation”, IWSNHC3DI'99, pp. 193-196, Sep. 15-17, 1999, Santorini, Greece.
Stelmach et al., “Stereo Image Coding: Effects of Stereo Mismatches on Image-Quality”, International Workshop on HDTV '96, Oct. 8-9, 1996, Los Angeles California, USA.
Stelmach et al., “Stereo Image Quality: Effects of Spatio-Temporal Resolution”, SPIE vol. 3639, pp. 4-11, Jan. 1999, San Jose California, USA.
Stelmach et al., “Stereoscopic image coding: Effect of disparate image-quality in left- and right-eye views”, Signal Processing: Image Communication 14, pp. 111-117, 1998, Elsevier Science B.V.
Stelmach et al., “Transactions Letters—Stereo Image Quality: Effects if Mixed Spatio-Temporal Resolution”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 10, No. 2, pp. 188-193, Mar. 2000.
Tam et al., “Bandwidth Reduction for Stereoscopic Video Signals”, Stereoscopic Displays and Virtual Reality Systems VII, SPIE vol. 3957, pp. 33-40, Jan. 24-27, 2000, San Jose, California, USA.
Tam et al., “Perceived Image Quality of MPEG-2 Stereoscopic Sequences”, Human Vision and Electronic Imaging II, SPIE vol. 3016, pp. 296-301, Feb. 10-13, 1997, San Jose, California USA.
Tam et al., “Psychovisual aspects of viewing stereoscopic video sequences”, Stereoscopic Displays and Virtual Reality Systems V, SPIE vol. 3295, pp. 226-235, Jan. 26-29, 1998, San Jose, California, USA.
Tam et al., “Visual Masking at Video Scene Cuts”, SPIE vol. 2411, pp. 111-119.

Affiliated with

Also associated with

Rating

Bandwidth reduction for stereoscopic imagery and video signals does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Bandwidth reduction for stereoscopic imagery and video signals, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Bandwidth reduction for stereoscopic imagery and video signals will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3229540