Television – Stereoscopic – Signal formatting
Reexamination Certificate
1999-12-17
2001-04-10
Le, Vu (Department: 2713)
Television
Stereoscopic
Signal formatting
C348S042000, C345S419000
Reexamination Certificate
active
06215516
ABSTRACT:
BACKGROUND OF THE INVENTION
This invention relates to a method and an apparatus for converting monoscopic (i.e., two-dimensional) images into stereoscopic (i.e., three-dimensional) images, and more particularly using image warping.
The human brain perceives depth by receiving two different images, which are horizontally shifted relative to each other, from each eye. Such depth information is important for determining how far away an object is and the depth arrangements between various objects in a scene. Unfortunately, most images are recorded in monoscopic format on recording medium (e.g., motion picture film and video media) where some depth information is lost. However, even a monoscopic camera lens produces an image according to the laws of Cartesian space and perspective. If such an image could be processed to extract that information, and thus be converted into three-dimensional stereoscopic format, there could be a vast amount of stereoscopic material available for three-dimensional viewing.
There are several methods to generate stereoscopic images from monoscopic images. One method, the horizontal shift method, isolates several important objects in the image field and shifts them horizontally. B. J. Garcia, Ph.D. and R. J. Greenstein, M.D., “True-Stereoscopic Video Media from Monoscopic Sources: The DeepVision System for Minimally Invasive Surgery,”
Medical Applications, Virtual Reality Systems,
pp. 52-57 (1994). The amount of the shift for each object varies according to its depth arrangement. The depth arrangement (also referred to as stereoscopic depth cue or binocular disparity) of an object can be set manually using cues such as shadows and the perspective within the monoscopic image. This process creates a stereoscopic image with depth perception between objects, but the objects themselves lack depth and appear to be flat cardboard cutouts.
Another method, the frame delay method, uses moving images to extract a second perspective. H. Murata, T. Okino, T. Iinuma, S. Yamashita, S. Tanase, K. Terada and K. Kanatani, “Conversion of Two-Dimensional Images to Three Dimensions, ”
SID
95
Digest, Society for Information Display
1995
Symposium Proceedings
(1995). When an object is in motion, a series of different perspectives is generated due to either the object's movement or the camera's motion. Different perspectives from different images in a time series can then be extracted to generate a second perspective for the stereoscopic effect. Though this technique can create very realistic three-dimensional effects, it requires that motion of both the camera and the objects be limited to a direction horizontal to the image frame's horizontal axis. The camera must move in a horizontal fashion perpendicular to the subject matter (this is called a “truck” in the motion picture industry). The reason for this perpendicular motion is that each stereoscopic image pair is formed by pairing up images which are delayed from each other. Because the camera is limited to sideways motion, the delay between images results in a parallel camera separation. If the camera were not moving in a perpendicular and horizontal manner, the image pairs would not be parallel and would not form a good stereoscopic image. Also, since this technique requires a series of images taken at different times, a single image cannot be converted.
In view of the foregoing, it would be desirable to be able to provide a method and an apparatus for converting monoscopic images into stereoscopic images which gives the appearance of depth to objects themselves, as well as the appearance of depth between objects. It would also be desirable to be able to convert images with vertical as well as horizontal object motion relative to the frame's horizontal axis. It would also be desirable to be able to convert a single image.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a method and an apparatus for converting monoscopic images into stereoscopic images which gives the appearance of depth to objects themselves, as well as the appearance of depth between objects.
It is also an object of the present invention to provide a method and an apparatus for converting images with vertical as well as horizontal object motion relative to the frame's horizontal axis.
It is another object of the present invention to provide a method and an apparatus for converting a single image.
These and other objects of the invention are accomplished in accordance with the principles of the invention by identifying at least one object in the monoscopic image with a first perspective, outlining the object to generate an outline, endowing the object with depth information and generating a second perspective by image warping the object.
Possible applications for such a method and apparatus include rapid conversion of existing monoscopic movie and video media, as well as still photograph (i.e., single image), libraries to stereoscopic images.
REFERENCES:
patent: 4645459 (1987-02-01), Graf et al.
patent: 4925294 (1990-05-01), Geshwind et al.
patent: 4992780 (1991-02-01), Penna et al.
patent: 5040005 (1991-08-01), Davidson et al.
patent: 5050984 (1991-09-01), Geshwind
patent: 5479603 (1995-12-01), Stone et al.
patent: 5510831 (1996-04-01), Mayhew
patent: 5510832 (1996-04-01), Garcia
patent: 5511153 (1996-04-01), Azarbayejani et al.
patent: 5523886 (1996-06-01), Johnson-Williams et al.
patent: 5581638 (1996-12-01), Givens et al.
patent: 5652851 (1997-07-01), Stone et al.
patent: 5727078 (1998-03-01), Chupaeu
patent: 5748199 (1998-05-01), Palm
patent: 5808664 (1998-09-01), Yamashita et al.
patent: 5973700 (1999-10-01), Taylor et al.
patent: 6005967 (1999-12-01), Nakagawa et al.
patent: 6031564 (2000-02-01), Ma et al.
patent: 0 735 512 A3 (1996-02-01), None
patent: 0 798 666 A2 (1997-01-01), None
B.J. Garcia, Ph.D. and R.J. Greenstein, M.D., “True-Stereoscopic Video Media from Monoscopic Sources: The DeepVision System for Minimally Invasive Surgery,” Medical Applications,Virtual Reality Systems,pp. 52-57 (1994).
H. Murata, T. Okino, T. Iinuma, S. Yamashita, S. Tanase, K. Terada and K. Kanatani, “Conversion of Two-Dimensional Images to Three Dimensions, ” SID 95 Digest,Society for Information Display 1995 Symposium Proceedings(1995).
Christopher Watkins, Alberto Sadun, Stephen Marenka, “Modern Image Processing: Warping, Morphing, and Classical Techniques,” Academic Press Professional, Inc. (1993).
G.R. Engel, “An Investigation of Visual Responses to Brief Stereoscopic Stimuli,”Q. Jl exp. Psychol.22, 148-166 (1970).
Perry Hoberman, “Depth Painting: The Interactive Transformation of Existing Images Into Stereoscopic 3D,” 78 SPIE vol. 2177.
Ma Kelvin
Swift David
Brill Gerow D.
Fish & Neave
Le Vu
Reveo Inc.
Weiss Joel
LandOfFree
Method and apparatus for monoscopic to stereoscopic image... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for monoscopic to stereoscopic image..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for monoscopic to stereoscopic image... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2456343