Computer graphics processing and selective visual display system – Computer graphics processing – Three-dimension
Reexamination Certificate
2000-06-09
2003-05-27
Jankus, Almis R. (Department: 2671)
Computer graphics processing and selective visual display system
Computer graphics processing
Three-dimension
C345S007000, C345S008000, C345S009000, C348S042000, C348S047000, C359S234000, C359S017000
Reexamination Certificate
active
06570566
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to an image processing apparatus and image processing method, and particularly relates to an image processing apparatus and image processing method capable of showing three-dimensional images of a sensation closer to observations made in actual space with a system which provides three-dimension information images such as with computer graphics and the like, and more specifically relates to an image processing apparatus and image processing method capable of performing control so as to generate and show three-dimensional images of a sensation closer to observations made in actual space by means of showing images in focus and images not focused, i.e., images with out-of-focus generated, according to the point-of-view position information of the user.
2. Description of the Related Art
As a technique for showing three-dimensional images, there is a method wherein two images provided with parallax of the left and right eyes are generated, and shown to the respective left and right eyes. For example, an arrangement wherein objects and scenes in images are made to be viewed in a three-dimensional manner, by means of showing two images generated taking the parallax of the left and right eyes into consideration to the left and right eyes of a user wearing an HMD (Head Mounted Display) is in practical use.
Multiple conventional examples for showing three-dimensional images taking the parallax of the left and right eyes into consideration will be described with reference to
FIGS. 1A-1C
.
FIG. 1A
is an example primarily widely applied in the fields of video conferencing and remote-controlled robot vision, and is used to show the state of remote areas to a user in a three-dimensional manner, for example. As shown in
FIG. 1A
, the same object is simultaneously imaged with two cameras
101
and
102
regarding which the positional relation has been fixed. For example, the optical axes are positioned parallel and the same object or scene is taken by each, so that individual images for each are taken. The positional relation of the two cameras
101
and
102
is determined taking parallax into consideration, with the camera
101
taking images for the left eye, and the camera
102
taking images for the right eye. The images taken by each camera are displayed on two image display units, i.e., a left eye image display unit L
103
and a right eye image display unit R
104
, and the user observes the image taken with camera
101
with the left eye and the image taken with camera
102
with the right eye, and thus can experience a three-dimensional sensation as if the user were actually viewing the object or scene with naked eyes.
FIG. 1B
is an example of application in a field called VR (Virtual Reality) or MR (Mixed Reality), and is a configuration wherein a three-dimensional space created within a calculator can be shown to a user in a virtual manner, or the computer-synthesized three-dimensional image can be superimposed over a real-space image taken by the system shown in FIG.
1
B. Three-dimensional information defining a scene or object defined in a virtual three-dimensional space within the calculator is stored within the three-dimensional information storing unit
105
shown in
FIG. 1B
, and a left eye image and right eye image are generated in the parallax image generating unit
106
, based on this three-dimensional information. The left eye image and right eye image generated in the parallax image generating unit
106
are each two different sets of image data generate based on the stored information in the three-dimensional information storing unit
105
, assuming that a virtual object for example is observed from respective visual line directions. The left eye image and right eye image are displayed on the two image display units, i.e., a left eye image display unit L
107
and a right eye image display unit R
108
, and can be viewed by the user as a virtual reality (VR) image as a virtual three-dimensional image on a three-dimensional space created within the calculator, or as a mixed reality (MR) image synthesized with a real-space image taken with a camera or the like. Regarding the MR techniques, in addition to that using an image taken by a camera as described above, there is a configuration called “see-through” type wherein a virtual object is superimposed on a world which the user is directly viewing, using a half-mirror or the like (e.g., “Technique for Positioning Real Worlds and Virtual Worlds”, Kiyohide Sato, Image Recognition and Understanding Symposium, July 1998).
FIG. 1C
is a technique used in 3D movies, and is a configuration wherein image data is prepared separately as left eye images and right eye images beforehand, stored in an image storing unit L
109
and image storing unit R
110
, and synthesized to be displayed on an image display unit L
111
and an image display unit R
112
.
The examples shown in
FIGS. 1A-1C
are configurations for showing three-dimensional images by displaying images separately for left and right eyes, but there are also methods for realizing displaying of three-dimensional images without having two image display units, i.e., with only one image display unit. This includes a method wherein the user wears glasses wherein the polarized plane of incident light to the left and right eyes becomes perpendicular, the images to be shown to the left and right eyes respectively are polarized and displayed, so as to observe images with the left and right eyes from respective points of view, a method wherein the user wears glasses capable of transmitting or shielding incident light to the left and right eyes by using liquid crystal shutters or the like, and alternately displaying images to be shown to the left and right eyes respectively in time-sequence at high speed, so as to observe images with the left and right eyes from respective points of view, and so forth.
The above conventional art represents a three-dimensional sensation by individually showing to the left and right eyes of the user two sets of image data taking parallax of the left and right eyes into consideration. However, parallax is not the only information necessary for humans to obtain a three-dimensional sensation. In the event of humans viewing an actual three-dimensional space, the eyes focus on an object at a fixation point by adjusting the thickness of the crystalline lens which serves as the lens of the eye. Thus all objects except that at the point of fixation are out of focus according to the distance thereof from the object at the fixation point, and these appear to the human eye as fuzzy or out-of-focus images. This fuzzy focus has not been taken into consideration in conventional three-dimensional image showing apparatuses, with the outline of almost all object images contained within the area image at differing distances from the fixation point being displayed clearly, giving the user viewing the images an unnatural sensation.
Thus, many conventional three-dimensional image showing apparatuses show the outline of objects contained within the area other than the fixation point at differing distances from the fixation point as clearly as that of the object at the fixation point. Accordingly, a great number of images regarding which the user is not focused upon, i.e., at positions other than the fixation point, are observed by the user with clear outlines. Such a configuration not only gives the user viewing the three-dimensional images an unnatural sensation, but also is burdensome for the eyes of the user and has been a cause of increased fatigue for the user.
SUMMARY OF THE INVENTION
The present invention has been made in light of such conventional art, and accordingly, it is an object thereof to provide an image processing apparatus, image processing method, and program providing medium, wherein three-dimensional images closer to real space can be shown to the user, by means of obtaining the fixation point position of the user observing three-dimensional images, generating out
Bell Boyd & Lloyd LLC
Jankus Almis R.
Nguyen Kimbinh T.
LandOfFree
Image processing apparatus, image processing method, and... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image processing apparatus, image processing method, and..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image processing apparatus, image processing method, and... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3002250