Computer graphics processing and selective visual display system – Display peripheral interface input device – Light pen for fluid matrix display panel
Reexamination Certificate
1998-06-22
2001-07-31
Zimmerman, Mark (Department: 2671)
Computer graphics processing and selective visual display system
Display peripheral interface input device
Light pen for fluid matrix display panel
C382S285000, C382S308000
Reexamination Certificate
active
06268846
ABSTRACT:
BACKGROUND
The present invention relates to the fields of computer graphics and image manipulation. More particularly, the invention relates to techniques for generating three dimensional (3D) graphics directly from images, without constructing a 3D model explicitly.
Conventionally, a 3D modeling and rendering process is used for representing different views of a 3D scene. The usual steps in constructing a 3D model include: loading an image or previous saved work; displaying the image; identifying one or more object features in the image; finding the object features in 3D space; displaying a model of object features in 3D space; measuring lengths, distances and angles of the objects; and saving the work. These steps can be repeated until satisfactory results are obtained. This process requires a great deal of user interaction and is time-consuming. The user has to construct detailed models (e.g., polygon or wire frame) of the objects appearing in an image.
Once 3D models are obtained, the models may be animated by varying them and displaying the varied models at a predetermined frame rate. However, it is difficult to manipulate computer graphics representations of three-dimensional models, for example to rotate the object or “fly through” a scene. If many objects need to be displayed, or many surface textures need to be filled, the time required to compute new views can be prohibitive. The conventional 3D rendering process is thus compute intensive and also the rendering time depends on the complexity of the visible part of the scene.
On another note, one type of special effect in computer graphics is known as morphing. The morphing operation changes one picture to another by creating a smooth transitional link between the two pictures. The process preserves features associated with each image by mapping the features from a source image to corresponding features in a destination image. Morphing couples image warping with color interpolation. Image warping applies two dimensional geometric transformations on images to align their features geometrically, while color interpolation blends their colors. In this way, a seamless transition from one picture to another is achieved.
It can be expected that morphing between two views may be used to generate an effect of moving a camera while taking a movie. Distortions in the geometry of the images generated by morphing often arise when morphing is used to generate the effect of moving a camera. In a method known as view morphing, two parallel views taken by two cameras are interpolated and a special geometry is designed so that the distortions are eliminated. Any view from a point on the line connecting the two view points can be synthesized. However, the view morphing method cannot synthesize a view from any point in 3D space and can only synthesize views on a line connecting the two cameras.
SUMMARY
A computer-implemented method generates a new view of a three-dimensional scene by receiving three or more pictures representing three or more different view points on a plane, each picture taken from a viewing direction perpendicular to the plane; selecting a new point on the plane; and generating the new view of the three dimensional scene from the new point by morphing among the three or more pictures.
In another aspect, the method may also generate the new view by receiving two or more pictures from two or more view points located on a line along the direction of view; projecting the two or more pictures onto a cylinder; performing a multi-image morph on the images projected on the cylinder; and projecting the result of the multi-image morph to generate the new view of the three dimensional scene.
In yet another aspect, the method can also generate the new view by receiving three or more images representing three or more different view points on a first plane, each image taken from a viewing direction perpendicular to the first plane; receiving three or more images from three or more different view points on a second plane, each image taken from a viewing direction perpendicular to the second plane, the first plane being parallel to the second plane; and generating the new view of the three dimensional scene from an arbitrary point in three dimensional space by morphing among the six or more images. More than two parallel planes can be used with a similar setting.
In another aspect, the method can synthesize the view after changing the lighting of a three dimensional scene from a first light source to a second light source by creating views of the three dimensional scene from viewpoints of the first light source and the second light source, respectively; determining a mesh associated with the view of the three dimensional scene from the first light source; determining a mesh associated with the view of the three dimensional scene from the second light source; determining the amount of light based on the ratio of the areas of pairs of corresponding quadrilaterals in the meshes; and generating the new view of the three dimensional scene with the determined lighting. The input pictures are taken with the first light source.
Implementations of each of the above aspect may include the following. The picture may be taken using a virtual camera, including a physical camera or a computer image generator. Further, one virtual camera is positioned at each view point, or alternatively, all images may be taken by one virtual camera sequentially from each view point. Additionally, a movie may be generated by generating a sequence of views from a sequence of new points.
Advantages of the invention include the following. The invention permits the user to generate any desired 3D view, if provided with a small number of appropriately chosen starting images. The invention avoids the need for 3D shape modeling. System performance is enhanced because the morphing process requires less memory space, disk space and processing power than the 3D shape modeling process. The need for 3D modeling, which is not only time-consuming, but is also practically impossible in certain cases such as modeling hair or trees, is obviated.
Further, rendering speed is independent of the complexity of the scene. Also, the resulting 3D images are strikingly lifelike and visually convincing because they are derived from images and not from geometric models. The multi-image morphing process correctly simulates effects of specular reflectivity. The invention thus provides a powerful and lasting impression, engages audiences and creates a sense of reality and credibility.
REFERENCES:
patent: 5598515 (1997-01-01), Shashua
patent: 5764231 (1998-06-01), Ray et al.
patent: 5959718 (1999-09-01), Morton
patent: 6064399 (2000-05-01), Teo
Seungyong Lee et al., “Polymorph: Morphing Among Multiple Images,”IEEE,60-73, 1998.
Todor Georgiev, “Movie Compression and Motion Editing by Multi-Image Morphing,” 20 pgs. 1997.
Jain et al., “Algorithms for Clustering Data,”Prentice Hall,Englewood Cliffs, NJ, 24-36, 1988.
Turk et al., “Eigenfaces for Recognition,” Massachusetts Institute of Technology,Journal of Cognitive Neurosciencevol.3, No.1, 72-86, 1991.
Devijver et al., “Pattern Recognition: a Statistical Approach,”Prentice Hall International,301-341, 1982.
George Wolberg, “Digital Image Warping,”IEEE Computer Society,41-65, 1990.
Klaus et al., “Robot Vision,” The MIT Electrical Engineering and Computer Science Series, 279-95, 1986.
Johnson et al., “Applied Multivariate Statistical Analysis,” University of Wisconsin-Madison,Prentice-Hall, Inc.,361-388, 1982.
Beymer et al., “Example Based Image Analysis and Synthesis,”Massachusetts Institute of Technology Artificial Intelligence Laboratory,Memo No. 1431, Paper No.80, 21 pgs., Nov. 1993.
Wolberg, “Motion Field & Optical Flow,” Motion Field 12, 279-295, 1990.
T.Georgiev et al., “Morphing Between Multiple Images,” S.Illinois Univ. at Cardbondale dept. of Comp. Science, Technical Report, pp. 17, Apr. 17, 1997.
T.Georgiev, “Morphing Between Multiple Images: Theory and Applications,” Thesis, S.Illinois Univ. at Cardbondale Dept. of Comp. Science, pp. 45,
Adobe Systems Incorporated
Fish & Richardson P.C.
Sealey Lance W.
Zimmerman Mark
LandOfFree
3D graphics based on images and morphing does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with 3D graphics based on images and morphing, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and 3D graphics based on images and morphing will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2516007