Computer graphics processing and selective visual display system – Computer graphics processing – Three-dimension
Reexamination Certificate
1997-09-12
2001-05-01
Luu, Matthew (Department: 2672)
Computer graphics processing and selective visual display system
Computer graphics processing
Three-dimension
C345S426000
Reexamination Certificate
active
06226004
ABSTRACT:
COPYRIGHT NOTICE
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by any one of the patent disclosure, as it appears in the Patent and Trademark Office patents files or records, but otherwise reserves all copyright rights whatsoever.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to the field of three dimensional modeling; and more particularly to the creation of three dimensional models from a two dimensional image.
2. Description of Related Art
Researchers have attempted to create three dimensional models of scenes based on two dimensional photographs. The resulting model helps to provide virtual environments or valuable visualization tools.
Some prior techniques have used architectural plans, CAD designs, and other human input. Such creation of three dimensional models can be expensive and time consuming. Further, such computer generated models may not accurately reflect the look of the scene which is being modeled.
Attempts have been made to create models from two dimensional photographs. Some such techniques use stereo computational techniques based on multiple images of the scene to be modeled. Such techniques require more than one photograph of the scene to be modeled.
One modeling system is described in an article entitled “Modeling and Rendering Architecture From Photographs: A Hybrid Geometry- and Image-Based Approach,” Technical Report UCB//csd-96-893, Jan. 19, 1996 by P. Debevec, C. Taylor, J. Malik. Another approach is described in “Semiautomatic 3-D Model Extraction From Uncalibrated 2-D Camera Views,” MIT Media Laboratory by S. Becker and V. Bove.
“Constraints” are relationships between aspects of items in a scene, such as a parallel relationship between surfaces. Using constraints, researchers have attempted to solve for three dimensional models of scenes.
One method for extracting a three dimensional model of an object based on image data is described in U.S. Pat. No. 5,633,995 by McClain. In McClain, multiple cameras are shown to acquire information about a scene.
One problem encountered in three dimensional modeling from two dimensional photographs relates to distortion in the image due to a camera's characteristics.
A photograph from which a model is to be created may lack significant indications of physical structure that would allow a three dimensional model to be easily created from the photograph. There may be a lack of sufficient number of surfaces visible that have knowable orientations and interconnectivity relationships. Such an under-constrained situation may lead to solutions for the camera model and scene model that may be consistent with the available data but which yield some aspects that may not appear correct to a human observer.
Even in over-constrained cases, errors in the determination of image positions, as well as errors in the constraints supplied, may lead to a solution that yields an image that does not appear perfectly accurate.
Prior techniques of creating three dimensional models have the disadvantage of requiring extensive information about scene geometry that may not be available in the images provided. Further, using models created by prior techniques, resulting projections of images may not appear correct. Thus, there is a need for an improved method of creation of three dimensional models.
SUMMARY OF THE INVENTION
One embodiment of the invention includes a method of creating a three dimensional model of a scene based on a two dimensional image of the scene. The method includes identifying a plurality of surfaces in the image, identifying a plurality of constraints between the surfaces in the image, identifying a pattern on a first surface in the image, identifying a identifying a first constraint between the pattern and another feature of the image, and generating a three dimensional model of the scene based on the surfaces, the plurality of constraints, and the first constraint.
In one embodiment of the invention, the pattern includes a grout line in a tile surface. Alternatively, the pattern may include, for example, a mark on a wall paper. Identifying a plurality of surfaces in the image may include drawing lines on an image, the lines corresponding to edges of a surface. In one embodiment the another feature includes a surface; in another embodiment it comprises a second pattern. In one embodiment, the plurality of constraints includes a parallel relationship; in another embodiment the plurality of constraints includes a perpendicular relationship.
REFERENCES:
patent: 5255352 (1993-10-01), Falk
patent: 5268997 (1993-12-01), Funaki
patent: 5497452 (1996-03-01), Shimizu et al.
patent: 5511153 (1996-04-01), Azarbayejani et al.
patent: 5617510 (1997-04-01), Keyrouz et al.
patent: 5633995 (1997-05-01), McClain
patent: 5784063 (1998-07-01), Nagakura et al.
patent: 5903270 (1999-05-01), Gentry
Becker, S. et al., “Semiautomatic 3-D model extraction from uncalibrated 2-D camera views”, MIT Media Laboratory, Proceedings of the SPIE—The International Society for Optical Engineering Conference, vol. 2410, (1995) 15 pages.
Debevec, P. et al., “Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach”, Technical Report UCB//CSD-96-893, Univ. of Cal. at Berkeley, Jan. 1996, pp. 1-33.
Autodesk, Inc.
Harrison Chante
Luu Matthew
Wilson Sonsini Goodrich & Rosati
LandOfFree
Modeling system using surface patterns and geometric... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Modeling system using surface patterns and geometric..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Modeling system using surface patterns and geometric... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2551119