Computer graphics processing and selective visual display system – Computer graphics processing – Graphic manipulation
Reexamination Certificate
2000-04-27
2009-10-13
Amini, Javid A (Department: 2628)
Computer graphics processing and selective visual display system
Computer graphics processing
Graphic manipulation
Reexamination Certificate
active
07602404
ABSTRACT:
A computer-assisted technique for constructing a three-dimensional model on top of one or more images (e.g., photographs) such that the model's parameters automatically match those of the real world object depicted in the photograph(s). Camera parameters such as focal length, position, and orientation in space may be determined from the images such that the projection of a three-dimensional model through the calculated camera parameters matches the projection of the real world object through the camera onto the image surface. Modeling is accomplished using primitives, such as boxes or pyramids, which may be intuitively manipulated to construct the three-dimensional model on a video display or other display screen of a computer system with a two-dimensional input controller (e.g., a mouse, joystick, etc.) such that the displayed three-dimensional object manipulation emulates physical three-dimensional object manipulation. Camera and primitive parameters are incrementally updated to provide visual feedback of the effect of additional constraints on the three-dimensional model, making apparent which user action may have been responsible for any failure to provide a modeling solution and, thus, allowing for rapid reversal and correction thereof. Surface properties (i.e., textures) may be extracted from the images for use in the three-dimensional model.
REFERENCES:
patent: 4969036 (1990-11-01), Bhanu et al.
patent: 5003498 (1991-03-01), Ota et al.
patent: 5010502 (1991-04-01), Diebel et al.
patent: 5469536 (1995-11-01), Blank
patent: 5506949 (1996-04-01), Perrin
patent: 5633995 (1997-05-01), McClain
patent: 5682505 (1997-10-01), Usami et al.
patent: 5699444 (1997-12-01), Palm
patent: 5729471 (1998-03-01), Jain et al.
patent: 5745126 (1998-04-01), Jain et al.
patent: 5748199 (1998-05-01), Palm
patent: 5761401 (1998-06-01), Kobayashi et al.
patent: 5778169 (1998-07-01), Reinhardt
patent: 5821943 (1998-10-01), Shashua
patent: 5850352 (1998-12-01), Moezzi et al.
patent: 5923336 (1999-07-01), Kaercher
patent: 5923573 (1999-07-01), Hatanaka
patent: 5986670 (1999-11-01), Dries et al.
patent: 6009359 (1999-12-01), El-Hakim et al.
patent: 6046745 (2000-04-01), Moriya et al.
patent: 6097394 (2000-08-01), Levoy et al.
patent: 6118474 (2000-09-01), Nayar
patent: 6224222 (2001-05-01), Inoguchi et al.
patent: 6281904 (2001-08-01), Reinhardt et al.
patent: 6333749 (2001-12-01), Reinhardt et al.
patent: 6421049 (2002-07-01), Reinhardt et al.
patent: 2002/0027559 (2002-03-01), Wood
patent: 2002/0059042 (2002-05-01), Kacyra et al.
Paul Debevec et al., Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image- based approac 1996 ACM.
Real-time vision-based camera tracking for augmented reality applications; Dieter Koller, Gudrun Klinker, Eric Rose, David Breen, Ross Whitaker, Mihran Tuceryan, Sep. 1997 Proceedings of the ACM symposium on Virtual reality software and technology.
Texture mapping 3D models of real-world scenes Frederick M. Weinhaus, Venkat Devarajan Dec. 1997 ACM Computing Surveys (CSUR), vol. 29 Issue 4.
Object shape and reflectance modeling from observation Yoichi Sato, Mark D. Wheeler, Katsushi Ikeuchi Aug. 1997; Proceedings of the 24th annual conference on Computer graphics and interactive techniques.
Texture mapping 3D models of real-world scenes Frederick M. Weinhaus, Venkat Devarajan Dec. 1997, ACM Computing Surveys (CSUR), vol. 29 Issue 4, Publisher: ACM Press.
Intelligent scissors for image composition Eric N. Mortensen, William A. Barrett , Sep. 1995 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques Publisher: ACM Press.
A data front-end for layered manufacturing Gill Barequet, Yuval Kaplan , Aug. 1997, Proceedings of the thirteenth annual symposium on Computational geometry Publisher: ACM Press.
Interactive graphics for plastic surgery: a task-level analysis and implementation Steven Pieper, Joseph Rosen, David Zeltzer Jun. 1992 ,Proceedings of the 1992 symposium on Interactive 3D graphics Publisher: ACM Press.
Catadioptric omnidirectional camera Nayar, S.K.; Computer Vision and Pattern Recognition, 1997. Proceedings., 1997 IEEE Computer Society Conference on Jun. 17-19, 1997 pp. 482-488.
Semiautomatic 3-D model extraction from uncalibrated 2-D camera views Shawn Becker and V. Michael Bove, Jr. fsbeck, vmbg@media.mit.ed, Feb. 8-10, 1995 in procedding SPIE visual data exploration and analysis II, vol. 2410, pp. 447-461.
Bundle Adjustment—A Modern Synthesis. Bill Triggs. 1. , Philip McLauchlan. 2. , Richard Hartley. 3. and Andrew Fitzgibbon 2000.
Good features to track Jianbo Shi; Tomasi, C.; Computer Vision and Pattern Recognition, 1994. Proceedings CVPR '94., 1994 IEEE Computer Society Conference on Jun. 21-23, 1994 pp. 593-600.
Interactive construction of 3D models from panoramic mosaics Heung-Yeung Shum; Mei Han; Szeliski, R.; Computer Vision and Pattern Recognition, 1998. Proceedings. 1998 IEEE Computer Society Conference on Jun. 23-25, 1998 pp. 427-433.
Youichi Horry, Ken-Ichi Anjyo, Kiyoshi Arai, “Tour into the picture: using a spidery mesh interface to make animation from a single image”. Aug. 1997 Proceedings of the 24th annual conference on Computer graphics and interactive techniques SIGGRAPH '97.
Paul E. Debevec, Camillo J. Taylor, Jitendra Malik, “Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach” Proceedings of the 23rd annual conference on Computer graphics and interactive techniques SIGGRAPH '96, Aug. 1996.
Paul E. Debevec et al., “Modeling and Rendering Archetecture from Photographs: A hybrid geometry- and image-based approach”,University of California at Berkeley, pp. 1-33 (Jan. 19, 1996).
Michael Gleicher and Andrew Witkin, “Through-the-Lens Camera Control”,Carnegie Mellon UniversityPittsburgh, PA, pp. 331-340 (1992).
Michael Kass, “Condor: Constraint-Based Dataflow”,Computer Graphics, vol. 26, No. 2, pp. 321-330 (Jul. 1992).
Robert M. Haralick and Linda G. Shapiro, “Computer and Robot Vision”, pp. 116-151, date of 1992, confirmed by Applicant.
Paul S. Heckbert, “Fundamentals of Texture Mapping and Image Warping”,Computer Science Division University of California Berkeley, pp. 1-87 (Jun. 1989).
Tzay T. Young, “Handbook of Pattern Recognition and Image Processing: Computer Vision”, vol. 2, pp. 1-5.
J.M. Ogden et al., “Pyramid-Based Computer Graphics”,RCA Corp., Reprint RE-30-5-1, pp. 4-15, (Sep./Oct. 1985).
Camillo J. Taylor & David J. Kriegman, “Minizaton on The Lie Group SO(3) and Related Manifolds”,Yale University, Technical Report No. 9405, pp. 1-8, (Apr. 1994).
Camilo J. Taylor & David J. Kriegman, “Structure and Motion From Line Segnants In Multiple Images”,Dept. of Electrical Engineering Yale University, pp. 1-31, date of Jan. 1990.
Shenchang Eric Chen & Lance Williams, “View Interpolation for Image Synthesis”,Apple Computers, Inc., pp. 279-288 (1993).
Youichi Horry et al., “Tour Into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image”,Computer Graphics Proceedings, Annual Conference Series, pp. 225-232 (1997).
Richard Szeliski and Heung-Yeung Shum, “Creating Full View Panoramic Image Mosaics and Environment Maps”,Siggraph, pp. 251-258 (Aug. 3-8, 1997).
Steven M. Seitz and Charles R. Dyer, “View Morphing”,Computer Graphics Proceedings, Annual Conference Series, pp. 21-30 (1996).
Marc Levoy and Pat Hanrahan, “Light Field Rendering”,Computer Graphics Proceedings, Annual Conference Series, pp. 31-42 (1996).
Steven J. Gortler et al., “The Lumigraph”,Computer Graphics Proceedings, Annual Conference Series, pp. 43-54 (1996).
James D. Foley et al., “Computer Graphics: Principles and Practice”,Addision-Wesley Publishing Company, Second Edition pp. 603-647 (1987).
Jeremy S. De Bonet, “Multisolution Sampling Procedure for Analysis and Synthesis
Reinhardt Tilman
Seidl Robert
Adobe Systems Incorporated
Amini Javid A
Kower Robert C
Meyertons Hood Kivlin Kowert & Goetzel P.C.
LandOfFree
Method and apparatus for image assisted modeling of... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for image assisted modeling of..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for image assisted modeling of... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4076838