Sketching reality

Details Sketching reality Sketching reality

2006-10-31

2009-12-29

Chang, Kent (Department: 2628)

Computer graphics processing and selective visual display system

Computer graphics processing

Three-dimension

C345S420000, C345S619000, C382S181000, C382S204000

Reexamination Certificate

active

07639250

ABSTRACT:
Systems and methods for sketching reality are described. In one aspect, a set of vector primitives is identified from a 2-D sketch. In one implementation, the 2-D sketch is hand-drawn by a user. A 2.5D geometry model is automatically generated from the vector primitives. The 2.5D geometry model is automatically rendered and presented to a user. In one implementation, the user provides 2-D sketch-based user inputs to modify one or more of lighting position, lighting direction, lighting intensity, texture, color, and geometry of the presentation.

REFERENCES:
patent: 4774685 (1988-09-01), Samuels
patent: 5133052 (1992-07-01), Bier et al.
patent: 5339367 (1994-08-01), Roth
patent: 5847712 (1998-12-01), Salesin et al.
patent: 6229546 (2001-05-01), Lancaster et al.
patent: 6308144 (2001-10-01), Bronfeld et al.
patent: 6912293 (2005-06-01), Korobkin
patent: 2002032742 (2002-01-01), None
Alex P. Pentland. Finding the illuminant direction. Nov. 29, 1981. Journal of Optical Society of America. vol. 72, No. 4.
M. Straforini, C. Coelho, M. Campani, and V. Torre. The Recovery and Understanding of a Line Drawing from Indoor Scenes. Feb. 1992. IEEE Transactions on Pattern Analysis and Machine Intelligence. vol. 14, No. 2. p. 298-303.
B.S. Manjunath and W.Y. Ma. Texture Features for Browsing and Retrieval of Image Data. Aug. 1996. IEE Transactions on Pattern Analysis and Machine Intelligence. vol. 18, No. 8. p. 837-42.
Ingo Wald, Philipp Slusallek, Casten Benthin, and Markus Wagner. Interactive Rendering with Coherent Ray Tracing. Eurographics 2001. vol. 20, No. 3.
P. Bellutta, G. Collini, A. Verri, V. Torre, “3D Visual Information from Vanishing Points”, Nov. 29, 1989, IEEE, Interpretation of 3D Scenes, 1989, Proceedings., Workshop on, p. 41-49.
T. Kanade, “A Theory of Origami World”, Jun. 1980, Artificial Intelligence, vol. 13, p. 279-311.
T. Whitted, “An Improved Illumination Model for Shaded Display”, 1980, ACM.
Agusanto, et al, “Photorealistic Rendering for Augmented Reality Using Environment Illumination”, Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '03).
Alvarado, et al, “SketchRead: a Multi-Domain Sketch Recognition Engine”, UIST '04, Oct. 24-27, Santa Fe, New Mexico.
Ao-yu, et al, “A Survey of Silhouette Detection Techniques for Non-Photorealistic Rendering”, Proceedings of the Third International Conference on Image and Graphics (ICIG'04).
Barrett, et al, “Object-Based Image Editing”, Association for Computer Machinery, Inc., 2002.
Bartalmio, et al, “Image Inpainting”, Electrical and Computer Engineering, University of Minnesota.
Collomosse, et al, “Painterly Rendering Using Image Salience”, Department of Computer Science, University of Bath, England.
Correa, et al, “Texture Mapping for Cel Animation”, Princeton University.
Coyne, et al, “WordsEye: An Automatic Text-to-Scene Conversion System”, ATandT Labs-Research.
Criminisi, et al, “Single View Metrology”, Department of Engineering Science, Univesity of Oxford, Oxford UK.
de Souza, et al, “Fragment-Based Image Completion”.
Debevec, “Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-Based Graphics with Global Illunination and High Dynamic Range Photography”, University of California at Berkeley.
Dick, et al, “Combining Single View Recognition and Multiple View Stereo for Architectural Scenes”.
Fant, et al, “Textureship: Texture Synthesis as a Photograph Editing Tool”, University of Illinois, Urbana-Champaign.
Funkhouser, et al, “Modeling by Example”.
Gooch, et al, “A Non-Photorealistic Lighting Model for Automatic Technical Illustration”, Department of Computer Science, University of Utah.
Grimstead, et al, “Creating Solid Models from Single 2D Sketches”, Univeristy of Wales College of Cardiff.
Halle, “Multiple Viewpoint Rendering”, Brigham and Women's Hospital.
Horry, et al, “Tour Into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image”.
Igarashi, et al, “Teddy: A Sketching Interface for 3D Freeform Design”.
Kalnins, et al, “WYSIWYG NPR: Drawing Strokes Directly on 3D Models”, Copyright 2002, Association for Computing Machinery.
Kazhdan, et al, “Shape Matching and Anisotropy”.
Keren, et al, “Placing Three-Dimensional Models in an Uncalibrated Single Image of an Architectural Scene”.
Klein, et al, “Non-Photorealistic Virtual Environments”, Princeton University.
Legakis, et al, “Feature-Based Cellular Texturing for Architectural Models”, Coyright 2001.
Mahoney, et al, “Three Main Concerns in Sketch Recognition and an Approach to Addressing Them”, Palo Alto Research Center, Copyright 2002, American Association for Artificial Intelligence.
Matsuda, et al, “Freehand Sketch System for 3D Geometric Modeling”, Dept. of Information and Computer Sciences, Saitama University, Japan, 1997.
Mayer, et al, “Multiresolution Texture for Photorealistic Rendering”, Copyright 2001 IEEE.
Mcfadzean, et al, “An Analysis of Architectural Visual Reasoning in Conceptual Sketching via Computlational Sketch Analysis (CSA)”, The Open University, Department of Design and Innovation, Milton Keynes, UK, Copyright 1999 IEEE.
Mignotte, “Unsupervised Statistical Sketching for Non-Photorealistic Rendering Models”, DIRO, Department d'Informatique et de Recherche Operationnelle, Montreal, Quebec, Canada.
Neyret, et al, “Pattern-Based Texturing Revisted”.
Oh, et al, “Image-Based Modeling and Photo Editing”, Laboratory for Computer Science, Massachusetts Institute of Technology, Aug. 2001.
Oliveira, et al, “Relief Texture Mapping”, University of North Carolina at Chapel Hill.
Parish, et al, “Procedural Modeling of Cities”, Copyright 2001.
Reche, et al, “Volumetric Reconstruction and Interactive Rendering of Trees from Photographs”, Copyright 2004.
Rother, “A New Approach for Vanishing Point Detection in Architectural Environments”, Computatinoal Vision and Active Perception Laboratory (CVAP), Royal Institute of Technology, Stockholm, Sweden.
Schumann, et al, “Assessing the Effect of Non-Photorealistic Rendered Images in CAD”, Copyright 1996.
Sezgin, et al, “Sketch Based Interfaces: Early Processing for Sketch Understanding”, Copyright 2001.
Shade, et al, “Layered Depth Images”.
Simhon, et al, “Sketch Interpretation and Refinement Using Statistical Models”, McGill University, Quebec, Canada, Copyright 2004, The Eurographics Association.
Stoyanov, et al, “Current Issues of Photorealistic Rendering for Virtual and Augmented Reality in Minially Invasive Surgery”, Proceedings of the Seventh International Conference on Information Visualization, Copyright 2003.
Thorne, et al, “Motion Doodles: An Interface for Sketching Charachter Motion”, Copyright 2004.
Turk, “Texture Synthesis on Surfaces”, GVU Center, College of Computing, Georgia Institute of Technology, 2001.
Varley, et al, “A System for Constructing Boundary Representation Solid Models from a Two-Dimensional Sketch”, Department of Computer Science, CArdiff University, Cardiff, Wales, UK.
Winnemoller, et al, “Rendering Optimisations for Stylised Sketching”, Association for Computing Machinery, Inc., Copyright 2003.
Wonka, et al, “Instant Architecture”.
Yu, et al, “Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs”, Computer Science Division, University of California at Berkeley.
PCT International Search Report dated Mar. 29, 2007, from counterpart PCT application, PCT/US2006/042783, 3 pages.

Affiliated with

Also associated with

Rating

Sketching reality does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Sketching reality, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Sketching reality will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4080761