Rapid computer modeling of faces for animation

Image analysis – Applications – Personnel identification

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Reexamination Certificate

active

07082212

ABSTRACT:
Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.

REFERENCES:
patent: 5469512 (1995-11-01), Fujita et al.
patent: 5774591 (1998-06-01), Black et al.
patent: 5864630 (1999-01-01), Cosatto et al.
patent: 5990901 (1999-11-01), Lawton et al.
patent: 5995119 (1999-11-01), Cosatto et al.
patent: 6009210 (1999-12-01), Kang
patent: 6047078 (2000-04-01), Kang
patent: 6072496 (2000-06-01), Guenter et al.
patent: 6118887 (2000-09-01), Cosatto et al.
patent: 6154559 (2000-11-01), Beardsley
patent: 6163322 (2000-12-01), LaChapelle
patent: 6173069 (2001-01-01), Daly et al.
patent: 6188777 (2001-02-01), Darrell et al.
patent: 6301370 (2001-10-01), Steffens et al.
patent: 6445810 (2002-09-01), Darrell et al.
patent: 6496594 (2002-12-01), Prokoski
patent: 6504646 (2003-01-01), Cosatto et al.
patent: 6526161 (2003-02-01), Yan
patent: 6532011 (2003-03-01), Francini et al.
patent: 6549200 (2003-04-01), Mortlock et al.
patent: 6556196 (2003-04-01), Blanz et al.
patent: 6580821 (2003-06-01), Roy
patent: 6661907 (2003-12-01), Ho et al.
patent: 6664956 (2003-12-01), Erdem
patent: 6714660 (2004-03-01), Ohba
patent: 6747652 (2004-06-01), Inoue et al.
patent: 6771303 (2004-08-01), Zhang et al.
patent: 6807290 (2004-10-01), Liu et al.
patent: 6879709 (2005-04-01), Tian et al.
patent: 6919892 (2005-07-01), Cheiky et al.
patent: 7020305 (2006-03-01), Liu et al.
patent: 2002/0102010 (2002-08-01), Liu et al.
patent: 11-1612821 (1999-06-01), None
Pighin Frederic et al, Synthesizing Realistic Facial Expressions from Photographs, ACM ISBN: 0-89791-999-8, 1-10.
Pei et al. Global Motion Estimation in Model-based Image Coding by Tracking Three-Dimensional Contour Feature Points, IEEE 1051-8215/98, 181-189.
“Global Motion Estimation in Model-Based Image Coding by Tracking Three-Dimensional Contour Featu Points”, Pei et al., IEEE, 1051-8215/98, pp. 181-190.
“Resynthesizing facial animation through 3D model-tracking”, Pighin et al., IEEE, Inspec Accession No. 6371194, pp. 1-8.
“Integration of eigentemplate and structure matching for automatic facial feature detection”, Shakunaga et al., IEEE, Inspec Accession No. 5920393, pp. 1-6.
“Realtime responsive animation with personality”, Perlin, IEEE, 1071-2626/95, pp. 5-15.
“Modeling subdivision control meshes for creating coorton faces”, Skaria et al., IEEE 0-7695-0853-7/01, pp. 216-225.
“Computer graphics models for the human face”, Parke, IEEE, CH515-6/79/0000-0724, pp. 724-727.
“Analysis of facial images using physical and anatomical models”, Terzopoulos et al., IEEE, CH2934-8/90/0000/072, pp. 727-732.
“FaceSpace: a facial spatial domain toolkit”, DiPaola, IEEE, 1093-9547, pp. 1-5.
“An anthropometric face model using variational techniques”, DeCarlo et al., University of Pennsylvannia, pp. 1-8.
“Face recognition based on fitting a 3D morphable model”, Blanz et al., IEEE, 0162-8828/03, pp. 1063-1074.
“3D models from contours”, Zheng et al., IEEE, 0-8186, pp. 733-741.
“Linear object classes and image synthesis”, Vetter et al., IEEE, 0162-8828/97, pp. 733-741.
“Spatiotemporal analysis of face profiles”, Dariush et al., IEEE, Inspec Accession No. 5920418, pp. 248-253.
“Automatic creation of 3D facial models”, Akimoto et al., IEEE, 0272-16/93, pp. 16-22.
“Three Dimensional Computer Vision”, Faugeras, 1999, pp. 1-663.
“A New Multistage Approach to Motion and Structure Estimation: From Essential Parameters to Euclidean Motion Via Fundamental Matrix”, Zhang, Jun. 1996, pp. 1-38.
“The Levenberg-Marquardt Algorithm: Implementation and Theory”, More, 1978, pp. 105-116.
“On the Optimization Criteria Used in Two-View Motion Analysis”, Zhang, Jul. 1998, pp. 717-729.
“Parametrized Structure from Motion for 3D Adaptive Feedback Tracking of Faces”, Jebara et al., 1997, pp. 144-150.
“Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences”, Fua, pp. 1-8.
“Synthesizing Realistic Facial Expressions from Photographs”, Pighln et al., pp. 1-20.
“From Regular Images to Animated Heads: A Least Squares Approach”, Fua et al., pp. 1-15.
“Appearance-based Structure from Motion Using Linear Classes of 3D Models”, Kang et al., pp. i-ii, 1-32.
Ohya et al., “Artistic Anatomy Based Real Time Reproduction of Facial Expressions”, IEEE 0-7695-0253, 684689, 7 pages.
Fritsch et al. Improving adaptive skin color segmentation by incorporating results from face detection, IEEE 0-7803-7549-9, 337-343.
Spors et al. “A real-time face tracker for color video”, IEEE 0-7803-7041-4/01, 1493-1496.
Saber et al. “Face detection and facial feature extraction using color, shape and symmetry based cost function”, IEEE 1015-4651/96, 654-658.
Shinijiro Kawato et al. “Automatic Skin-color Disribution Extraction for Face Detection and Tracking” IEEE 0-7803-5747, pp. 1415-1418.
Liu et al,. Robust Head Motion Computation by Taking Advantage of Physical Properties. IEEE 0-7695-0939-8/00, pp. 73-77.
Lopez et al., 3D Head Pose Computation from 2D Images, IEEE, 0-8186-7310, pp. 599-602.
Macliu et al., A robust model-brased approach for 3D head tracking in video sequences, pp.: 169-174.
Barron, J. et al., “Performance of optical flow techniques”, The International Journal of Computer Vision, 12(1):43-77, 1994.
Guenter, B. et al., “Making faces”, Computer Graphics, Annual Conference Series, pp. 55-66. Siggraph, Jul. 1998.
Harris, C. et al., “A combined corner and edge detector”, Plessey Research Roke Manor, UK, pp. 147-151, 1988.
Horn, B.K., “Closed-form Solution of Absolute Orientation using Unit Quatemions”, Journal of Optical Society of America, 4(4):629-642, Apr. 1987.
Horn, B.K.P. et al., “Determining Optical Flow”, Articifial Intellegence, 17:185-203, 1981.
Ip, H.H.S. et al., “Contructing a 3d individualized head model from tow orthogonal views”. The Visual Computer, (12):254-266. 1996.
Kass, M. et al., “SNAKES: Active contour Models”, The International Journal of Computer Vision, 1:321-332, Jan. 1988.
Lanitis, A. et al., “Automatic interpetation and coding of face Images using flexible models”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):743-756, 1997.
Lee, Y.C. et al., “Constructing physics-based facial models of individuals”, Proceedings of Graphics Interface, pp. 1-8, 1993.
Lee, Y.C. et al., “Realistic modeling for facial animation”, Computer Graphics, Annual Conference Series, pp. 55-62, Siggraph, 1995.
Lewis, J.P., “Algorithms for solid noise synthesis”, Computer Graphics, Annual Conference Series, 23(3):263-270, Siggraph 1989.
Magneneat-Thalmann, N. et al., “Design, transformation and animation of human faces”, Visual Computer, 5 (1/2):32-39, 1989.
Parke, F.I., “Computer generated animation of faces”, ACM National Conference, 1:451-457, Nov. 1972.
Perlin, K. et al., “Improv: A system for scripting interative actors in virtual worlds”, Computer Graphics, Annual Conference Series, pp. 205-215. Siggraph, Aug. 1995.
Platt, S. et al., “Animating facical expressions”, Computer Graphics, 15(3):245-252, 1981.
Ter

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Rapid computer modeling of faces for animation does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Rapid computer modeling of faces for animation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Rapid computer modeling of faces for animation will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-3587952

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.