Rapid computer modeling of faces for animation

Image analysis – Applications – Personnel identification

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Reexamination Certificate

active

11119597

ABSTRACT:
Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.

REFERENCES:
patent: 5469512 (1995-11-01), Fujita et al.
patent: 5774591 (1998-06-01), Black et al.
patent: 5864630 (1999-01-01), Cosatto et al.
patent: 5990901 (1999-11-01), Lawton et al.
patent: 5995119 (1999-11-01), Cosatto et al.
patent: 6009210 (1999-12-01), Kang
patent: 6047078 (2000-04-01), Kang
patent: 6072496 (2000-06-01), Guenter et al.
patent: 6072903 (2000-06-01), Maki et al.
patent: 6118887 (2000-09-01), Cosatto et al.
patent: 6154559 (2000-11-01), Beardsley
patent: 6163322 (2000-12-01), LaChapelle
patent: 6173069 (2001-01-01), Daly et al.
patent: 6188777 (2001-02-01), Darrell et al.
patent: 6301370 (2001-10-01), Steffens et al.
patent: 6445810 (2002-09-01), Darrell et al.
patent: 6496594 (2002-12-01), Prokoski
patent: 6504546 (2003-01-01), Cosatto et al.
patent: 6526161 (2003-02-01), Yan
patent: 6532011 (2003-03-01), Francini et al.
patent: 6549200 (2003-04-01), Mortlock et al.
patent: 6556196 (2003-04-01), Blanz et al.
patent: 6580821 (2003-06-01), Roy
patent: 6661907 (2003-12-01), Ho et al.
patent: 6664956 (2003-12-01), Erdem
patent: 6714660 (2004-03-01), Ohba
patent: 6747652 (2004-06-01), Inoue et al.
patent: 6771303 (2004-08-01), Zhang et al.
patent: 6807290 (2004-10-01), Liu et al.
patent: 6879709 (2005-04-01), Tian et al.
patent: 6919892 (2005-07-01), Cheiky et al.
patent: 2002/0102010 (2002-08-01), Liu et al.
patent: 11-1612821 (1999-06-01), None
Kawato et al., Automatic Skin Color Distribution Extraction for Face Detection and Tracking, IEEE 0-7803-5747-700.
Saber et al., Face Detection and Facial Features Extraction Uing Color, Shape and Symmetry-Based Cost Functions, IEEE 1015-4651/96.
Fritsch et al., Improving Adaptive Skin Color Segmentation by Incorporating Results fromFace Detection, IEEE 0-7803-7545-9/02, 337-343.
“Global Motion Estimation in Model-Based Image Coding by Tracking Three-Dimensional Contour Featu Points”, Pei et al., IEEE, 1051-8215/98, pp. 181-190.
“Resynthesizing facial animation through 3D model-tracking”, Pighin et al., IEEE, Inspec Accession No. 6371194, pp. 1-8.
“Integration of eigentemplate and structure matching for automatic facial feature detection”, Shakunaga et al., IEEE, Inspec Accession No. 5920393, pp. 1-6.
“Realtime responsive animation with personality”, Perlin, IEEE, 1071-2626/95, pp. 5-15.
“Modeling subdivision control meshes for creating coorton faces”, Skaria et al., IEEE 0-7695-0853-7/01, pp. 216-225.
“Computer graphics models for the human face”, Parke, IEEE, CH515-6/79/0000-0724, pp. 724-727.
“Analysis of facial images using physical and anatomical models”, Terzopoulos et al., IEEE, CH2934-8/90/0000/072, pp. 727-732.
“FaceSpace: a facial spatial domain toolkit”, DiPaola, IEEE, 1093-9547, pp. 1-5.
“An anthropometric face model using variational techniques”, DeCarlo et al., University of Pennsylvannia, pp. 1-8.
“Face recognition based on fitting a 3D morphable model”, Blanz et al., IEEE, 0162-8828/03, pp. 1063-1074.
“3D models from contours”, Zheng et al., IEEE, 0-8186, pp. 733-741.
“Linear object classes and image synthesis”, Vetter et al., IEEE, 0162-8828/97, pp. 733-741.
“Spatiotemporal analysis of face profiles”, Dariush et al., IEEE, Inspec Accession No. 5920418, pp. 248-253.
“Automatic creation of 3D facial models”, Akimoto et al., IEEE, 0272-16/93, pp. 16-22.
“Three-Dimensional Computer Vision”, Faugeras, 1999, pp. 1-663.
“A New Multistage Approach to Motion and Structure Estimation: From Essential Parameters to Euclidean Motion Via Fundamental Matrix”, Zhang, Jun. 1996, pp. 1-38.
“The Levenberg-Marquardt Algorithm: Implementation and Theory”, More, 1978, pp. 105-116.
“On the Optimization Criteria Used in Two-View Motion Analysis”, Zhang, Jul. 1998, pp. 717-729.
“Parametrized Structure from Motion for 3D Adaptive Feedback Tracking of Faces”, Jebara et al., 1997, pp. 144-150.
“Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences”, Fua, pp. 1-8.
“Synthesizing Realistic Facial Expressions from Photographs”, Pighin et al., pp. 1-20.
“From Regular Images to Animated Heads: A Least Squares Approach”, Fua et al., pp. 1-15.
“Appearance-based Structure from Motion Using Linear Classes of 3D Models”, Kang et al., pp. i-ii, 1-32.
Ohya et al., “Artistic Anatomy Based Real Time Reproduction of Facial Expressions”, IEEE 0-7695-0253, 684689, 7 pages.
Kawato et al., “Automatic skin-color distribution extraction for detection and tracking”, IEEE 0-7803-5747-7/00, 1415-1418.
Spors et al. “A real-time face tracker for color video”, IEEE 0-7803-7041-4/01, 1493-1496.
Fritsch et al., “Improving adaptive skin color segmentation by incorporating results from face detection”, IEEE 0-7803-7545-9, 337-343.
Saber et al. “Face detection and facial feature extraction using color, shape and symmetry based cost function”, IEEE 1015-4651/96, 654-658.
Liu et al,. Robust Head motion Computation by Taking Advantage of Physical Properties, IEEE 0-7695-0939-8/00, pp. 73-77.
Macliu et al., A robust model-based approach for 3D head tracking in video sequences, pp. 169-174.
Lopez et al., 3D Head Pose Computation from 2D Images, IEEE, 0-8186-7310, pp. 599-602.
Zhang et al, Rapid Modeling of 3D Faces for Animation Using An Efficient Adaptation Algorithm.
Magneneat-Thalmann, N. et al., “Design, transformation and animation of human faces”, Visual Computer, 5 (1/2):32-39,1989.
Parke, F.I., “Computer generated animation of faces”, ACM National Conference, 1:451-457, Nov. 1972.
Perlin, K. et al., “Improv: A system for scripting interactive actors in virtual worlds”, Computer Graphics, Annual Conference Series, pp. 205-215. Siggraph, Aug. 1995.
Platt, S. et al., “Animating facial expressions”, Computer Graphics, 15(3):245-252, 1981.
Terzopoulos, D. et al., “Physically based facial modeling, analysis, and animation”, Visualization and Computer Animation, 1:73-80, 1990.
Todd, J. T. et al., “The Perception of human growth”, Scientific American, 242(2):132-144. 1980.
Waters, K. “A Muscle model for animating three-dimensional facial expression”, Computer Graphics, 21(4):17-24, 1987.
Zhang, Z. “Determining the epipolar geometry and its uncertainty: A review”, The International Journal of Computer Vision, 27(2): 161-195, 1998.
Zhang, Z. “Flexible camera calibration by viewing a plane from unknown orientations”, International Conference on Computer Vision (ICCV '99), IEEE, pp. 666-673, 1999.
Zhang, Z. “Motion and structure form two perspective views: From essential parameters to euclidean motion through the fundamental matrix”, Journal of the Optical Society of America, A, 14(11):2938-2950, 1997.
Zheng, J.Y. “Acquiring 3-d models from sequences of contours”, IEEE Transcation of Pattern Analysis and Machine Intelligence, 16(2):163-178, Feb. 1994.
Barron, J. et al., “Performance of optical flow techniques”, The International Journal of Computer Vision, 12(1):43-77, 1994.
Guenter, B. et al., “Making faces”, Computer Graphics, Annual C

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Rapid computer modeling of faces for animation does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Rapid computer modeling of faces for animation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Rapid computer modeling of faces for animation will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-3788944

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.