Rapid computer modeling of faces for animation

Details Rapid computer modeling of faces for animation Rapid computer modeling of faces for animation

2007-05-01

2007-05-01

Sherali, Ishrat (Department: 2624)

Image analysis

Applications

Personnel identification

C382S154000

Reexamination Certificate

active

11275755

ABSTRACT:
Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.

REFERENCES:
patent: 5469512 (1995-11-01), Fujita et al.
patent: 5774591 (1998-06-01), Black et al.
patent: 5864630 (1999-01-01), Cosatto et al.
patent: 5990901 (1999-11-01), Lawton et al.
patent: 5995119 (1999-11-01), Cosatto et al.
patent: 6009210 (1999-12-01), Kang
patent: 6047078 (2000-04-01), Kang
patent: 6072496 (2000-06-01), Guenter et al.
patent: 6072903 (2000-06-01), Maki et al.
patent: 6118887 (2000-09-01), Cosatto et al.
patent: 6154559 (2000-11-01), Beardsley
patent: 6163322 (2000-12-01), LaChapelle
patent: 6173069 (2001-01-01), Daly et al.
patent: 6188777 (2001-02-01), Darrell et al.
patent: 6301370 (2001-10-01), Steffens et al.
patent: 6445810 (2002-09-01), Darrell et al.
patent: 6496594 (2002-12-01), Prokoski
patent: 6504546 (2003-01-01), Cosatto et al.
patent: 6526161 (2003-02-01), Yan
patent: 6532011 (2003-03-01), Francini et al.
patent: 6549200 (2003-04-01), Mortlock et al.
patent: 6556196 (2003-04-01), Blanz et al.
patent: 6580821 (2003-06-01), Roy
patent: 6661907 (2003-12-01), Ho et al.
patent: 6664956 (2003-12-01), Erdem
patent: 6714660 (2004-03-01), Ohba
patent: 6747652 (2004-06-01), Inoue et al.
patent: 6771303 (2004-08-01), Zhang et al.
patent: 6807290 (2004-10-01), Liu et al.
patent: 6879709 (2005-04-01), Tian et al.
patent: 6919892 (2005-07-01), Cheiky et al.
patent: 2002/0102010 (2002-08-01), Liu et al.
patent: 11-1612821 (1999-06-01), None
Barron, J. et al., “Performance of optical flow techniques”, The International Journal of Computer Vision, 12(1):43-77, 1994.
Guenter, B. et al., “Making faces”, Computer Graphics, Annual Conference Series, pp. 55-66. Siggraph, Jul. 1998.
Harris, C. et al., “A combined corner and edge detector”, Plessey Research Roke Manor, UK, pp. 147-151, 1988.
Horn, B.K. “Closed-form Solution of Absolute Orientation using Unit Quaternions”, Journal of Optical Society of America, 4(4):629-642, Apr. 1987.
Horn, B.K. P. et al., “Determining Optical Flow”, Artificial Intelligence, 17:185-203, 1981.
Ip, H. H. S. et al., “Constructing a 3d individualized head motel from two orthogonal views”, The Visual Computer, (12):254-266, 1996.
Kass, M. et al., “SNAKES: Active contour models”, The International Journal of Computer Vision, 1:321-322, Jan. 1988.
Lanitis, A. et al., “Automatic interpretation and coding of face images using flexible models”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):743-756, 1997.
Lee, Y.C. et al., “Constructing physics-based facial models of individuals”, Proceedings of Graphics Interface, pp. 1-8, 1993.
Lee, Y.C. et al., “Realistic modeling for facial animation”, Computer Graphics, Annual Conference Series, p. 55-62. SIGGRAPH, 1995.
Lewis, J. P., “Algorithms for solid noise synthesis”, Computer Graphics, Annual Conference Series, 23(3):263-270. SIGGRAPH, 1989.
Magneneat-Thalmann, N. et al., “Design, transformation and animation of human faces”, Visual Computer, 5 (1/2):32-39, 1989.
Parke, F. I., “Computer generated animation of faces”, ACM National Conference, 1:451-457, Nov. 1972.
Perlin, K. et al., “Improv: A system for scripting interactive actors in virtual worlds”, Computer Graphics, Annual Conference Series, pp. 205-215. SIGGRAPH, Aug. 1995.
Platt, S. et al., “Animating facial expressions”, Computer Graphics, 15(3):245-252, 1981.
Terzopoulos, D. et al., “Physically based facial modeling, analysis, and animation”, Visualization and Computer Animation, 1:73-80, 1990.
Todd, J. T. et al., “The perception of human growth”, Scientific American, 242(2):132-144, 1980.
Waters, K. “A muscle model for animating three-dimensional facial expression”, Compuster Graphics, 21(4):17-24, 1987.
Zhang, Z. “Determining the epipolar geometry and its uncertainty: A review”, The International Journal of Computer Vision, 27(2):161-195, 1998.
Zhang, Z. “Flexible camera calibration by viewing a plane from unknown orientations”, International Conference on Computer Vision, (ICCV 1999), IEEE, pp. 666-673, 1999.
Zhang, Z. “Motion and structure for two perspective views: From essential parameters to euclidean motion through the fundamental matrix”, Journal of the Optical Society of America A, 14(11):2938-2950, 1997.
Zheng, J. Y. “Acquiring 3-d models from sequences of contours”, IEEE Transations of Pattern Analysis and Machine Intelligence, 16(2):163-178, Feb. 1994.
Akimoto et al.“Automatic Creation of 3D Facial Models” IEEE Computer Graphics & Applications 0272-16/93 1993 pp. 16-22.
Blanz et al., “Face recognition based on fitting a 3D morphable model”, IEEE, 0162-8828/03 pp. 1063-1074.
Dariush et al., “Spatiotemporal Analysis of Face Profiles: Detection Segmentation and Registration” IEEE Inspec Accession No. 5920418 pp. 248-253.
DeCarlo et al., “An anthropometric face model using variational techniques”, University of Pennsylvania, p. 1-8.
Di Paoloa, “FaceSpace: a facial spatial domain toolkit”, IEEE, 1093-9547, p. 1-5.
Faugeras, “Three Dimensianl Computer Vision”; 1999; pp. 1-663.
Fritsch et al. Improving adaptive skin color segmentation by incorporating results from face detection, IEEE 0-7803-7549-9, 337-343.
Fua et al., “From Regular Images to Animated Heads: A Least Squares Approach”; pp. 1-15.
Fua, “Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences”; pp. 1-8.
Jebara et al., “Parametrized Structure from Motion for 3D Adaptive Feedback Tracking of Faces”; 1997 pp. 144-150.
Kang et al., “Appearance-nased Structure from Motion Using Linear Classes of 3D Models”; pp. I-ii 1-32.
Kawato et al,. “Automatic Skin-color Distribution Extraction for Face Detection and Tracking”, IEEE 0-7803-5747-700, 2000 IEEE.
Liu et al., “Robust Head motion Computation by Taking Advantage of Physical Properties”, IEEE 0-7695-0939-8/00, pp. 73-77.
Lopez et al., “3D Head Pose Computation from 2D Images”, IEEE, 0-8186-7310, pp. 599-602.
Macliu et al., “A robust model-based approach for 3D head tracking in video sequences”, pp. 169-174.
More, “The Levenberg-Marquardt Algorithm: Imlplementation and Theory”; 1978; pp. 105-116.
Ohya et al. “Artisitic Anatomy Based Real TIme reporoduction of Facial Expressions”, IEEE 0-7695-0253,684689.
Parke, “Computer graphics models for the human face”, IEEE, Ch 515-6/79/0000-0724 p. 724-727.
Perlin, “Realtime responsive animation with personality”, IEEE, 1071-2626/95 p. 5-15.
Pighin et al., “Resynthesizing facial animation through 3D model-tracking”, IEEE, Inspec Accession No. 6371194 p. 1-8.
Pighin et al., “Synthesizing Realistic Facial Expressions from Photographs” pp. 1-20.
Saber et al. “Face detection and facial feature extraction using color, shape and symmetry based cost function”, IEEE 1015-4651/96, 654-658.
Shakunaga et al., “Integration of eigentemplate and structure for automatic facial feature detection”, IEEE, Inspec Accession No. 5920393 p. 1-6.
Shinijiro Kawato et al. “Automatic Skin-color Disribution

Affiliated with

Also associated with

Rating

Rapid computer modeling of faces for animation does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Rapid computer modeling of faces for animation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Rapid computer modeling of faces for animation will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3814267