Computer graphics processing and selective visual display system – Computer graphics processing – Animation
Reexamination Certificate
2000-10-12
2004-05-04
Vo, Cliff N. (Department: 2671)
Computer graphics processing and selective visual display system
Computer graphics processing
Animation
C345S418000
Reexamination Certificate
active
06731287
ABSTRACT:
FIELD OF THE INVENTION
The present invention is related to the field of computer animation, and more specifically, to a technique for animating a personalized three-dimensional (3-D) model of a person's face in accordance with the facial motion of the person.
BACKGROUND OF THE INVENTION
The goal of facial animation is to mimic the facial motion of a person on a 3-D model of the person's face as accurately and as fast as possible. The accuracy of a facial animation method is measured by the realism of the animated face it generates. On the other hand, the computational speed of a facial animation method determines whether it can be realized in real-time. There are known techniques for using markers to track selected facial features such as the eyebrows, ears, mouth and corners of the eyes.
The 3-D model of a person's face is composed of a 3-D triangular mesh, referred to as the geometry mesh, and an associated composite image of the person's face, referred to as the texture image. A 3-D triangular mesh refers to a connected set of triangular patches in 3-D whose corners form the nodes of the mesh. Each triangular patch in the geometry mesh acquires its image data from an associated triangular region in the texture image. The geometry mesh represents the geometry of the person's face in its neutral state. Animating the 3-D face model of a person involves deforming the geometry mesh of the face model to reflect the changes in the geometry of the face caused by the motion of the face.
The methods disclosed in the prior art on facial animation can be generally classified as (i) physics-based methods and (ii) rule-based methods. In physics-based methods, the motion of each triangle of the geometry mesh is controlled by a multi-layer facial muscle system. Dynamic models of the facial muscles are employed to calculate the propagation of any facial force throughout the face and to obtain the resulting deformation of the surface of the face. Physics-based methods can produce realistic animations, however, because of their high computational cost, they cannot be used in real-time applications.
In rule-based methods, a subset of the nodes of the geometry mesh, referred to as feature points, are used to control the movement of the rest of the nodes of the geometry mesh. Each feature point is assigned an area of influence on the geometry mesh. When a feature point is moved, the nodes of the geometry mesh that belong to the area of influence of the feature point move according to some predefined deformation rules. These deformation rules may specify linear, piece-wise linear, or rotational motion for the nodes of the mesh with the amount of motion being inversely proportional to the distance of the node to its controlling feature point. Although the rule-based methods provide real-time deformations of the face, they may lack realism as they are not based on any physical model.
SUMMARY OF THE INVENTION
The present invention provides an improvement designed to satisfy the aforementioned needs. Particularly, the present invention is directed to a computer program product for animating a 3-D face model realistically and in real-time by performing the steps of: (a) receiving the 3-D face model of a person; (b) receiving the global and local facial motion values; and (c) animating the fine geometry mesh of the 3-D face model using a sparse shape mesh overlaying the geometry mesh.
REFERENCES:
patent: 4975960 (1990-12-01), Petajan
patent: 5280530 (1994-01-01), Trew et al.
patent: 5744953 (1998-04-01), Hansen
patent: 5774591 (1998-06-01), Black et al.
patent: 5802220 (1998-09-01), Black et al.
patent: 5805745 (1998-09-01), Graf
patent: 5807284 (1998-09-01), Foxlin
patent: 5907626 (1999-05-01), Toklu et al.
patent: 5923337 (1999-07-01), Yamamoto
patent: 5982909 (1999-11-01), Erdem et al.
patent: 6009210 (1999-12-01), Kang
patent: 6016148 (2000-01-01), Kang et al.
patent: 6020892 (2000-02-01), Dillon
patent: 6028960 (2000-02-01), Graf et al.
patent: 6031539 (2000-02-01), Kang et al.
patent: 6037949 (2000-03-01), DeRose et al.
patent: 6047078 (2000-04-01), Kang
patent: 6052132 (2000-04-01), Christian et al.
patent: 6064390 (2000-05-01), Sagar et al.
Antunes, Gabriel, et al., “MPEG-4 Facial Animation Technology: Survey, Implementation, and Results”,IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 2, pp. 290-305, (1999).
Lavagetto , Fabio, et al., “The Facial Animation Engine: Toward a High-Level Interface for the Design of MPEG-4 Compliant Animated Faces”,IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 2, pp. 277-289, (1999).
Waters, Keith, “A Muscle Model for Animating Three-Dimensional Facial Expression”,Computer Graphics(SIGGRAPH 95), vol. 21, No. 4, pp. 17-24, (Jul. 1987)
Lee, Yuencheng, et al., “Realistic Modeling for Facial Animation”,Computer Graphics, (SIGGRAPH 95), Los Angeles, CA, pp. 55-63, (Aug. 1995).
Platt, Stephen M., et al., “Animating Facial Expressions”,Computer Graphics, (SIGGRAPH 81), vol. 15, No. 3, pp. 245-252, (Aug. 1981).
Tekalp, Murat, et al., “Face and 2-D Mesh Animation in MPEG-4”,Signal Processing: Image Communication, vol. 15, No. 4-5, pp. 387-421, (Jan. 21, 2000).
Zitnick, Lawrence C. et al., “Manipulation of Video Eye Gaze and Head Orientation for Video Teleconferencing”,Microsoft Research Technical Report MSR-TR-99-46, pp. 1-13, (Jun. 16, 1999).
Haratsch, Erich, et al., “An Animation Definition Interface”,International Workshop on Synthetic -Natural Hybrid Coding and Three Dimensional Imaging, Rhodes, Greece, pp. 216-219, (Sep. 5-9, 1997).
Bregler, Christoph, et al., “Video Rewrite: Driving Visual Speech With Audio”,Computer Graphics (SIGGRAPH 97), pp. 1-8, (1997).
Escher, Marc, et al., “Automatic 3D Cloning and Real-Time Animation of a Human Face”,Proceedigs of Computer Animation, Geneva, Switzerland, pp. 1-13, (1997).
FitzGerald Esq. Thomas R.
Momentum Bilgisayar, Yazilim, Danismanlik, Ticaret A.S.
Vo Cliff N.
LandOfFree
Method for animating a 3-D model of a face does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for animating a 3-D model of a face, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for animating a 3-D model of a face will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3216800