Method and system for capturing and representing 3D geometry, co

Details Method and system for capturing and representing 3D geometry, co Method and system for capturing and representing 3D geometry, co

1998-06-08

2000-06-06

Nguyen, Phu K.

Computer graphics processing and selective visual display system

Computer graphics processing

Three-dimension

G06F 1500

Patent

active

06072496&

ABSTRACT:
The method captures a 3D model of a face, which includes a 3D mesh and a series of deformations of the mesh that define changes in position of the mesh over time (e.g., for each frame). The method also builds a texture map associated with each frame in an animation sequence. The method achieves significant advantages by using markers on an actor's face to track motion of the face over time and to establish a relationship between the 3D model and texture. Specifically, videos of an actor's face with markers are captured from multiple cameras. Stereo matching is used to derive 3D locations of the markers in each frame. A 3D scan is also performed on the actor's face with the markers to produce an initial mesh with markers. The markers from the 3D scan are matched with the 3D locations of the markers in each frame from the stereo matching process. The method determines how the position of the mesh changes from frame to frame by matching the 3D locations of the markers from one frame to the next. The method derives textures for each frame by removing the dots from the video data, finding a mapping between texture space and the 3D space of the mesh, and combining the camera views for each frame into a signal texture map. The data needed to represent facial animation includes: 1) an initial 3D mesh, 2) 3D deformations of the mesh per frame, and 3) a texture map associated with each deformation. The method compresses 3D geometry by decomposing the deformation data into basis vectors and coefficients. The method compresses the textures using video compression.

REFERENCES:
patent: 5524187 (1996-06-01), Feiner et al.
patent: 5675720 (1997-10-01), Sato et al.
M. Proesmans, L. Van Gool, A. Oosterlinck; "One-Shot Active 3D Shape Acquisition", Proceedings 13.sup.th IAPR International Conference on Pattern Recognition: Applications & Robotic Systems, IEEE, 1996.
Christoph Bregler, Michele Covell, Malcolm Slaney; "Video Rewrite: Driving Visual Speech with Audio", Computer Graphics, Annual Conference Series 1997.
Yuencheng Lee, Demetri Terzopoulos, Keith Waters; "Realistic Modeling for Facial Animation", Computer Graphics, Annual Conference Series 1995.
Frederic Pighin, Joel Auslander, Dani Lischinski, David H. Salesin, Richard Szeliski; "Realistic Facial Animation Using Image-Based 3D Morphing", University of Washington, Technical Report, May 6, 1997.
Keith Waters; "A Muscle Model for Animating Three-Dimensional Facial Expression", Computer Graphics, vol. 21, No. 4, Jul. 1987.
Lance Williams; "Performance-Driven Facial Animation", Computer Graphics, vol. 24, No. 4, Aug. 1990.

Affiliated with

Also associated with

Rating

Method and system for capturing and representing 3D geometry, co does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method and system for capturing and representing 3D geometry, co, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for capturing and representing 3D geometry, co will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2217680