Method and apparatus for synthesizing realistic animations of a

Details Method and apparatus for synthesizing realistic animations of a Method and apparatus for synthesizing realistic animations of a

1998-05-08

2000-08-01

Hong, Stephen S.

Computer graphics processing and selective visual display system

Display driving control circuitry

Controlling the condition of display elements

345473, G06T 1500

Patent

active

060973811

ABSTRACT:
A method and apparatus for synthesizing speech or facial movements to match selected speech sequences. A videotape of an arbitrary text sequence is obtained including a plurality of images of a user speaking various sequences. Video images corresponding to specific spoken phonemes are obtained. A video frame is digitized from that sequence which represents the extreme of mouth motion and shape. This is used to create a database of images of different facial positions relative to spoken phonemes and diphthongs. An audio speech sequence is then used as the element to which a video sequence will be matched. The audio sequence is analyzed to determine spoken phoneme sequences and relative timings. The database is used to obtain images for each of these phonemes and these times, and morphing techniques are used to create transitions between the images. Different parts of the images can be processed in different ways to make a more realistic speech pattern.

REFERENCES:
patent: 5358259 (1994-10-01), Best
patent: 5657426 (1997-08-01), Waters et al.
patent: 5734923 (1998-03-01), Sagawa et al.
patent: 5799267 (1998-08-01), Siegel
patent: 5878396 (1999-03-01), Henton
Terzopoulos et al., "Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, No. 6, Jun. 1993, pp. 569-579.
Morishima et al., "An Intelligent Facial Image Coding Driven by Speech and Phoneme", ICASSP '89, Acoustics, Speech & Signal Processing, 1989, pp. 1795-1798.

Affiliated with

Also associated with

Rating

Method and apparatus for synthesizing realistic animations of a does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method and apparatus for synthesizing realistic animations of a , we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for synthesizing realistic animations of a will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-668581