Face feature analysis for automatic lipreading and character ani

Details Face feature analysis for automatic lipreading and character ani Face feature analysis for automatic lipreading and character ani

1996-09-20

2000-02-22

Tran, Phuoc

Image analysis

Pattern recognition

Feature extraction

382100, 382118, 382165, G06K 946

Patent

active

060289600

ABSTRACT:
A face feature analysis which begins by generating multiple face feature candidates, e.g., eyes and nose positions, using an isolated frame face analysis. Then, a nostril tracking window is defined around a nose candidate and tests are applied to the pixels therein based on percentages of skin color area pixels and nostril area pixels to determine whether the nose candidate represents an actual nose. Once actual nostrils are identified, size, separation and contiguity of the actual nostrils is determined by projecting the nostril pixels within the nostril tracking window. A mouth window is defined around the mouth region and mouth detail analysis is then applied to the pixels within the mouth window to identify inner mouth and teeth pixels and therefrom generate an inner mouth contour. The nostril position and inner mouth contour are used to generate a synthetic model head. A direct comparison is made between the inner mouth contour generated and that of a synthetic model head and the synthetic model head is adjusted accordingly. Vector quantization algorithms may be used to develop a codebook of face model parameters to improve processing efficiency. The face feature analysis is suitable regardless of noise, illumination variations, head tilt, scale variations and nostril shape.

REFERENCES:
patent: 4975960 (1990-12-01), Petajan
patent: 5761329 (1998-06-01), Chen et al.
Automatic Lipreading to Enhance Speech Recognition, Eric David Petajan, Urbana, Illinois 1984.
Automated Lip-Sync: Direct Translation of Speech-Sound to Mouth-Shape, Barrett E. Koster, Robert D. Rodman and Donald Bitzer--Nato Workshop--Sep. 5, 1995.
Using Deformable Templates to Infer Visual Speech Dynamics, Marcus E. Hennecke, K Venkatesh Prassad, David G. Stark, Asilomar Workshop--Oct. 31, 1994.
Lip Modeling for Visual Speech Recognition, Ram R. Rao and Russell M. Mersereau, Alisomar Workshop--Oct. 31, 1994.
Sensory Integration in Audiovisual Automatic Speech Recognition, Peter L. Silsbee, Asilomar Workshop--Oct. 13, 1994.
Locating Faces and Facial Parts, Hans Peter Graf, Tsuhan Chen, Eric Petajan, Eric Cosatto, Proceedings of the International Workshop on Automatic Face-and Gesture-Recognition, Bichsel (ed), Multimedia Laboratory, U. Zurich, 1995, pp. 41-46--Jun. 26, 1995.
Experiments with an articulatory Speech Recognizer, Igor Zlokarnik, Eurospeech 93, Berlin, Sep. 1993.

Affiliated with

Also associated with

Rating

Face feature analysis for automatic lipreading and character ani does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Face feature analysis for automatic lipreading and character ani, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Face feature analysis for automatic lipreading and character ani will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-527069