Image analysis – Applications
Reexamination Certificate
2006-05-16
2008-10-07
Carter, Aaron W (Department: 2624)
Image analysis
Applications
C382S118000, C704S235000, C704S256000, C704S258000, C704S260000, C704S270000
Reexamination Certificate
active
07433490
ABSTRACT:
A novel method for synchronizing the lips of a sketched face to an input voice. The lip synchronization system and method approach is to use training video as much as possible when the input voice is similar to the training voice sequences. Initially, face sequences are clustered from video segments, then by making use of sub-sequence Hidden Markov Models, a correlation between speech signals and face shape sequences is built. From this re-use of video, the discontinuity between two consecutive output faces is decreased and accurate and realistic synthesized animations are obtained. The lip synchronization system and method can synthesize faces from input audio in real-time without noticeable delay. Since acoustic feature data calculated from audio is directly used to drive the system without considering its phonemic representation, the method can adapt to any kind of voice, language or sound.
REFERENCES:
patent: 5880788 (1999-03-01), Bregler
patent: 5907351 (1999-05-01), Chen et al.
patent: 5933151 (1999-08-01), Jayant et al.
patent: 6366885 (2002-04-01), Basu et al.
patent: 6449595 (2002-09-01), Arslan et al.
patent: 6735566 (2004-05-01), Brand
patent: 6813607 (2004-11-01), Faruquie et al.
patent: 6919892 (2005-07-01), Cheiky et al.
patent: 7133535 (2006-11-01), Huang et al.
patent: 2002/0007276 (2002-01-01), Rosenblatt et al.
patent: 2002/0152074 (2002-10-01), Junqua
patent: 2004/0122675 (2004-06-01), Nefian et al.
Williams et al. “An HMM-Based Speech-to-Video Synthesizer”, Jul. 2002, IEEE Transactions on Neural Networks, vol. 13, Issue 4, pp. 900-915.
Guo Baining
Huang Ying
Lin Stephen Ssu-te
Shum Heung-Yeung
Carter Aaron W
Lyon Katrina A.
Lyon & Harr LLP
Microsoft Corp
LandOfFree
System and method for real time lip synchronization does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for real time lip synchronization, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for real time lip synchronization will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4000036