Data processing: speech signal processing – linguistics – language – Speech signal processing – Application
Reexamination Certificate
2004-12-10
2009-11-03
Dorvil, Richemond (Department: 2626)
Data processing: speech signal processing, linguistics, language
Speech signal processing
Application
C704S260000, C704S270000, C704S271000
Reexamination Certificate
active
07613613
ABSTRACT:
A method and system for presenting lip-synchronized speech corresponding to the text received in real time is provided. A lip synchronization system provides an image of a character that is to be portrayed as speaking text received in real time. The lip synchronization system receives a sequence of text corresponding to the speech of the character. It may modify the received text in various ways before synchronizing the lips. It may generate phonemes for the modified text that are adapted to certain idioms. The lip synchronization system then generates the lip-synchronized images based on the phonemes generated from the modified texts and based on the identified expressions.
REFERENCES:
patent: 5884267 (1999-03-01), Goldenthal et al.
patent: 5913193 (1999-06-01), Huang et al.
patent: 5938447 (1999-08-01), Kirksey
patent: 6112177 (2000-08-01), Cosatto et al.
patent: 6792406 (2004-09-01), Fujimura et al.
patent: 6925438 (2005-08-01), Mohamed et al.
patent: 6990452 (2006-01-01), Ostermann et al.
patent: 7130790 (2006-10-01), Flanagan et al.
patent: 7149690 (2006-12-01), August et al.
patent: 7168953 (2007-01-01), Poggio et al.
patent: 7203648 (2007-04-01), Ostermann et al.
patent: 7260539 (2007-08-01), Cosatto et al.
patent: 2001/0049596 (2001-12-01), Lavine et al.
patent: 2002/0069059 (2002-06-01), Smith
patent: 2002/0161582 (2002-10-01), Basson et al.
patent: 2003/0028380 (2003-02-01), Freeland et al.
patent: 2003/0069732 (2003-04-01), Stephany et al.
patent: 2003/0163314 (2003-08-01), Junqua
patent: 2003/0163315 (2003-08-01), Challapali et al.
patent: 2004/0019484 (2004-01-01), Kobayashi et al.
patent: 2004/0107101 (2004-06-01), Eide
patent: 2004/0215460 (2004-10-01), Cosatto et al.
patent: 2005/0096909 (2005-05-01), Bakis et al.
patent: 2005/0107127 (2005-05-01), Moriya
patent: 2006/0074689 (2006-04-01), Cosatto et al.
Cosatto, E.; Graf, H.P., “Photo-realistic talking-heads from image samples,” Multimedia, IEEE Transactions on , vol. 2, No. 3, pp. 152-163, Sep. 2000.
“Headcase Technology,” RED TED—3D Talking Heads for your website and windows applications, Available at http://www.redted.mcmail.com/headcase.htm [last accessed Nov. 2, 2004] 4 pages.
“Real-Time, 3D, Natural Speech Facial Animation,” Fluent Animated Speech, www.sensoryinc.com [last accessed Nov. 2, 2004] 2 pages.
Comet, Michael B., “Lip Sync—Making Characters Speak,” Copyright 1998 Michael D. Comet, Available at http://www.comet-cartoons.com/toons/3ddocs/lipsync/lipsync.html, [last accessed Nov. 2, 2004] 12 pages.
Decarlo, Doug and Matthew Stone, “Rutgers University Talking Head,” Available at http://www.cs.rutgers.edu/˜village/ruth/ [last accessed Nov. 2, 2004] 2 pages.
De Leeuw, Ben, “Lips Let Loose, Straight Talking with LIPSinc.Ventriloquist 1.0,”News and Opinions, 3D Direct Newsletter, Mar. 13, 2000, Available at http://www.3dgate.com
ews—and—opinions/000313/0313ventriloquist.html [last accessed Nov. 2, 2004] 5 pages.
Lin, I-Chen et al., “A Speech Driven Talking Head System Based on a Single Face Image,”Computer Graphics and Applications, 1999,Proceedings of Seventh Pacific Conference, Publication Date 1999, pp. 43-49.
Lin, I-Chen, “Image-based Talking Head from a single image,”Image Talk: a chinese text-to-speech talking head, Feb. 27, 1999, Available at http://graphics.csie.ntu.edu.tw/project/ImageTalk/ImageTalk.htm [last accessed Nov. 2, 2004] 3 pages.
Perng, Woei Luen et al., “Image Talk: A Real Time Synthetic Talking Head Using One Single Image with Chinese Text-To-Speech Capability,”Sixth Pacific Conference on Computer Graphics and Applications(PG'98), 1998, 9 pages.
“Declarative Programming for Natural Language Generation,”SPUD-Matthew Stone's NLG Page, Available at http://www.cs.rutgers.edu/˜mdstone
lg.html [last accessed Nov. 11, 2004] 4 pages.
Wilson, Jim, “Talking Heads,”New Face of Animation,. Available at http://popularmechanics.com/science/research/2000
ew—face—animation/print.phtml [last accessed Nov. 2, 2004] 3 pages.
Cotton Brandon
Fields Timothy V.
Dorvil Richemond
Godbold Douglas C
Microsoft Corporation
Perkins Coie LLP
LandOfFree
Method and system for converting text to lip-synchronized... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and system for converting text to lip-synchronized..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for converting text to lip-synchronized... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4101295