Method and system for aligning natural and synthetic video...

Details Method and system for aligning natural and synthetic video... Method and system for aligning natural and synthetic video...

2008-08-18

2010-11-30

Lerner, Martin (Department: 2626)

Data processing: speech signal processing, linguistics, language

Speech signal processing

Synthesis

C704S270000, C345S473000, C715S706000

Reexamination Certificate

active

07844463

ABSTRACT:
According to MPEG-4's TTS architecture, facial animation can be driven by two streams simultaneously—text and Facial Animation Parameters. A Text-To-Speech converter drives the mouth shapes of the face. An encoder sends Facial Animation Parameters to the face. The text input can include codes, or bookmarks, transmitted to the Text-to-Speech converter, which are placed between and inside words. The bookmarks carry an encoder time stamp. Due to the nature of text-to-speech conversion, the encoder time stamp does not relate to real-world time, and should be interpreted as a counter. The Facial Animation Parameter stream carries the same encoder time stamp found in the bookmark of the text. The system reads the bookmark and provides the encoder time stamp and a real-time time stamp. The facial animation system associates the correct facial animation parameter with the real-time time stamp using the encoder time stamp of the bookmark as a reference.

REFERENCES:
patent: 4520501 (1985-05-01), Dubrucq
patent: 4841575 (1989-06-01), Welsh et al.
patent: 4884972 (1989-12-01), Gasper
patent: 5111409 (1992-05-01), Gasper et al.
patent: 5404437 (1995-04-01), Nguyen
patent: 5473726 (1995-12-01), Marshall
patent: 5493281 (1996-02-01), Owens
patent: 5608839 (1997-03-01), Chen
patent: 5623587 (1997-04-01), Bulman
patent: 5634084 (1997-05-01), Malsheen et al.
patent: 5657426 (1997-08-01), Waters
patent: 5732232 (1998-03-01), Brush, II et al.
patent: 5793365 (1998-08-01), Tang et al.
patent: 5802220 (1998-09-01), Black et al.
patent: 5806036 (1998-09-01), Stork
patent: 5812126 (1998-09-01), Richardson
patent: 5812201 (1998-09-01), Yoo
patent: 5815634 (1998-09-01), Daum et al.
patent: 5818461 (1998-10-01), Rouet et al.
patent: 5818463 (1998-10-01), Tao et al.
patent: 5826234 (1998-10-01), Lyberg
patent: 5878396 (1999-03-01), Henton
patent: 5880731 (1999-03-01), Liles
patent: 5884029 (1999-03-01), Brush, II et al.
patent: 5907328 (1999-05-01), Brush, II et al.
patent: 5920835 (1999-07-01), Huzenlaub et al.
patent: 5923337 (1999-07-01), Yamamoto
patent: 5930450 (1999-07-01), Fujita
patent: 5963217 (1999-10-01), Grayson et al.
patent: 5970459 (1999-10-01), Yang et al.
patent: 5977968 (1999-11-01), Le Blanc
patent: 5983190 (1999-11-01), Trower et al.
patent: 6177928 (2001-01-01), Basso et al.
patent: 6477239 (2002-11-01), Ohki et al.
patent: 6567779 (2003-05-01), Basso et al.
patent: 6602299 (2003-08-01), Basso et al.
patent: 6862569 (2005-03-01), Basso et al.
patent: 7076426 (2006-07-01), Beutnagel et al.
patent: 7110950 (2006-09-01), Basso et al.
patent: 7366670 (2008-04-01), Basso et al.
patent: 7584105 (2009-09-01), Basso et al.
patent: 7627478 (2009-12-01), Cosatto et al.
patent: 2007/0223389 (2007-09-01), Basso et al.
patent: 2008/0015861 (2008-01-01), Cosatto et al.
patent: 2008/0059194 (2008-03-01), Basso et al.
patent: 2008/0312930 (2008-12-01), Basso et al.
patent: 63-225875 (1988-09-01), None
patent: 02-234285 (1990-09-01), None
patent: 04-245789 (1992-09-01), None
patent: 07-078074 (1995-03-01), None
patent: 08-194494 (1996-07-01), None
patent: 09-016195 (1997-01-01), None
patent: 09-138767 (1997-05-01), None
patent: 09-160575 (1997-06-01), None
Baris Uz, et al.; “Realistic Speech Animation of Synthetic Faces”,Proceedings Computer Animation '98, Philadelphia, PA, USA, Jun. 8-10, 1998, pp. 111-118, XP002111637, IEEE Comput. Sco., Los Alamitos, CA, ISBN: 0-8186-8541-7, Section 6 (“Synchronizing Speech with Expressions”), pp. 115-116.
Chiariglione, L., ISO/IEC/JYC 1/SC 29/WG11: “Report of the 43rd WG 11 Meeting”,Coding of Moving Pictures and Audio; ISO/IEC JTC 1/SC 29/WG 11 N2114, Mar. 1998 (1198-03), XP002111638 International Organisation for Standardisation, p. 40, TTSI Section.
Chiariglione, L., “MPEG and Multimedia Communications”;IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, No. 1, Feb. 1997, pp. 5-18, XP000678876; ISSN 1051-8215, Sections VII and VIII, pp. 12-16.
Ostermann, J. et al., “Synchronisation between TTS and FAP based on bookmarks and timestamps”, International Organization for Standarization, Coding of Moving Pictures and Associated Audio Information, ISO/IEC/JTC1/SC29/WG11 MPEG 97/1919, Bristol, Apr. 1997, five pages.
“International Standard of MPEG/Multimedia Coding” by Hiroshi Yasuda et al., Maruzen Company, Limited, Japan, Sep. 30, 1994, First Edition, pp. 149-154.
“Concept of Multi-Layered Speech/Sound Synthesis Control Language” by Osamu Mizuno et al., Technical Report of IEICE, Institute of Electronics, Information and Communication Engineers, Japan, May 22, 1997, Vo. 97, No. 64 (SP97˜1˜9), pp. 21-26.

Affiliated with

Also associated with

Rating

Method and system for aligning natural and synthetic video... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method and system for aligning natural and synthetic video..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for aligning natural and synthetic video... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-4235874