System and method of providing conversational visual prosody...

Details System and method of providing conversational visual prosody... System and method of providing conversational visual prosody...

2006-11-14

2006-11-14

{hacek over (S)}mits, Talivaldis Ivars (Department: 2626)

Data processing: speech signal processing, linguistics, language

Speech signal processing

Application

C704S270100, C704S276000

Reexamination Certificate

active

07136818

ABSTRACT:
A system and method of controlling the movement of a virtual agent while the agent is speaking to a human user during a conversation is disclosed. The method comprises receiving speech data to be spoken by the virtual agent, performing a prosodic analysis of the speech data, selecting matching prosody patterns from a speaking database and controlling the virtual agent movement according to the selected prosody patterns.

REFERENCES:
patent: 4884972 (1989-12-01), Gasper
patent: 5357596 (1994-10-01), Takebayashi et al.
patent: 5652828 (1997-07-01), Silverman
patent: 6081780 (2000-06-01), Lumelsky et al.
patent: 6112177 (2000-08-01), Cosatto et al.
patent: 6721706 (2004-04-01), Strubbe et al.
patent: 6731307 (2004-05-01), Strubbe et al.
patent: 6795808 (2004-09-01), Strubbe et al.
“Soft Machine: A Personable Interface”, by Lewis, J., Purcell, P., Architecture Machine Group, Massachusetts Institute of Technology, Cambridge, MA 02139.
“The ToBI Annotation Conventions”, Beckman, M., Herschberg, J., http://www.ling.ohio-state.edu/phonetics/ToBI/ToBI6.html.
“Embodied Conversational Agents”, Cassell, J., Sullivan, J. Prevost, S., Churchill, E., (eds.)MIT Press, Cambridge, 2000.
“Photo-Realistic Talking Heads from Image Samples”, by Cosatto, E., and Graf, H.P.,IEEE Trans. Multimedia, pp. 152-163, Sep. 2000.
“Face Analysis for the Synthesis of Photo-Realistic Talking Heads”, by Graf, H. P., Cosatto, E., and Essat, T.,Proc. Fourth IEEE Int. Conf. Automatic Face and Gesture Recognition, Grenoble, France, IEEE Computer Society, Los Alamitos, 2000, pp. 189-194.
“The Timing of Shifts in Head Postures During Conversation”, by Hadar, U., Steiner, T. J., Grant, E. C., Rose, F. C.,Human Movement Science, 3, pp. 237-245, 1984.
“Spoken Language Processing”, by Huang X., Acero, A., Hon, H.,Prentice Hall, 2001, pp. 739-791.
“Computer Facial Animation” by Parke, F. I., Waters, K., A., K. Peters, Wellesley, Massachusetts, 1997.
“ToBI: A Standard for Labeling English Prosody”, by Silverman, K., Beckman, M., Pitrelli, J., Osterndorf, M., Wrightman, C., Price, P., Pierrehumbert, J., Herschberg, J.,Int. Conf. on Spoken Language Processing, 1992, Banff, Canada, pp. 867-870.
“Inter-transcriber reliability and ToBI Prosodic Labeling” by Syrdal, A. K., and McGory, J.,ICSLP 2000, Beijing, China; vol. 3, pp. 235-238.
“Visual Prosody: Facial Movements Accompanying Speech” by Graf, Hans Peter, Cosatto, Eric, Strom, Volker and Huang, Fu Jie,AT&T Labs Research, 200 Laurel Ave., South, Middletown, NJ 07748.

Affiliated with

Also associated with

Rating

System and method of providing conversational visual prosody... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with System and method of providing conversational visual prosody..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method of providing conversational visual prosody... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3658294