System and method of providing conversational visual prosody...

Details System and method of providing conversational visual prosody... System and method of providing conversational visual prosody...

2008-04-01

2008-04-01

Harper, V. Paul (Department: 2626)

Data processing: speech signal processing, linguistics, language

Speech signal processing

Application

C704S276000, C704S262000

Reexamination Certificate

active

11237557

ABSTRACT:
A system and method of controlling the movement of a virtual agent while the agent is listening to a human user during a conversation is disclosed. The method comprises receiving speech data from the user, performing a prosodic analysis of the speech data and controlling the virtual agent movement according to the prosodic analysis.

REFERENCES:
patent: 4884972 (1989-12-01), Gasper
patent: 5652828 (1997-07-01), Silverman
patent: 5983190 (1999-11-01), Trower et al.
patent: 6081780 (2000-06-01), Lumelsky et al.
patent: 6112177 (2000-08-01), Cosatto et al.
patent: 6212502 (2001-04-01), Ball et al.
patent: 6389396 (2002-05-01), Lyberg
patent: 6665643 (2003-12-01), Lande et al.
patent: 6735566 (2004-05-01), Brand
patent: 2005/0033582 (2005-02-01), Gadd et al.
patent: PCT/IL99/00056 (1999-08-01), None
Ball et al., in “Embodied Conversational Agents,” MIT press 2000, pp. 189-219.
Cassell et al., “Embodiment in conversational Interfaces: Rea,” Chi 99, May 1999, pp. 520-527.
Hayes-Roth et al., “Desigining for Diversity: Multi-Cultural Characters for a Multi-Cultural World,” Proceedings of Imagina, Feb. 2002.
Kakumanu et al., “Speech Driven Facial Animation,” Proceedings of the 2001 Workshop on Perceptive user Interfaces, Nov. 2001, Orlando Florida.
Lavagetto, F. et al., “Converting Speech into Lip Movements: A Multimdia Telephone for Hard of Hearing People,” IEEE Transactions on Rehabilitation Engineering, vol. 3, No. 1, Mar. 1995.
Marquis, et al., “Emotionally responsive poker playing agents,” in Notes for Twelfth National Conference on Artificial Intelligence, AAAI-94 Workshop on Artifical Intelligence, Artificial Life, and Entertainment, AAAI 1994.
“The ToBI Annotation Conventions”, Beckman, M., Herschberg, J., http://www.ling.ohio-state.edu/phonetics/ToBI/ToBI6.html.
“Embodied Conversational Agents”, Cassell, J., Sullivan, J. Prevost, S., Churchill, E., (eds.)MIT Press, Cambridge 2000.
“Photo-Realistic Talking Heads from Image Samples”, by Cosatto, E., and Graf, H. P.,IEEE Trans. Multimedia, pp. 152-163, Sep. 2000.
“Face Analysis for the Synthesis of Photo-Realistic Talking Heads”, by Graf, H. P., Cosatto, E., and Essat, T.,Proc. Fourth IEEE Int. Conf. Automatic Face and Gesture Recognition, Grenoble, France, IEEE Computer Society, Los Alamitos, 2000, pp. 189-194.
“The Timing of Shifts in Head Postures During Conversation”, by Hadar, U., Steiner, T. J., Grant, E. C., Rose, F. C.,Human Movement Science, 3, pp. 237-245, 1984.
“Spoken Language Processing”, by Huang X., Acero, A., Hon, H.,Prentice Hall, 2001, pp. 739-791.
“Computer Facial Animation” by Parke, F. I., Waters, K.,A.. K. Peters, Wellesley, Massachusetts, 1997.
“ToBI: A Standard for Labeling English Prosody”, by Silverman, K., Beckman, M., Pitrelli, J., Osterndorf, M., Wrightman, C., Price, P., Pierrehumbert, J., Herschberg, J.,Int. Conf. on Spoken Language Processing, 1992, Banff, Canada, pp. 867-870.
“Inter-transcriber reliability and ToBI Prosodic Labeling” by Syrdal, A. K., and McGory, J.,ICSLP 2000, Beijing, China; vol. 3, pp. 235-238.
“Visual Prosody: Facial Movements Accompanying Speech” by Graf, Hans Peter, Cosatto, Eric, Strom, Volker and Huang, Fu Jie,AT&T Labs Research, 200 Laurel Ave., South, Middletown, NJ 07748.
“Soft Machine: A Personable Interface”, by Lewis, J., Purcell, P., Architecture Machine Group, Massachusetts Institute of Technology, Cambridge, MA 02139.

Affiliated with

Also associated with

Rating

System and method of providing conversational visual prosody... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with System and method of providing conversational visual prosody..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method of providing conversational visual prosody... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3909139