System and method of providing conversational visual prosody...

Details System and method of providing conversational visual prosody... System and method of providing conversational visual prosody...

2006-07-11

2006-07-11

Harper, V. Paul (Department: 2654)

Data processing: speech signal processing, linguistics, language

Speech signal processing

Application

C704S276000, C704S272000

Reexamination Certificate

active

07076430

ABSTRACT:
A system and method of controlling the movement of a virtual agent while the agent is listening to a human user during a conversation is disclosed. The method comprises receiving speech data from the user, performing a prosodic analysis of the speech data and controlling the virtual agent movement according to the prosodic analysis.

REFERENCES:
patent: 4884972 (1989-12-01), Gasper
patent: 5652828 (1997-07-01), Silverman
patent: 5983190 (1999-11-01), Trower et al.
patent: 5987415 (1999-11-01), Breese et al.
patent: 6081780 (2000-06-01), Lumelsky et al.
patent: 6112177 (2000-08-01), Cosatto et al.
patent: 6389396 (2002-05-01), Lyberg
patent: 6665643 (2003-12-01), Lande et al.
patent: 6735566 (2004-05-01), Brand
patent: 2005/0033582 (2005-02-01), Gadd et al.
patent: PCT/IL99/00056 (1999-08-01), None
Ball et al., in “Embodied Conversational Agents,” MIT press 2000, pp. 189-219.
Cassell et al., “Embodiment in conversational interfaces: Rea,” Chi 99, May 1999, pp. 520-527.
Hayes-Roth et al., “Desigining for Diversity: Multi-Cultural Characters for a Multi-Cultural World,” Proceedings of Imagine, Feb. 2002.
Kakumanu et al., “Speech Driven Facial Animation,” Proceedings of the 2001 Workshop on Preceptive user Interfaces, Nov. 2001, Orlando Florida.
Lavagetto, F. et al., “Converting Speech into Lip Movements: A Multimdia Telephone for Hard of Hearing People,” IEEE Transactions on Rehabilitation Engineering, vol. 3, No. 1, Mar. 1995.
Marquis, et al., “Emotionally responsive poker playing agents,” in Notes for Twelfth National Conference on Artificial Intelligence, AAAI-94 Workshop on Artificial Intelligence, Artificial Life, and Entertainment, AAAI 1994.
Cappella et al., “Rules for Responsive Robots: Using Human Interactions to Build Virtual Interactions,” in “Stabiltiy and Change in Relationships” editors Vangelisti et al., Cambridge University Press, 2001.
“The ToBl Annotation Conventions”, Beckman, M., Herschberg, J., http://www.ling.ohio-state.edu/phonetics/ToBI/ToBl6.html.
“Embodied Conversational Agents”, Cassell, J., Sullivan, J. Prevost, S., Churchill, E., (eds.)MIT Press.Cambridge, 2000.
“Photo-Realistic Talking Heads for Image Samples”, by Cosatto, E., and Graf, H. P.,IEEE Trans. Multimedia,pp. 152-163, Sep. 2000.
“Face Analysis for the Synthesis of Photo-Realistic Talking Heads”, by Graf, H. P., Cosatto, E., and Essat, T.,Proc. Fourth IEEE Int. Conf. Automatic Face and Gesture Recognition,Grenoble, France, IEEE Computer Society, Los Alamitos, 2000, pp. 189-194.
“The Timing of Shifts in Head Postures During Conversation”, by Hadar, U., Steiner, T. J., Grant, E. C., Rose, F. C.,Human Movement Science,3, pp. 237-245, 1984.
“Spoken Language Processing”, by Huang X., Acero, A., Hon, H.,Prentice Hall,2001, pp. 739-791.
“Computer Facial Animation” by Parke, F. I., Waters, K., A.. K. Peters. Wellesley, Massachusetts, 1997.
“ToBl: A Strandard for Labeling English Prosody”, by Silverman, K., Beckman, M., Pitrelli, J., Ostemdorf, M., Wrightman, C., Price, P., Pierrehumbert, J., Herschberg, J.,Int. Conf. on Spoken Language Processing,1992, Banff, Canada, pp. 867-870.
“Inter-transcriber reliability and ToBl Prosodic Labeling” by Syrdal, A. K., and McGory, J.,ICSLP 2000,Beijing, China; vol. 3, pp. 235-238.
“Visual Prosody: Facial Movements Accompanying Speech” by Graf, Hans Peter, Cosatto, Eric, Strom, Volker and Huang, Fu Jie,AT&T Labs Research,200 Laurel Ave., South, Middletown, NJ 07748.
“Soft Machine: A Personable Interface”, by Lewis, J., Purcell, P., Architecture Machine Group, Massachusetts Institute of Technology, Cambridge, MA 02139.

Affiliated with

Also associated with

Rating

System and method of providing conversational visual prosody... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with System and method of providing conversational visual prosody..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method of providing conversational visual prosody... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3589752