Geometry-driven feature point-based image synthesis

Details Geometry-driven feature point-based image synthesis Geometry-driven feature point-based image synthesis

2003-10-14

2008-05-27

Zimmerman, Mark (Department: 2628)

Computer graphics processing and selective visual display system

Computer graphics processing

Attributes

C345S646000, C382S118000, C382S171000

Reexamination Certificate

active

07379071

ABSTRACT:
A method and system uses geometry-driven feature point analysis to synthesize images including for example facial expressions. Given the feature point positions (geometry) of an expression, the method automatically synthesizes the corresponding expression image, which has photorealistic and natural looking expression details.

REFERENCES:
patent: 5991459 (1999-11-01), Fogel
patent: 2001/0031081 (2001-10-01), Quan et al.
patent: 2001/0036860 (2001-11-01), Yonezawa
patent: 2002/0097380 (2002-07-01), Moulton et al.
patent: 2003/0190091 (2003-10-01), Stewart et al.
patent: 2003/0202686 (2003-10-01), Rowe
patent: 2003/0223622 (2003-12-01), Simon et al.
patent: 2004/0075667 (2004-04-01), Burky et al.
patent: 2005/0084151 (2005-04-01), Aggarwal et al.
Cosatto, E. and H. Graf. “Photo-Realistic Talking Heads from Image Samples.” IEEE Trans. on Multimedia, vol. 2, No. 3, Sep. 2000, pp. 152-163.
Chai, J.; Jing, X.; Hodgins, J. “Vision-based control of 3D facial animation.” Proc. 2003 ACM SIGGRAPH/Eurgraphics Symp. on Comp. Animation. pp. 193-206, 2003.
A. Lanitis, C. J. Taylor, and T. F. Cootes, “Automatic interpretation and coding of face images using flexible models,” IEEE Trans. on PAMI, vol. 19, No. 7, pp. 743-756, 1997.
U.S. Appl. No. 10/099,673, filed Mar. 14, 2002, Guo et al.
Beymer, D. and Poggio, T. Image representation for visual learning. Science, 272(28):1905-1909, Jun. 1996.
Bichsel, M. Automatic interpolation and recognition of face by morphing. In Proc. 2nd Intl. Conf. on Automatic Face and Gesture Recogniton. Los Alamitos, CA, 128-135, 1996.
Black, M.J. and Yacoob, Y. Tracking and recognizing rigid and non-rigid facial motion using local parametric models of image motion. In Proc. IEEE Intl. Conf. Computer Vision, Cambridge, MA, 374-381, 1995.
Breglar, C., Covell, M. and Slaney, M. Video rewrite: Driving visual speech with audio. In Proc. SIGGRAPH'97, 353-360, Jul. 1997.
Cassell, J. More than just another pretty face: Embodied conversational interface agents. Communications of the ACM 43(4): 70-78, 2000.
Chu-Carroll, J. Form-based reasoning for mixed-initiative dialogue management in information-query systems. In Proc. Eurospeech'99, 1519-1522, 1999.
Cossatto, E. and Graf, H. P. Photo-realistic talking-heads from image samples. IEEE Trans. on Multimedia, 2(3), Sep. 2000.
Dahlbäck, N. Towards a dialogue taxonomy. In Proceedings of ECAI'96 Workshop Dialogue Processing in Spoken Language Systems, 28-34, 1996.
Escher, M. and Magnenat-Thalmann, N. Automatic 3D cloning and real-time animation of a human face. In Proc. Computer Animation, 58-66, 1997.
Ferguson, G. and Allen, J. TRIPS: An Integrated Intelligent Problem-Solving Assistant. In Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98), Madison, WI, 567-573, Jul. 1998.
Ferguson, G., Allen, J., Miller, B. and Ringger, E. The design and implementation of the TRAINS-96 system: a prototype mixed-initiative planning assistant. TRAINS Technical Note 96-5, Computer Science Dept., University of Rochester, Oct. 1996.
Flycht-Eriksson, A. A survey of knowledge sources in dialogue systems. In Proceedings of IJCAI-99 Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Stockholm, 1999.
Glass, J. et al. The MIT ATIS System: Dec. 1994 Progress Report. In Proc. ARPA Spoken Language Systems Technology Workshop, Jan. 1995.
Guiard-Marigny, T., Adjoudani, A. and Benoit, C. A 3-D model of the lips for Realistic speech Amination. In Proc. Computer Animation '96, IEEE, 80-89, 1996.
Lee, Y., Terzopoulos, D. and Waters, K. Realistic modeling for facial animation. In Proc. SIGGRAPH'95, 55-62, 1995.
Lewis, J. Automated lip-sync: Background and techniques. Journal of Visualization and Computer Animation, 2(4):118-122, 1991.
Lundeberg, M. and Beskow, J. Developing a 3D-agent for the August dialogue system. In Proc. AVSP'99, Santa Cruz, USA, 1999.
Oh, A. H. and Rudnicky, A. Stochastic language generation for spoken dialogue systems. ANLP/NAACL 2000 Workshop on Conversational Systems, 27-32, May 2000.
Paek, T. and Horvitz, E. Conversation as action under uncertainty. In Proc. 16th Conf. on Uncertainty in Artificial Intelligence (UAI-2000), Stanford, CA, Jun. 2000.
Pandzic, I., Ostermann, J. and Millen, D. User evaluation: synthetic talking faces for interactive services. The Visual Computer, 15:330-340, 1999.
Peckham, J. A new generation of spoken dialogue systems: results and lessons from the SUNDIAL project. In Proc. Eurospeech'93, 33-40, 1993.
Riccardi, G. and Gorin, A.L. Stochastic language adaptation over time and state in a natural spoken dialog system. IEEE Trans. on Speech and Audio, 8:3-10, Jan. 2000.
Rudnicky, A., Thayer, E., Constantinides, P., Tchou, C., Shern, R., Lenzo, K., Xu W., and Oh, A. Creating natural dialogs in the Carnegie Mellon Communicator system. In Proc. Eurospeech'99, 1531-1534, 1999.
Rudnicky, A. and Xu, W. An agenda-based dialog management architecture for spoken language systems. IEEE Automatic Speech Recognition and Understanding Workshop, 1999.
Schodl, A. and Szeliski, R. Video textures. In Proc. SIGGRAPH'99, 1999.
Wang, Y. A robust parser for spoken language understanding. In Proc. Eurospeech'99, 1999.
Ward, W. and Pellom, B. The CU Communicator system. IEEE Workshop on Automatic Speech Recognition and Understanding, Keystone, CO, Dec. 1999.
Zue, V. et al. JUPITER: A telephone-based conversational interface for weather information. IEEE Transactions on Speech and Audio Processing, 8(1), Jan. 2000.
N. Badler and S. Platt. Animating facial expressions. In Computer Graphics, pp. 245-252.Siggraph, Aug. 1981.
T.Beier and S.Neely . Feature-based image metamorphosis. In Computer Graphics, pp. 35-42.Siggraph, Jul. 1992.
M. Brand.V oice puppetry. In Computer Graphics, Annual Conference Series, pp. 22-28.Siggraph, Aug. 1999.
B. Choe and H. seok Ko. Analysis and synthesis of facial expression with hand-generated muscle actuation basis. In Proceedings of Computer Animation, 2001.
T.Ezzat, G.Geiger, and T. Poggio. Trainable video realistic speech animation. In Computer Graphics, Annual Conference Series, pp. 388-398.Siggraph, Aug. 2002.
B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin. Making faces. In Computer Graphics, Annual Conference Series, pp. 55-66. Siggraph, Jul. 1998.
Y. Lee, D. Terzopoulos, and K. Waters. Realistic modeling for facial animation. In Computer Graphics, pp. 55-62.Siggraph, Aug. 1995.
S.Z. Li and L. Gu. Real-time multi-view face detection, tracking, pose estimation, alignment, and recognition. In IEEE Conf. on Computer Vision and Pattern Recognition Demo Summary, 2001.
P. Litwinowicz and L. Williams. Animating images with drawings In Computer Graphics, pp. 235-242. Siggraph, Aug. 1990.
Z. Liu, Y. Shan, and Z. Zhang. Expressive expression mapping with ratio images. In Computer Graphics, Annual Conference Series, pp. 271-276.Siggraph, Aug. 2001.
N. Magneneat-Thalmann, N.E. Primeau, and D. Thalmann. Abstract muscle actions procedures for human face animation. Visual Computer, 3(5):290-297, 1988.
K. Perlin and A. Goldberg. Improv: A system for scripting interactive actors in virtual worlds. In Computer Graphics, Annual Conference Series, pp. 205-216.Siggraph, Aug. 1996.
F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D.H. Salesin. Synthesizing realistic facial expressions from photographs. In Computer Graphics, Annual Conference Series, pp. 75-84.Siggraph, Jul. 1998.
F. Pighin, R. Szeliski, and D.H. Salesin. Resynthesizing facial animation through 3d model-based tracking. In International Conference on Computer Vision (ICCV'99), 1999.
S.M. Seize and C.R. Dyer. View morphing. In Computer Graphics, pp. 21-30.Siggraph, Aug. 1996.
D. Terzopoulos and K. Waters. Physically-based facial modeling and animation. Journal of Visualization and Computer Animation, 1(4):73-80, Mar. 1990.
S. Toelg and T. Poggio. Towards and example based image compression architecture for videoconferencing. In MIT Technical Report No. 1494, 1994.
K. Waters. A muscle model for animating three dimensional facial expression. Computer Graphic

Affiliated with

Also associated with

Rating

Geometry-driven feature point-based image synthesis does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Geometry-driven feature point-based image synthesis, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Geometry-driven feature point-based image synthesis will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3983560