Image analysis – Applications – Target tracking or detecting
Reexamination Certificate
2001-07-24
2004-03-30
Mehta, Bhavesh M. (Department: 2625)
Image analysis
Applications
Target tracking or detecting
C382S118000, C382S209000, C382S240000, C345S473000
Reexamination Certificate
active
06714661
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates to avatar animation, and more particularly, to facial feature tracking.
Virtual spaces filled with avatars are an attractive the way to allow for the experience of a shared environment. However, animation of a photo-realistic avatar generally requires robust tracking of an actor's movements, particularly for tracking facial features.
Accordingly, there exists a significant need for improved facial feature tracking. The present invention satisfies this need.
SUMMARY OF THE INVENTION
The present invention is embodied in a method, and related system, for customizing a visual sensor using a neutral face image of an actor. The method includes capturing a front neutral face image of an actor and automatically finding facial feature locations on the front neutral face image using elastic bunch graph matching. Nodes are automatically positioned at the facial feature locations on the front neutral face image of the actor. The node positions are then manually corrected on front neutral face image of the actor.
Further, the method may include generating a corrector graph based on the corrected node positions.
Other features and advantages of the present invention should be apparent from the following description of the preferred embodiments taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the invention.
REFERENCES:
patent: 4725824 (1988-02-01), Yoshioka
patent: 4805224 (1989-02-01), Koezuka et al.
patent: 4827413 (1989-05-01), Baldwin et al.
patent: 5159647 (1992-10-01), Burt
patent: 5168529 (1992-12-01), Peregrim et al.
patent: 5187574 (1993-02-01), Kosemura et al.
patent: 5220441 (1993-06-01), Gerstenberger
patent: 5280530 (1994-01-01), Trew et al.
patent: 5333165 (1994-07-01), Sun
patent: 5383013 (1995-01-01), Cox
patent: 5430809 (1995-07-01), Tomitaka
patent: 5432712 (1995-07-01), Chan
patent: 5511153 (1996-04-01), Azarbayejani et al.
patent: 5533177 (1996-07-01), Wirtz et al.
patent: 5550928 (1996-08-01), Lu et al.
patent: 5581625 (1996-12-01), Connell
patent: 5588033 (1996-12-01), Yeung
patent: 5680487 (1997-10-01), Markandey
patent: 5699449 (1997-12-01), Javidi
patent: 5714997 (1998-02-01), Anderson
patent: 5715325 (1998-02-01), Bang et al.
patent: 5719951 (1998-02-01), Shackleton et al.
patent: 5719954 (1998-02-01), Onda
patent: 5736982 (1998-04-01), Suzuki et al.
patent: 5764803 (1998-06-01), Jacquin et al.
patent: 5774591 (1998-06-01), Black et al.
patent: 5802220 (1998-09-01), Black et al.
patent: 5809171 (1998-09-01), Neff et al.
patent: 5828769 (1998-10-01), Burns
patent: 5835616 (1998-11-01), Lobo et al.
patent: 5917937 (1999-06-01), Szeliski et al.
patent: 5982853 (1999-11-01), Liebermann
patent: 5995119 (1999-11-01), Cosatto et al.
patent: 6011562 (2000-01-01), Gagné et al.
patent: 6031539 (2000-02-01), Kang et al.
patent: 6044168 (2000-03-01), Tuceryan et al.
patent: 6052123 (2000-04-01), Lection et al.
patent: 6222939 (2001-04-01), Wiskott et al.
patent: 6301370 (2001-10-01), Steffens et al.
patent: 0807902 (1997-11-01), None
patent: WO9/53443 (1999-10-01), None
Wiskott et al, Phantom faces for face analysis, 1997, Institute for neuroinformatic, Germany pp. 308-311.*
Wiskott et al, Face recognition by elastic bunch graph matching, 1997, IEEE, pp. 775-779.*
Tomasi, C., et al., “Stereo Without Search”,Proceedings of European Conference on Computer Vision,Cambridge, UK, 1996, 14 pp. (7 sheets).
Triesch, J., et al, “Robust Classification of Hand Postures Against Complex Backgrounds”,Proceedings of the Second International Conference on Automatic Face and Gesture Recognition,Killington, VT, Oct. 1996, 6 pp.
Turk, M., et al, “Eigenfaces for Recognition”,Journal of Cognitive Neuroscience,vol. 3, No 1, pp. 71-86, 1991.
Wiskott, L., et al, “Face Recognition and Gender Determination”,Proceedings of International Workshop on Automatic Face and Gesture Recognition,pp. 92-97, Zurich CH, Jun. 26, 1995.
Wiskott, L., et al, “Face Recognition by Elastic Bunch Graph Matching”,Internal Report, IR-INI 96-08,Institut fur Neuroinformatik, Ruhr-Universitat, Bochum, pp. 1-21, Apr. 1996.
Wiskott, L., “Labeled Graphs and Dynamic Link Matching for Face Recognition and Scene Analysis”,Verlag Harr Deutsch,Thun-Frankfurt am Main. Reihe Physik, Dec. 1995, pp. 1-109.
Wiskott, L., “Phanton Faces for Face Analysis”.Proceedings of 3rd Joint Symposium on Neural Computation,Pasadena, CA, vol. 6, pp. 46-52, Jun. 1996.
Wiskott, L., “Phanton Faces for Face Analysis”.Internal Report, IR-INI 96-06,Institut fur Neoroinformatik, Ruhr-Universitat, Bochum, Germany, Apr. 1996, 12 pp.
Wiskott, L. “Phantom Faces for Face Analysis”,Pattern Recognition,vol. 30, No. 6, pp. 837-846, 1997.
Wiskott, L., et al, “Face Recognition by Elastic Bunch Graph Matching”,IEEE Transactions on Pattern Analysis and Machine Intelligence,19(7), pp. 775-779, 1997.
Wong, R., et al, “PC-Based Human Face Recognition System”,IEEE,pp. 641-644, 1992.
Wurtz, R., “Object Recognition Robust Under Translations, Deformations, and Changes in Background”,IEEE Transactions on Patern Analysis and Machine Intelligence,vol. 19, No. 7, Jul. 1997, pp. 769-775.
Wurtz, R., et al, “Corner Detection in Color Images by Multiscale Combination of End-stopped Cortical Cells”,Artificial Neural Networks—ICANN'97, Lecture Notes in Computer Science, vol. 1327, pp. 901-906, Springer-Verlag, 1997.
Yao, Y., et al, “Tracking a Dynamic Set of Feature Points”,IEEE Transactions on Image Processing,vol. 4, No. 10, Oct., 1995, pp. 1382-1394.
Kruger, N., et al, “Object Recognition with a Sparse and Autonomously Learned Representation Based on Banana Wavelets”,Internal Report 96-11,Institut fur Neuroinformatik, Dec. 96, pp. 1-24.
Kruger, N., et al, “Object Recognition with Banana Wavelets”,European Symposium on Artificial Neural Networks(ESANN97), 1997, 6 pp.
Kruger, N., “An Algorithm for the Learning of Weights in Discrimination Functions Using a priori Constraints”,IEEE Transactions on Pattern Analysis and Machine Intelligence,vol. 19, No. 7, Jul. 1997, pp. 764-768.
Lades, M., et al, “Distortion Invarient Object Recognition in the Dynamic Link Architecture”,IEEE Transactions on Computers,vol. 42, No. 3, 1993, 11 pp.
Luong, Q. T., et al, “The Fundamental Matrix, Theory, Algorithm, and Stability Analysis”,INRIA,1993, pp. 1-46.
Manjunath, B. S., et al, “A Feature Based Approach to Face Recognition”,In Proceedings IEEE Conference on Computer Vision and Pattern Recognition,pp. 373-378, 3/92.
Mauer, T., et al, “Single-View Based Recognition of Faces Rotated in Depth”, InProceedings of the International Workshop on Automatic Face and Gesture Recognition,pp. 248-253, Zurich, CH, Jun. 26, 1995.
Mauer, T., et al, “Learning Feature Transformations to Recognize Faces Rotated in Depth”, InProceedings of the International Conference on Artificial Neural Networks,vol. 1, pp. 353-358, Paris, France, Oct. 9-13, 1995.
Mauer, T., et al, “Tracking and Learning Graphs and Pose on Image Sequences of Faces”,Proceedings of 2nd International Conference on Automatic Face and Gesture Recognition,Oct. 14-16, 1996, pp. 176-181.
Maybank, S. J., et al, “A Theory of Self-Calibration of a Moving Camera”,International Journal of Computer Vision,8(2), pp. 123-151, 1992.
McKenna, S.J., et al, Tracking Facial Feature Points With Gabor Wavelets and Shape Models, (publication&date unknown), 6 pp.
Okada, K., et al, “The Bochum/USC Face Recognition System”, 19 pp. (publication&date unknown).
Okutomi, M., et al, “A Multiple-Baseline Stereo”,IEEE Trans. on Pattern Analysis and Machine Intelligence,vol. 15, No. 4, pp. 353-363, Apr. 1993.
Peters, G., et al, “Learning Object Representations by Clustering Banana Wavelet Responses”,Tech. Report IR-INI 96-09,Institut fur Neuroinformatik, Ruhr Universitat, Bochum, 1996, 6 pp.
Phillips, P. J., et al, “The Face Recognition Technology (FERET) Program”,Proceedings of Office of National Drug Control Policy,CTAC International Technology Symposium, Aug. 18-22, 1997, 10 pages.
Pighin, F, et al, “Synthesizing Realistic Facial Expressions from Photograph
Buddenmeier Ulrich F.
Neven Hartmut
Choobin Barry
Fawcett Robroy R.
Mehta Bhavesh M.
Nevengineering, Inc.
LandOfFree
Method and system for customizing facial feature tracking... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and system for customizing facial feature tracking..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for customizing facial feature tracking... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3200814