Image analysis – Applications – Motion or velocity measuring
Reexamination Certificate
2006-03-28
2006-03-28
Ahmed, Samir (Department: 2623)
Image analysis
Applications
Motion or velocity measuring
C382S118000, C382S195000, C348S154000
Reexamination Certificate
active
07020305
ABSTRACT:
The system provides improved procedures to estimate head motion between two images of a face. Locations of a number of distinct facial features are identified in two images. The identified locations can correspond to the eye comers, mouth corners and nose tip. The locations are converted into as a set of physical face parameters based on the symmetry of the identified distinct facial features. The set of physical parameters reduces the number of unknowns as compared to the number of equations used to determine the unknowns. An initial head motion estimate is determined by: (a) estimating each of the set of physical parameters, (b) estimating a first head pose transform corresponding to the first image, and (c) estimating a second head pose transform corresponding to the second image. The head motion estimate can be incorporated into a feature matching algorithm to refine the head motion estimation and the physical facial parameters. In one implementation, an inequality constraint is placed on a particular physical parameter—such as a nose tip, such that the parameter is constrained within a predetermined minimum and maximum value. The inequality constraint is converted to an equality constraint by using a penalty function. Then, the inequality constraint is used during the initial head motion estimation to add additional robustness to the motion estimation.
REFERENCES:
patent: 5469512 (1995-11-01), Fujita et al.
patent: 5774591 (1998-06-01), Black et al.
patent: 5864630 (1999-01-01), Cosatto et al.
patent: 5990901 (1999-11-01), Lawton et al.
patent: 5995119 (1999-11-01), Cosatto et al.
patent: 6009210 (1999-12-01), Kang
patent: 6047078 (2000-04-01), Kang
patent: 6072496 (2000-06-01), Guenter et al.
patent: 6118887 (2000-09-01), Cosatto et al.
patent: 6154559 (2000-11-01), Beardsley
patent: 6163322 (2000-12-01), LaChapelle
patent: 6173069 (2001-01-01), Daly et al.
patent: 6188777 (2001-02-01), Darrell et al.
patent: 6301370 (2001-10-01), Steffens et al.
patent: 6445810 (2002-09-01), Darrell et al.
patent: 6496594 (2002-12-01), Prokoski
patent: 6504546 (2003-01-01), Cosatto et al.
patent: 6526161 (2003-02-01), Yan
patent: 6532011 (2003-03-01), Francini et al.
patent: 6556196 (2003-04-01), Blanz et al.
patent: 6580821 (2003-06-01), Roy
patent: 6661907 (2003-12-01), Ho et al.
patent: 6664956 (2003-12-01), Erdem
patent: 6714660 (2004-03-01), Ohba
patent: 6747652 (2004-06-01), Inoue et al.
patent: 6771303 (2004-08-01), Zhang et al.
patent: 6807290 (2004-10-01), Liu et al.
patent: 6879709 (2005-04-01), Tian et al.
patent: 6919892 (2005-07-01), Cheiky et al.
patent: 2002/0102010 (2002-08-01), Liu et al.
patent: 11-1612821 (1999-06-01), None
Faugeras “Three Dimesional Computer Vision”; 1999; pp. 1-663.
Zhang; “A New Multisage Approach to Motion and Structure Estimation: From Essential Parameters to Euclidean Motion Via Fundamental Matrix”; Jun. 1996; pp. 1-38.
More; “The Levenberg-Marquardt Algorithm: Implementation and Theory”; 1978; pp. 105-116.
Zhang; “On the Optimization Criteria Used in Two-View Motion Analysis”; Jul. 1998; pp. 717-729.
Jebara et al; “Parametrized Structure from Motion for 3D Adaptive Feedback Tracking of Faces”; 1997, pp. 144-150.
Fua; “Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences”; pp. 1-8.
Pighin et al; “Synthesizing Realistic Facial Expression from Photographs”; pp. 1-20.
Fua et al; “From Regular Images to Animated Heads: A Least Squares Approach”; pp. 1-15.
Kang et al; “Appearance-based Structure from Motion Using Linear Classes of 3-D Models”; pp. 1-ii, 1-32.
Pei et al., “Global Motion Estimation in Model-Based Image Coding by Tracking Three-Dimensional Contour Feature Points”, IEEE, 1051-8215/98, 1998, pp. 181-190.
Pighin et al., “Resynthesizing Facial Animation Through 3-D Model-Based Tracking”, IEEE, Inspec Accession No. 6371194, 1999, pp. 1-8.
Shakunaga et al., “Integration of Eigentemplate and Structure Matching for Automatic Facial Feature Detection”, IEEE, Inspec Accession No. 5920393, pp. 1-6.
Perlin, “Realtime Responsive Animation with Personality”, IEEE, 1071-2626/95, pp. 5-15.
Skaria et al., “Modeling Subdivision Control Meshes for Creating Cartoon Faces”, IEEE 0-7695-0853-7/01, 2001, pp. 216-225.
Parke, “Computer Graphic Models for the Human Face”, IEEE, CH515-6/79/0000-0724, 1979, pp. 724-727.
Terzopoulos et al., “Analysis of Facial Images Using Physical and Anatomical Models”, IEEE, CH2934-8/90/0000/072, 1990, pp. 727-732.
DiPaola, “FaceSpace: a Facial Spatial-Domain Toolkit”, IEEE, 1093-9547, pp. 1-5.
DeCarlo et al., “An Anthropometric Face Model using Variational Techniques”, Proceedings SIGGRAPH 1998, pp. 67-74.
Blanz et al., “Face Recognition Based on Fitting a 3D Morphable Model”, IEEE, 0162-8828/03, 2003, pp. 1063-1074.
Zheng et al., “3D Models from Contours: Further Identification of Unexposed Areas”, IEEE, 0-8186, 1992, pp. 733-741.
Vetter et al., “Linear Object Classes and Image Synthesis From a Single Example Image”, IEEE Transactions on Pattern Analysis and Machine Intelligence vol. 19, n 7, 0162-8828/97, Jul. 1997, pp. 733-741.
Dariush et al., “Spatiotemporal Analysis of Face Profiles: Detection, Segmentation and Registration”, IEEE, Inspec Accession No. 5920418, pp. 248-253.
Akimoto et al., “Automatic Creation of 3D Facial Models”, IEEE Computer Graphics & Applications, 0272-16/93, 1993, pp. 16-22.
Ohya et al, “Artistic Anatomy Based Real Time Reproduction of Facial Expressions”, IEEE 0-7695-0253, 684689, 7 pages.
Fritsch et al., Improving adaptive skin color segmentation by incorporating results from face detection, IEEE 0-7803-7549-9, 337-343.
Spors et al. “A real-time face tracker for color video”, IEEE 0-7803-7041-4/01, 1493-1496.
Saber et al., “Face detection and facial feature extraction using color, shape and symmetry based cost function”, IEEE 1015-4651/96, 654-658.
Shinjiro Kawato et al., “Automatic Skin-color Distribution Extraction for Face Detection and Tracking”, IEEE 0-7803-5747, pp. 1415-1418.
Pighin Frederic et al., Synthesizing Realistic Facial Expressions from Photographs, ACM ISBN: 0-89791-9998-8, 1-10.
Pei et al., Global Motion Estimation in Model-Based Image Coding by Tracking Three-Dimensional Contour feature Points, IEEE 1051-8215/98, 181-189.
Liu et al., Robust Head motion Computation by Taking Advantage of Physical Properties, IEEE 0-7695-0939-8/00, PP. 73-77.
Macliu et al., A robust model vased approach for eD head tracking in video sequences, pp. 169-174.
Lopez, et al., 3D Head Pose Computation from 2D Images, IEEE, 0-8166-7310, pp. 599-602.
Zhang et al., Rapid Modeling of 3D Faces for Animationn Using An Efficient Adaption Algorithm.
Kawato et al., “Automatic Skin-color Distribution Extraction for Face Detection and Tracking”, IEEE 0-7803-5747-700, 2000 IEEE.
Liu Zicheng
Zhang Zhengyou
Ahmed Samir
Bhatnagar Anand
Lee & Hayes PLLC
Microsoft Corporation
LandOfFree
System and method providing improved head motion estimations... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method providing improved head motion estimations..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method providing improved head motion estimations... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3583408