Image analysis – Applications – Personnel identification
Reexamination Certificate
2011-08-30
2011-08-30
Ahmed, Samir A (Department: 2624)
Image analysis
Applications
Personnel identification
C382S308000, C345S582000, C345S583000, C345S584000, C345S585000, C345S586000
Reexamination Certificate
active
08009880
ABSTRACT:
A subregion-based image parameter recovery system and method for recovering image parameters from a single image containing a face taken under sub-optimal illumination conditions. The recovered image parameters (including albedo, illumination, and face geometry) can be used to generate face images under a new lighting environment. The method includes dividing the face in the image into numerous smaller regions, generating an albedo morphable model for each region, and using a Markov Random Fields (MRF)-based framework to model the spatial dependence between neighboring regions. Different types of regions are defined, including saturated, shadow, regular, and occluded regions. Each pixel in the image is classified and assigned to a region based on intensity, and then weighted based on its classification. The method decouples the texture from the geometry and illumination models, and then generates an objective function that is iteratively solved using an energy minimization technique to recover the image parameters.
REFERENCES:
patent: 6828972 (2004-12-01), Zhang et al.
patent: 6853745 (2005-02-01), Jacobs et al.
patent: 6888960 (2005-05-01), Penev et al.
patent: 6903738 (2005-06-01), Pfister et al.
patent: 6915022 (2005-07-01), Huang
patent: 7058217 (2006-06-01), Thornber et al.
patent: 7103225 (2006-09-01), Yang et al.
patent: 7139439 (2006-11-01), Hwang
patent: 2006/0182367 (2006-08-01), Moghaddam
Marschner, S. R., B. Guenter, S. Raghupathy, Modeling and Rendering for Realistic Facial Animation, Rendering Techniques, 2000, pp. 231-242, Springer Wien New York.
Zhang, L., S. Wang, D. Samaras, Face Sythesis and Recognition from a Single Image under Arbitrary Unknown Lighting Using a Spherical Harmonic Basis Morphable Model, Proc. of the 2005 IEEE comp. Soc. Conf. on Comp. Vision and Pattern recognition (CVPR'05), 2005, pp. 209-216, vol. 2.
Adini, Y., Y. Moses, and S. Ullman, Face recognition, The problem of compensating for changes in illumination direction, PAMI, 1997, pp. 721-732, vol. 19.
Basri, R., and D. W. Jacobs, Lambertian reflectance and linear subspaces, IEEE Trans. Pattern Analysis and Machine Intelligence, Feb. 2003, pp. 218-233, vol. 25, No. 2.
Belhumeur, P. N., J. P. Hespanha, D. J. Kriegman, Eigenfaces vs. fisherfaces: Recognition using class specific linear projection, Trans. on Pattern Analysis and Mach. Intelligence, Jul. 1997, pp. 711-720, vol. 19, No. 7.
Belhumeur, P., D. Kriegman, What is the set of images of an object under all possible illumination conditions?, Int. Journal of Comp. Vision, vol. 28, No. 3, 1998, pp. 245-260.
Blanz, V., S. Romdhani, T. Vetter, Face identification across different poses and illuminations with a 3D morphable model, Proc. Fifth IEEE Int'l Conf. on Automatic Face and Gesture Recognition, May 20-21, 2002, pp. 192-197.
Blanz, V., K. Scherbaum, T. Vetter, H.-P. Seidel, Exchanging faces in images, Proc. Eurographics'04, Computer Graphics Forum, pp. 669-676, vol. 23, No. 3.
Blanz, V., T. Vetter, A morphable model for the synthesis of 3D faces, Proceedings of the 26th Annual Conf. on Comp. Graphics and Interactive Techniques, 1999, pp. 187-194.
Cabral, B., M. Olano, and P. Nemec, Reflection space image based rendering, Proc. of the 26th Annual Conf. on Comp. Graphics and Interactive Techniques, 1999, pp. 613-620.
Chellappa, R., C. L. Wilson, S. Sirohey, Human and machine recognition of faces: A survey, Proc. of the IEEE, May 1995, pp. 705-741, vol. 83, No. 5.
Cootes, T., G. Edwards, and C. Taylor, Active appearance models, IEEE Trans. Pattern Analysis and Mach. Intelligence, 2001, pp. 681-685, vol. 23, No. 6.
Debevec, P.E., T. Hawkins, C. Tchow, H.-P. Duiker, W. Sarokin, and M. Sagar, Acquiring the reflectance field of a human face, Comp. Graphics, Annual Conf. Series Siggraph, Jul. 2000, pp. 145-156.
Dimitrijevic, M., S. Ilic, P. Fua, Accurate face models from uncalibrated and ill-lit video sequences, IEEE Comp. Soc. Conf. on Comp. Vision and Pattern Recognition (CVPR'04), 2004, pp. 1034-1041, vol. 2.
Eisemann, E., F. Durand, Flash photography enhancement via intrinsic relighting, Int'l Conf. on Comp. Graphics and Interactive Techniques, ACM SIGGRAPH 2004, pp. 673-678.
Epstein, R., P. Hallinan, and A. L. Yuille, 5±2 eigenimages suffice: an empirical investigation oflow-dimensional lighting models, Proceedings of the Workshop on Physics-Based Modeling in Comp. Vision, Jun. 18-19, 1995, pp. 108-116.
Freeman, W. T., and E.C. Pasztor, Learning low-level vision, Int'l Conf. on Comp. Vision, 1999, pp. 1182-1189.
Georghiades, A. S., P. N. Belhumeur, and D. J. Kriegman, From few to many: Illumination cone models for face recognitionunder variable lighting and pose, Transactions on Pattern Analysis and Mach. Intelligence, Jun. 2001, pp. 643-660, vol. 23, No. 6.
Hallinan, P., A low-dimensional representation of human faces for arbitrary lighting conditions, Proc. IEEE CVPR, 1994, pp. 995-999.
Land, E. H. and J. J. McCann, Lightness and retinex theory, J. of the Optical Society of America, 1971, pp. 1-11, vol. 61, No. 1.
Lee, J., R. Machiraju, H. Pfister, B. Moghaddam, Estimation of 3D faces and illumination from single photographs using a bilinear illumination model, Eurographics Symposium on Rendering (EGSR), Jun. 2005.
Lee, J., B. Moghaddam, H. Pfister, R. Machiraju, A bilinear illumination model for robust face recognition,Tenth IEEE Int'l Conf. on Comp. Vision, Oct. 17-21, 2005, pp. 1177-1184, vol. 2.
Lee, K.-C., J. Ho, D. Kriegman, Nine points of light: Acquiring subspaces for face recognition under variable lighting, Proceedings of the 2001 IEEE Comp. Soc. Conf. on Comp. Vision and Pattern Recognition, 2001, pp. 519-526, vol. 1.
Liu, Z., Y. Shan, Z. Zhang, Expressive expression mapping with ratio images, SIGGRAPH 2001, Los Angeles, Aug. 12-17, pp. 271-276.
Loscos, C., G. Drettakis, and L. Robert, Interactive virtual relighting of real scenes, IEEE Trans. Visualization and Comp. Graphics, Dec. 2000, pp. 289-305, vol. 6, No. 4.
Luong, Q.-T., P. Fua, Y. G. Leclerc, Recovery of reflectances and varying illuminants from multiple views, 7th European Conference on Computer Vision, 2002, pp. 163-179, vol. 3.
Marschner, S. R., B. Guenter, and S. Raghupathy, Modeling and rendering for realistic facial animation, Rendering Techniques, 2000, pp. 231-242, Springer Wien New York.
Marschner S., S. Westin, E. Lafortune, and K. Torrance, Image-based BRDF measurement, Applied Optics, 2000, pp. 2592-2600, vol. 39, No. 16.
Qing, L., S. Shan, X. Chen, Face relighting for face recognition under generic illumination, IEEE Int'l Conf. on Acoustics, Speech, and Signal Processing (ICASSP2004), May 17-21, 2004, pp. 733-736, Quebec, Canada.
Ramamoorthi, R., and P. Hanrahan, An efficient representation for irradiance environment maps, Proceedings of ACM SIGGRAPH 2001, pp. 497-500.
Ramamoorthi, R. and P. Hanrahan, A signal-processing framework for inverse rendering, SIGGRAPH, 2001, pp. 117-128.
Riklin-Raviv, T., A. Shahua, The quotient image: Class based re-rendering and recognition with varying illuminations, IEEE Trans. on Pattern Analysis and Mach. Intelligence (PAMI) 2001, pp. 129-139, vol. 23, No. 2.
Romdhani, S., T. Vetter, Efficient, Robust and Accurate Fitting of a 3D Morphable Model, Proc. of the Ninth IEEE Int'l Conf. on Comp. Vision, 2003, vol. 2, pp. 59-66.
Salt, E., and S. Ullman, Recognizing novel 3D objects under new illumination and viewing position using a small number of examples, Proc. Int'l Conf. Comp. Vision, 1998, pp. 153-161.
Samaras, D., D. Metaxas, P. Fua, and Y. G. Leclerc, Variable albedo surface reconstruction from stereo and shape from shading, CVPR, 2000, pp. 480-487.
Sato, I., Y. Sato, and K. Ikeuchi, Acquiring a radiance distribution to superimpose virtual objects onto a real scene, IEEE Trans. on Visualization and Comp. Graphics, 1999, pp. 1-12, vol. 5, No. 1.
Sim, T., S. Baker, and M. Bsat, The CMU pose, illumination, and expression database, IEEE Trans. Pattern Analysis and Mach. Intelligence, Dec. 2003, pp. 1615-1618, vol. 25, No. 12.
Sim, T., and T. Kanade, Combining models and exemplars for face recognition: An illuminati
Hua Gang
Liu Zicheng
Wang Yang
Zhang Zhengyou
Ahmed Samir A
Fischer Craig S.
Hu Fred
Lyon & Harr L.L.P.
Microsoft Corporation
LandOfFree
Recovering parameters from a sub-optimal image does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Recovering parameters from a sub-optimal image, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Recovering parameters from a sub-optimal image will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2726452