Image analysis – Image compression or coding – Interframe coding
Patent
1996-04-03
1998-06-09
Couso, Jose L.
Image analysis
Image compression or coding
Interframe coding
G06K 936
Patent
active
057648034
ABSTRACT:
A method and apparatus for video coding whereby a region of an image which includes a predetermined object such as a person's face in the foreground portion of the image is automatically determined. Specifically, the foreground portion of the image is identified, and one or more predetermined (geometric) shapes (e.g., ellipses) are compared with the shapes of objects found in the foreground portion of the image. The foreground portion of an image may be determined by performing a global motion estimation of the overall image to detect global image movement resulting, for example, from camera pan and zoom. That portion of the image whose movement is consistent with the estimated global motion may be identified as the background portion, with the remainder of the image identified as the foreground portion. The identified region of the image which includes the predetermined object and portions of the image which do not include the predetermined object may be coded with differing levels of coding accuracy (e.g., using different quantization levels), such that if the identified region contains, for example, a person's face, the quality of the coding of the face may be improved relative to the quality of the coding of other portions of the image.
REFERENCES:
patent: 4218704 (1980-08-01), Netavali
patent: 4232338 (1980-11-01), Netravali et al.
patent: 4245248 (1981-01-01), Netravali
patent: 5086480 (1992-02-01), Sexton
patent: 5103488 (1992-04-01), Gemello et al.
patent: 5117287 (1992-05-01), Koike et al.
patent: 5136374 (1992-08-01), Jayant et al.
patent: 5309232 (1994-05-01), Hartung et al.
A.R. Buschmann, "1.15 Mbit/s Coding of Video Signals Including Global Motion Compensation," Signal Processing: Image Communication, vol. 3, Nos. 2-3, Jun. 1991, pp. 259-274.
D.M. Amitay, "Global-Motion Estimation In Image sequences of 3-D Scenes For Coding Applications," Signal Processing: Image Communication, vol. 6, 1995, pp. 507-520.
W. Guse et al., "Effective Exploitation Of Background Memory For Coding Of Moving Video Using Object Mask Generation," Proc. SPIE VCIP '90, vol. 1360, 1990, pp. 512-523.
ITU-T Study Group 15, "Draft Recommendation H.263: Video Coding For Narrow Telecommunication Channels," Boston, Jun. 1995.
C. Lettera et al., "Foreground/Background Segmentation In Videotelephony," Signal Processing: Image Communication, vol. 1, No. 2, Oct. 1989, pp. 181-189.
F. Moscheni et al., "A New Two-Stage Global/Local Motion Estimation Based On A Background/Foreground Segmentation," Proc. ICASSP '95, 1995, pp. 2261-2264.
C. Swain et al., "Defocus-Based Image Segmentation," Proc. ICASSP1995, pp. 2403-2406.
Y.T. Tse et al., "Global Zoom/Pan Estimation and Compensation For Video Compression," Proc. ICASSP'91, 1991, pp. 2725-2728.
J-H. Park et al., "Estimation Of Camera Parameters From Image Sequence For Model-Based Video Coding," IEEE Trans. On Circuits And Systems For Video Tech., vol. 4, No. 3, Jun. 1994, pp. 288-296.
A. Eleftheriadis et al., "Model-Assisted Coding Of Video Teleconferencing Sequences At Low Bit Rates," ISCAS 1994, London, May-Jun. 1994, pp 177-180.
A. Jacquin et al., "Automatic Location Tracking Of Faces And Facial Features In Video Sequences," Proc. Of International Workshop On Automatic Face And Gesture Recognition, Zurich, Switzerland, Jun. 26-28, 1995, pp. 1-6.
D.E. Pearson, "Developments In Model-Based Video Coding," Proc. Of The IEEE, vol. 83, No. 6, Jun. 1995, pp. 892-906.
F. Pereira et al., "Mobile Videotelephone Communications: The CCITT H.261 Chances," SPIE, vol. 1977, pp. 168-179.
M. Menezes de Sequeira et al., "Knowledge-Based Videotelephone Sequence Segmentation," SPIE, vol. 2094, pp. 858-868.
K. Aizawa et al., "Model-Based Analysis Image Coding (MBASIC) System For A Person's Face," Signal Processing: Image Communication, vol. 1, No. 2, Oct. 1989, pp. 139-152.
K. Aizawa et al., "Human Facial Motion Analysis And Synthesis With Applications To Model-Based Coding," Motion Analysis And Image Sequence Processing, Chapter 11, Kluwer Academic Publishers, 1993, pp. 317-348.
J.S. Angiolillo et al., "Video Telephony," AT&T Technical Journal, vol. 72, No. 3, May/Jun. 1993, pp. 7-20.
Aravind et al., "Image And Video Coding Standards," AT&T Technical Journal, vol. 72, No. 1, Jan./Feb. 1993, pp. 67-80.
M. Buck, "Model-Based Image Sequence Coding," Motion Analysis And Image Sequence Processing, Chapter 10, Kluwer Academic Publishers, 1993, pp. 285-315.
C.S. Choi et al., "Analysis and Synthesis Of Facial Expressions In Knowledge-Based Coding Of Facial Image Sequences," Proc. ICASSP, 1991, pp. 2737-2740.
I. Craw et al., "Automatic Extraction Of Face Features," Pattern Recognition Letters, vol. 5, No. 2, Feb. 1987, pp. 183-187.
N. Diehl, "Object-Oriented Motion Estimation and Segmentation In Image Sequences," Signal Processing: Image Communication, vol. 3, No.1, Feb. 1991, pp. 23-56.
"Draft Revision Of Recommendation H.261: Video Codec For Audiovisual Services At p x 64 kbit/s," Signal Processing: Image Communication, vol. 2, No. 2, Aug. 1990, pp. 221-239.
M. A. Fischler et al., "The Representation And Matching Of Pictorial Structures," IEEE Trans. On Computers, Jan. 1973, pp. 67-92.
R. Forcheimer et al., "Image Coding-From Waveforms To Animation," IEEE Trans. On Acoustics, Speech, and signal Processing, vol. 37, No. 12, Dec. 1989, pp. 2008-2023.
V. Govindaraju et al., "Locating Human Faces In Newspaper Photographs,"Proc. IEEE Computer Society Conference On Computer Vision And Pattern Recognition, Jun. 1989, pp. 549-554.
V. Govindaraju et al., "A Computational Model For face Location," Proc. Third International Conference On Computer Vision, Dec. 1990, pp. 718-721.
M. Hotter et al., "Image Segmentation Based On Object-Oriented Mapping Parameter Estimation," Signal Processing, vol.15, No. 3, Oct. 1988, pp. 315-334.
C. Podilchuk et al., "Geometric Vector Quantization For Subband-Based Video Coding," DIMAC Series In Discrete Mathematics And Theoretical Computer Science, vol. 14, 1993, pp. 243-251.
A. Jacquin et al., "Very Low Bit Rate 3D Subband-Based Video Coding With A Dynamic Bit Allocation," Proc. International Symposium on Fiber Optic Networks and Video Communications, Apr. 1993, pp. 156-167.
M. Kunt et al., "Second-Generation Image Coding Techniques," Proc. IEEE, vol. 73, No. 4, Apr. 1985, pp. 549-574.
M. Liou, "Overview Of The px64 kbit/s Video Coding Standard," Communications of the ACM, vol. 34, No. 4, Apr. 1991, pp. 60-63.
H.G. Musmann et al., "Object-Oriented Analysis-Synthesis Coding Of Moving Images," Signal Processing: Image Communication, vol. 1, No. 2, Oct. 1989, pp. 117-138.
Y. Nakaya et al., "Model-Based/Waveform Hybrid Coding For Videotelephone Images," Proc. ICASSP, 1991, pp. 2741-2744.
Y. Nakaya et al., "Model-Based/waveform Coding for Low-Rate Transmission Of Facial Images," IEICE Trans. on Communications, vol. E75-B, No. 5, May 1992, pp. 377-384.
T. Pavlidis, Structural Pattern Recognition, Springer-Verlag, 1977, pp. 1-10; 297-302.
Jacquin Arnaud Eric
Rabiner Wendi Beth
Brown Kenneth M.
Couso Jose L.
Lucent Technologies - Inc.
LandOfFree
Motion-adaptive modelling of scene content for very low bit rate does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Motion-adaptive modelling of scene content for very low bit rate, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Motion-adaptive modelling of scene content for very low bit rate will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2211125