Content-adaptive compression encoding

Details Content-adaptive compression encoding Content-adaptive compression encoding

1998-05-22

2002-11-05

Britton, Howard (Department: 2613)

Pulse or digital communications

Bandwidth reduction or expansion

Television or motion video signal

C382S243000

Reexamination Certificate

active

06477201

ABSTRACT:

The invention relates to compression encoding of information streams and, more particularly, the invention relates to content-adaptive compression encoding of information streams to selectively provide information emphasis and/or de-emphasis.
BACKGROUND OF THE DISCLOSURE
In several communications systems the data to be transmitted is compressed so that the available bandwidth is used more efficiently. For example, the Moving Pictures Experts Group (MPEG) has promulgated several standards relating to digital data delivery systems. The first, known as MPEG-1 refers to ISO/IEC standards 11172 and is incorporated herein by reference. The second, known as MPEG-2, refers to ISO/IEC standards 13818 and is incorporated herein by reference. A compressed digital video system is described in the Advanced Television Systems Committee (ATSC) digital television standard document A/53, and is incorporated herein by reference.
The above-referenced standards describe data processing and manipulation techniques that are well suited to the compression and delivery of video, audio and other information using fixed or variable length digital communications systems. In particular, the above-referenced standards, and other “MPEG-like” standards and techniques, compress, illustratively, video information using intra-frame coding techniques (such as run-length coding, Huffman coding and the like) and inter-frame coding techniques (such as forward and backward predictive coding, motion compensation and the like). Specifically, in the case of video processing systems, MPEG and MPEG-like video processing systems are characterized by prediction-based compression encoding of video frames with or without intra- and/or inter-frame motion compensation encoding.
In an MPEG-like motion video compression process, it is known to use a quantity called Mquant to determine the quality of the encoding of each 16 picture element (pixel) by 16 pixel macroblock in a video frame or picture. That is, a rate-control process determines a value of Mquant for each macroblock in a picture to produce (at a decoder) the best quality picture without exceeding the available bit budget. Lower values of Mquant, which result in higher bit allocations and correspondingly better picture quality, are typically assigned to macroblocks within regions of low activity (i.e., low luminance frequency), since the human eye is more sensitive to such low frequency video information. Similarly, higher values of Mquant, which result in lower bit allocations and correspondingly lower picture quality, are typically assigned to macroblocks within regions of high activity (i.e., high luminance frequency), since the human eye is less sensitive to such high frequency video information.
Unfortunately, the mechanical assignment of Mquant and other qualitative parameters may produce encoded pictures having regions of special interest encoded with less than desired quality. For example, an advertisement for, e.g., a soap manufacturer may comprise an image of a person holding up a bar of soap. From the perspective of a soap manufacturer, the details of the bar of soap are very important, while the details of the person holding the soap are less important. Thus, the important image region is that image region including. the bar of soap, rather than the image region including the person. However, if the above-described mechanical assignment of Mquant values is used, the qualitative emphasis may be misdirected to the person rather than the bar of soap.
Therefore, it is seen to be desirable to provide content-adaptive encoding of information, such as video information. Specifically, it is seen to be desirable to provide content-adaptive encoding of information effectuating a selective enhancement or degradation of information quality, such as video information quality.
SUMMARY OF THE INVENTION
The invention comprises a method and concomitant apparatus for providing selective enhancement and/or degradation of an information frame using content-based, regional analysis techniques. In general, the invention provides a subjective evaluator that delineates regions of an information space to be encoded in a qualitatively preferential or non-preferential manner such that the encoded information space comprises one or more of normal, emphasized or de-emphasized information content.
Specifically, the invention comprises a method for selectively encoding an information stream comprising a plurality of information frames, comprising the steps of: generating, in response to a subjective evaluation of the contents of an information frame, a mask indicative of a desired encoding quality adjustment for one or more information regions within said information frame; and associating each of said one or more information regions with respective encoding quality adjustment indicia; encoding said information frame in accordance with said encoding quality adjustment indicia.
In one embodiment of the invention, an operator delineates high value and/or low value regions of an information frame, illustratively a video frame. High value portions of the information frame are encoded at an enhanced quality level, while low value portions of the information frame are encoded at a degraded quality level.
In another embodiment of the invention, the quality enhancement and/or degradation is effected using one or more of several techniques including of a bit allocation method and a regional and sub-regional filtering method.


REFERENCES:
patent: 5802220 (1998-09-01), Black et al.
patent: 0 676 899 (1995-10-01), None
patent: 0 739 141 (1996-10-01), None
patent: 0 790 741 (1997-08-01), None
Feng et al.: “Adaptive object tracking and video compression with dynamic contours”, NRSC 98, IEEE XP002112425ISBN: 0-7803-5121-5, pp. INV3/1-26.*
J. Bergen, P. Anandan, K. Hanna, R. HIngorani, “Hierarchical Model-Based Motion Estimation”, Proc. of European Conference on Computer Vision-92, Mar. 23, 1992.
Yutao Feng Et Al: “Adaptive object tracking and video compression with dynamic contours”, Proceedings of the Fifteenth National Radio Science Confreence, NRSC '98 (CAT. No. 98EX109) Proceedings of the Fifteenth National Radio Science Conference. NRSC '98, Cairo, Egypt, Feb. 24-26, 1998, New York, NY, USA, IEEE, USA, pp. INV3/1-26 XP002112425ISBN: 0-7803-5121-5 p. 3-6, line 1—pp. 3-6, line 32 p. 3-19,line 6-p. 3-19, line 16.
Yaser Yacoob Et Al: “Computer Spatio-Temporal Representations of Human Faces”, Proceedings of the Computer Society Conference on Computer Vision a Pattern Recognition, Seattle, Jun. 21-23, 1994, pp. 70-75, Institute of Electrical Electronics Engineers XP000515823ISBN: 0-8186-5827-4 *Section “2 Tracking Face Regions”* *Section “3.4 Computing basic action cues”*.
Eleftheriadis A Et Al: “Automatic Face Location Detection and Tracking for Model-Assisted Coding of Video Teleconferencing Sequences at Low Bit-Rates” Signal Processing. Image Communication, vol. 7, No. 3, Sep. 1, 1995, pp. 231-248, XP000523869 ISSN: 0923-5965 The Whole Document.
PCT International Search Report our reference PCT 12097PCT Application No. PCT/US99/11316 filing date May 21, 1999.

Affiliated with

Also associated with

Rating

Content-adaptive compression encoding does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Content-adaptive compression encoding, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Content-adaptive compression encoding will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2969330