Television – Monitoring – testing – or measuring
Reexamination Certificate
1999-03-12
2002-12-10
Miller, John (Department: 2614)
Television
Monitoring, testing, or measuring
C348S184000, C348S192000, C348S438100, C348S455000, C382S167000, C382S162000, C382S254000, C382S260000, C382S272000, C382S286000
Reexamination Certificate
active
06493023
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a method and apparatus for the evaluation of the visual quality of processed digital video sequences. One common form of processing is compression to reduce the bit-rate of digital video. The invention can be used in various applications such as the automatic and continuous monitoring of processing of digital video sequences for transmission as High Definition Television (HDTV) or Direct Broadcast System (DBS) TV. More particularly, the present invention relates to a Digital Video Quality (DVQ) apparatus and method that incorporate a model of human visual sensitivity to predict the visibility of artifacts and the visual quality of processed video.
2. Description of Related Art
Considerable research has been conducted in the field of data compression, especially the compression of digital images. Digital images comprise a rapidly growing segment of the digital information stored and communicated by science, commerce, industry and government. Digital image transmission has gained significant importance in highly advanced television systems, such as high definition television using digital information. Because a relatively large number of digital bits are required to represent digital images, a difficult burden is placed on the infrastructure of the computer communication networks involved with the creation, transmission and re-creation of digital images. For this reason, there is a need to compress digital images to a smaller number of bits, by reducing redundancy and invisible image components of the images themselves.
A system that performs image compression is disclosed in U.S. Pat. No. 5,121,216 of Chen et al. and is incorporated herein by reference. The '216 patent describes a transform coding algorithm for a still image, wherein the image is divided into small blocks of pixels. For example, each block of pixels can be either an 8×8 or 16×16 block. Each block of pixels undergoes a two dimensional transform to produce a two dimensional array of transform coefficients. For still image coding applications, a Discrete Cosine Transform (DCT) is utilized to provide the transform.
In addition to the '216 patent, the DCT is also employed in a number of current and future international standards, concerned with digital image compression, commonly referred to as JPEG and MPEG, which are acronyms for Joint Photographic Experts Group and Moving Pictures Experts Group, respectively. After a block of pixels of the '216 patent undergoes a DCT, the resulting transform coefficients are subject to compression by thresholding and quantization operations. Thresholding involves setting all coefficients whose magnitude is smaller than a threshold value equal to zero, whereas quantization involves scaling a coefficient by step size and rounding off to the nearest integer.
Commonly, the quantization of each DCT coefficient is determined by an entry in a quantization matrix. It is this matrix that is primarily responsible for the perceived image quality and the bit rate of the transmission of the image. The perceived image quality is important because the human visual system can tolerate a certain amount of degradation of an image without being alerted to a noticeable error. Therefore, certain images can be transmitted at a low bit rate, whereas other images cannot tolerate degradation and should be transmitted at a higher bit rate in order to preserve their informational content.
The '216 patent discloses a method for the compression of image information based on human visual sensitivity to quantization errors. In the method of '216 patent, there is a quantization characteristic associated with block to block components of an image. This quantization characteristic is based on a busyness measurement of the image. The method of '216 patent does not compute a complete quantization matrix, but rather a single scaler quantizer.
Recent years have seen the introduction and widespread acceptance of several varieties of digital video. These include digital television broadcasts from satellites (DBS-TV), the US Advanced Television System (ATV), digital movies on a compact disk (DVD), and digital video cassette recorders (DV). Such a trend is expected to continue in the near future and to expand to widespread terrestrial broadcast and cable distribution of digital television systems.
Most of these systems depend upon lossy compression of the video stream. Lossy compression can introduce visible artifacts, and indeed there is an economic incentive to reduce bit rate to the point where artifacts are almost visible. Compounding the problem is the “bursty” nature of digital video, which requires adaptive bit allocation based on visual quality metrics, and the economic need to reduce bit rate to the lowest level that yields acceptable quality.
For this reason, there is an urgent need for a reliable means to automatically evaluate the visibility of compression artifacts, and more generally, the visual quality of processed digital video sequences. Such a means is essential for the evaluation of codecs, for monitoring broadcast transmissions, and for ensuring the most efficient compression of sources and utilization of communication bandwidths.
The following references that are incorporated herein by reference, describe visual quality metrics for evaluating, controlling, and optimizing the quality of compressed still images, and incorporate simplified models of human visual sensitivity to spatial and chromatic visual signals:
A. B. Watson, “Image Data Compression Having Minimum Perceptual Error,” U.S. Pat. No. 5,629,780 (1997).
A. B. Watson, G. Y. Yang, J. A. Solomon, and J. Villasenor, “Visibility of Wavelet Quantization Noise,” IEEE Transactions on Image Processing, 6(8), 1164-1175 (1997).
A. B. Watson, “Perceptual Optimization of DCT Color Quantization Matrices,” IEEE International Conference on Image Processing, 1, 100-104 (1994).
A. B. Watson, “Image Data Compression Having Minimum Perceptual Error,” U.S. Pat. No. 5,426,512 (1995).
It would be desirable to extend the still image metrics described in the foregoing references to cover moving images. Most, if not all video quality metrics are inherently models of human vision. For example, if root-mean-squared-error (RMSE) is used as a quality metric, this amounts to the assumption that the human observer is sensitive to the summed squared deviations between reference and test sequences, and is insensitive to aspects such as the spatial frequency of the deviations, their temporal frequency, or their color. The DVQ metric is an attempt to incorporate many aspects of human visual sensitivity in a simple image processing algorithm. Simplicity is an important goal, since one would like the metric to run in real-time and require only modest computational resources.
A number of video quality metrics have been proposed in the following references:
K. T. Tan, M. Ghanbari, and D. E. Pearson, “A Video Distortion Meter,” Picture Coding Symposium, 119-122 (1997).
T. Hamada, S. Miyaji, and S. Matsumoto, “Picture Quality Assessment System By Three-Layered Bottom-Up Noise Weighting Considering Human Visual Perception,” Society of Motion Picture and Television Engineers, 179-192 (1997).
C. J. v. d. B. Lambrecht, “Color Moving Pictures Quality Metric,” International Conference on Image Processing, I, 885-888 (1996).
A. B. Watson, “Multidimensional Pyramids In Vision And Video,” Representations of Vision: Trends and Tacit Assumptions in Vision Research, A. Gorea, 17-26, Cambridge University Press, Cambridge (1991).
A. B. Watson, “Perceptual-Components Architecture For Digital Video,” Journal of the Optical Society of America A, 7(10), 1943-1954 (1990).
A. A. Webster, C. T. Jones, M. H. Pinson, S. D. Voran, and S. Wolf, “An Objective Video Quality Assessment System Based On Human Perception,” Human Vision, Visual Processing, and Digital Display IV, SPIE Proceedings, 1913, 15-26 (1993).
J. Lubin, “A Human Vision System Model for Objective Picture Quality
Miller John
Natnael Paulos M.
Padilla Robert M.
The United States of America as represented by the Administrator
LandOfFree
Method and apparatus for evaluating the visual quality of... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for evaluating the visual quality of..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for evaluating the visual quality of... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2997200