Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
1999-01-27
2003-09-23
Diep, Nhon (Department: 2613)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
C348S699000
Reexamination Certificate
active
06625216
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates to image block matching methods and in particular to a method of matching blocks of pixels between two images which operates in the domain of an orthogonal transform.
Motion estimation a fundamental type of digital video processing. Motion estimation can be found in many digital video applications, for example, video coding, motion compensated video standards conversion and machine vision. Motion information in the context of video coding is useful to reduce signal entropy so that a compressed video signal can be transmitted through a bandwidth-constrained channel. Motion information in the context of video standards conversion helps the converter to recover missing data, spatially and/or temporally, by interpolating the signal along the motion path. Motion information is useful in machine vision applications to allow a robot to find or follow a workpiece through various processing steps. In each of these instances, motion estimation typically uses a pixel-domain block matching (BM) technique and the matching criterion is the minimum mean-square-error (MSE) between the motion block in the current frame and the trial matching blocks in the search frame. The minimum MSE may be replaced by minimum mean absolution difference (MAD) for a more cost-effective hardware implementation.
Pixel-domain BM techniques are well suited to these applications because of their algorithmic simplicity and because they may be implemented using very large scale integrated (VLSI) circuitry. These existing BM techniques may provide less than optimal results, however, because they are based on pixel-domain comparison and because the best match is determined based on the minimum error index (MAD/MSE). It is generally agreed that the pixel-domain MSE (or cross-correlation) measure is not fully consistent with image visual error as perceived by humans. Consequently the error measure currently used in motion estimation requires further modification. In other words, the characteristics of human visual system should be considered during the matching process.
SUMMARY OF THE INVENTION
This invention is embodied in a motion estimation technique that takes human visual characteristics into consideration. The scheme uses transform-domain block matching techniques to achieve more accurate motion vectors than can be achieved using pixel-domain block matching techniques.
According to one aspect of the invention the motion estimation method performs a transform operation on the motion block and on all trial matching blocks. The method then compares the transformed motion block to each of the transformed trial matching blocks and selects, as the matching block, the trial matching block which exhibits the smallest difference with the motion block in the transform domain.
According to another aspect of the invention, the transform operation is a Hadamard transform operation.
According to another aspect of the invention, the method calculates the mean-squared error (MSE) between the transformed motion block and each of the transformed trial matching blocks and selects, as the matching block, the transformed trial matching block having the minimum MSE.
According to another aspect of the invention, the method calculates the mean absolute difference (MAD) between the transformed motion block and each of the transformed trial matching blocks and selects, as the matching block, the transformed trial matching block having the minimum MAD.
According to yet another aspect of the invention, the method allows the size of the motion block to be changed.
REFERENCES:
patent: 5198901 (1993-03-01), Lynch
patent: 5337085 (1994-08-01), Lee et al.
patent: 5347309 (1994-09-01), Takahashi et al.
patent: 5471252 (1995-11-01), Iu
patent: 5475430 (1995-12-01), Hamada et al.
patent: 5544263 (1996-08-01), Iwamura
patent: 5694173 (1997-12-01), Kimura et al.
patent: 5703650 (1997-12-01), Robinson
patent: 5731850 (1998-03-01), Maturi et al.
patent: 5732157 (1998-03-01), Osawa
patent: 5786856 (1998-07-01), Hall et al.
patent: 5815602 (1998-09-01), Ueda et al.
patent: 6128341 (2000-10-01), Kwak
patent: 6205177 (2001-03-01), Girod et al.
patent: 0639925 (1995-02-01), None
patent: 0696002 (1996-02-01), None
Song et al, “Motion Estimation in DCT Domain”, 1996, International Conference On Communication Technology, pp. 670-674.*
Koc et al; “DCT-Based Subpixel Motion Compensation and Fully DCT-Based Video Coder”, 1997 IEEE, pp. 598-601.*
European Search Report, Jul. 3, 2001.
N.M.Nasrabadi et al.; “A New Image Coding Technique Using Transforms Vector Quantization”; Mar. 19-21, 1984, New York, IEEE, US, vol. Conf. 9, 1984, pp. 29901-29904.
Jong-Nam Kim et al., “A Fast Three-Step Search Algorithm With Minimum Checking Points Using Unimodal Error Surface Assumption,” IEEE Transactions on Consumer Electronics, vol. 44, No.. 3, pp. 638-647 (1998).
Diep Nhon
Matsushita Electic Industrial Co. Ltd.
RatnerPrestia
LandOfFree
Motion estimation using orthogonal transform-domain block... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Motion estimation using orthogonal transform-domain block..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Motion estimation using orthogonal transform-domain block... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3071438