Television – Monitoring – testing – or measuring
Reexamination Certificate
1998-06-23
2001-07-10
Peng, John K. (Department: 2714)
Television
Monitoring, testing, or measuring
C348S181000, C348S189000, C348S192000
Reexamination Certificate
active
06259477
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates to the testing of video signals, and more particularly to a joint spatial-temporal alignment of video sequences that aligns a test video signal with a reference video signal for testing video fidelity.
In video processing and/or transmission systems temporal latency and spatial shift may be introduced into the video signal. An example is a video transmission system using MPEG-2 compression for bandwidth reduction and digital bit stream transport. In order to test video signal fidelity of a video processing system, it is necessary to accurately align the signal under test to that of an original reference signal both spatially and temporally. The alignment task includes spatial and temporal shift detection and correction. A video sequence has sampled images equally spaced in time. For interlaced video each sampled image is called a video field.
There are many alignment methods for two-dimensional images, such as the well-known phase correlation method for spatial shift detection, as discussed in “The Phase Correlation Image Alignment Method” by C. D. Kuglin and D. C. Hines, Jr. in the Proceedings of the IEEE 1975 International Conference on Cybernetics and Society, September 1975, pp. 163-165. The phase correlation method is based upon the fact that most of the information about the alignment between two images is contained in the phase of their cross-power spectrum. The discrete phase correlation function is obtained by first computing the discrete two-dimensional Fourier transforms, F1 and F2, of two sampled images, calculating the cross-power spectrum and extracting its phase for each frequency bin. The phase array is calculated by multiplying Fourier transform F1 and the conjugate of F2, and dividing by the magnitude of the product. By performing inverse Fourier transform of the phase array, a phase correlation surface is obtained.
The location of the peak of the phase correlation surface provides information about the amount of the spatial shift between the two images: the height of the peak corresponds to the similarity of the two images. As an example of an ideal case, an image is shifted by a vector translation S, and equation (2) from the Kuglin et al article yields a unit height delta function centered at the location S of the correlation surface. For fractional pixel shift some form of curve fitting around the peak may be used to refine the peak location to fractional pixel precision.
The phase correlation alignment method provides a basic tool for solving the problem of spatial-temporal alignment of video sequences. To detect spatial-temporal shift of the video sequences relative to each other, the ambiguities of spatial shift or temporal shift uncertainties that exist in certain video signals need to be considered. For example temporal shift may not be determined with certainty for static scenes. For video captured by perfect camera panning, the shift may be caused by either temporal or spatial shift. The ambiguity may be resolved only when significant spatial-temporal changes occur in the video sequences.
What is desired is a joint spatial-temporal alignment of video sequences that resolves in a robust way the inherent ambiguities possible in the video sequences.
SUMMARY OF THE INVENTION
Accordingly the present invention provides a joint spatial-temporal alignment of video sequences. Using a well-known phase correlation method for spatial shift a video field is detected where a temporal transition takes place by the sudden drop of correlation peak of the neighboring fields of the reference sequence. Two fields from the reference sequence are selected that straddle the transitional field, which serves as the basis for the joint spatial-temporal alignment detection. A field pair from the test sequence having the same temporal distance as the reference field pair is used to perform spatial alignment against the reference pair. The temporal alignment is found if the spatial shifts for the two pairs are the same and the sum of the correlation peaks exceed a certain minimum. In this way spatial and temporal alignment detection is carried out simultaneously, achieving economy of computation and reduction of ambiguities of spatial versus temporal alignment detection.
The objects, advantages and other novel features of the present invention are apparent from the following detailed description when read in conjunction with the appended claims and attached drawing.
REFERENCES:
patent: 5309376 (1994-05-01), Barraco et al.
patent: 5446492 (1995-08-01), Wolf et al.
patent: 5602586 (1997-02-01), Schauer et al.
patent: 5764284 (1998-06-01), Stoker
patent: 5818520 (1998-10-01), Janko et al.
patent: 5894324 (1999-04-01), Overton
patent: 5940124 (1999-08-01), Janko et al.
Desir Jean W.
Gray Francis I.
Peng John K.
Tektronix Inc.
LandOfFree
Joint spatial-temporal alignment of video sequences does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Joint spatial-temporal alignment of video sequences, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Joint spatial-temporal alignment of video sequences will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2488664