Television – Format conversion – Changing number of fields for standard conversion
Reexamination Certificate
1998-06-02
2001-01-30
Lee, Michael (Department: 2714)
Television
Format conversion
Changing number of fields for standard conversion
C348S452000, C348S443000
Reexamination Certificate
active
06181382
ABSTRACT:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to video line interpolation, field rate converting and de-interlacing methods and apparatus for converting an interlaced standard video image into a progressive HDTV video image.
2. Description of the Prior Art
Up Converter is an interesting device for broadcasting at HDTV resolution or format an existing standard interlaced video signal into an HDTV video signal. An HDTV Up Converter can be essentially decomposed in three main parts: a field rate converter, a de-interlacer and a picture resizer. The combination of this three modules provide at the output a 60.00 Hz field (interlaced) or frame (progressive) rate having a 16:9 aspect ratio video signal. The major part in an HDTV Up Converter is the de-interlacer unit which converts the incoming interlaced video signal into a progressive video output. This progressive output permits in turn an easy vertical resizing. The present invention focuses on the first two modules of the HDTV up converter, thus providing improved methods and devices for the field rate conversion and for the de-interlacing a video image.
In today's broadcasting industry, more an more video presentations, such as movies and documentaries, must be converted from their original interlaced video format having 59.94 fields per second into the new High Definition Television (HDTV) video format, usually having 60.00 fields per second and a different image aspect rate, 16:9 rather than 4:3 for the standard format. For doing so, a large variety of solution have been proposed, each offering, however, only a partial solution to the problem.
For raising the field frequency of a video image from 59.94 Hz to 60.00 Hz, one new field must be added in each sequence of 1000 existing fields. This is usually done by repeating one video field, which does not give reliable results since the image will remain still for a longer time interval so it will often be perceived by the human eye. The second problem, i.e. de-interlacing a video image, is solved by inserting new video lines among the existing interlaced video lines.
In the patents U.S. Pat. No. 4,677,483 and GB-2,197,152A, fixed spatio-temporal filters are suggested for interpolation. However, this conversion technique introduces some artifacts such as line flicker and serration of diagonal edges. In U.S. Pat. No. 4,636,857, vertical filter and temporal filter are adaptively used according to a motion detector output. In U.S. Pat. No. 4,989,090, the adaptation is done by combining, in a suitable manner, vertical linear filter and temporal median filter results. The shortcomings are the resolution loss for moving parts in the picture, the staircase effect on moving diagonal edges. In U.S. Pat. No. 5,001,563, the interpolator is a spatio-temporal median filter in which the spatial inputs are selected along with estimated edge direction. There are still some defaults with this technique: the given edge detectors are not very reliable for a noisy or high frequency signal. This phenomenon produces some temporal flickers since the adaptation at a given edge can be different from frame to frame. The suggested spatial interpolation yields some resolution loss in the still parts of the picture. The median filter, which is excellent for preserving the edges, can give some unnatural results. In U.S. Pat. No. 5,019,903 and U.S. Pat. No. 5,347,599 the interpolations are edge-based and purely spatial which result in similar defaults caused essentially by the edge detection technique. Moreover, when the number of considered edge direction is small, for example three (3) directions for 45°, 90° and 135°, the staircase effect becomes noticeable for nearly horizontal and long edge in the picture.
The present de-interlacer structure is similar to the one disclosed in U.S. patent application No. 08/916,960 now U.S. Pat. No. 5,936,676 and corresponding CAN patent application # 2,213,606 by the same applicants. However, nearly horizontal edges and new edge direction detection techniques will now be considered.
In the case of field rate converter from 59.94 to 60.00 Hz, the reference literature is very restrictive. Usually frame-repeating technique is used at the end of 1000 incoming fields or when a low motion or a still picture is detected in this time window. Generally, frame repeating can create a noticeable motion discontinuity.
SUMMARY OF THE INVENTION
It is therefore an object of the present invention to provide an up converter apparatus for converting an interlaced video signal into a progressive HDTV video signal. Particularly, the present invention provides an improved video frame frequency converter for converting the lower frequency of an interlaced video signal into a higher frequency of an intermediate video signal which is then de-interlaced by the second device of the invention, namely the de-interlacer.
According to the preferred embodiment of the invention, the apparatus comprises line interpolation means for producing at least one of temporally and spatially interpolated video signals using information from at least one field of the interlaced video input signal. The interpolated signals are suitable for a)-still part of picture, b)-moving horizontal edges and c)-various directions along edge. The apparatus comprises various detection means for the above-mentioned conditions. Particularly, the edge direction detection means are robust for nearly horizontal edges in the presence of noise or in high frequency picture part. The proposed method for edge direction detection is composed in two steps: a)-interpolation in all considered directions and b)-selection of the “best” direction among these interpolation results. The considered directions are chosen in function of the knowledge of human visual system. The apparatus comprises also a resizing means to convert part of 4:3 aspect ratio progressive picture to 16:9 HDTV format which is not presented in the following text since it is well known in the art.
According to another broad aspect of the present invention, there is provided an apparatus for producing, for example, a 60.00 Hz field (frame) rate HDTV format video signal from a 59.94 Hz interlaced video input signal. The apparatus comprises picture deletion and insertion means for deleting appropriately a lower number of incoming frames and inserting a higher number of new frames in order to produce the exact field rate of 60.00 Hz. The two new pictures are preferably not repeated frame but rather interpolated from the incoming signal. The proposed “deleting one-inserting two” technique reduces substantially the motion discontinuity. The apparatus comprises also various detector means for determining subjectively favorable conditions in picture deletion/insertion. In a 50.00 Hz system, picture frame rate converter is not necessary.
An object of an aspect in the present invention is to provide a video de-interlacer in which the degradation of diagonal or nearly horizontal edges, moving or fixed, can be reduced.
An object of an aspect in the present invention is to provide a line interpolation apparatus and method in which the edge direction, nearly horizontal or not, is robust in the presence of noise or in high frequency picture parts.
Another object of an aspect of the invention is to provide a line interpolation apparatus or method in which high resolution in still picture parts is fully preserved.
Yet another object of an aspect of the invention is to provide a line interpolation apparatus and method in which the flicker of vertically moving horizontal edges is reduced.
Yet another object of an aspect of the invention is to provide an efficient field rate converter from 59.94 to 60.00 Hz in which motion discontinuity are subjectively minimized.
According to a broad aspect of the invention, there is provided an apparatus for producing an output HDTV format video component signal from an input interlaced video component signal.
For 60 Hz system, the apparatus comprises a 59.94 Hz to 60.00Hz field rate converter, a line doubler and a
Dinh Chon Tam Le
Kieu Cong Toai
Poirier Daniel
Lee Michael
Miranda Technologies Inc.
LandOfFree
HDTV up converter does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with HDTV up converter, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and HDTV up converter will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2531399