Television – Format conversion – Conversion between standards with different aspect ratios
Reexamination Certificate
1999-04-30
2002-07-16
Lee, Michael H. (Department: 2714)
Television
Format conversion
Conversion between standards with different aspect ratios
Reexamination Certificate
active
06421089
ABSTRACT:
FIELD OF THE INVENTION
The invention relates to a 4/3 to 16/9 TV format conversion process. It also relates to a converter for the implementation of this process.
BACKGROUND OF THE INVENTION
Usual 4/3-to-16/9 TV format conversion can be achieved in different ways.
FIG. 1
a
shows a frame of a virtual scene generated by a 4/3 camera and
FIG. 1
b
one generated by a 16/9 camera.
FIG. 2
illustrates known ways to convert a 4/3 TV format to a 16/9 TV format:
The simplest method consists of keeping the 4/3 format and filling the empty parts of the 16/9 frame by black bands, as shown on
FIG. 2
a.
Another type of methods consists of distorting or cutting the 4/3 source frame in order to obtain a 16/9 frame:
horizontal zoom which horizontally extends the 4/3 frame (
FIG. 2
b
)
zoom and cutting of the high and low parts of the frame (
FIG. 2
c
)
the same zoom, but only the high part of the frame is cut in order to keep the sub-titles (
FIG. 2
d
)
linear zoom, that is the zoom factor varying in the frame; near to 1 on the center, it takes its maximum values near the frame borders (
FIG. 2
e
).
A compromise between these methods may also be used.
A last type of methods aims at creating the missing information on the borders by specific techniques:
duplication of the border rows or lines
mirror effect (
FIG. 2
f
)
padding methods, adapted deformations taking into account the objects edges, fractals . . .
These different methods can be applied either directly on the TV set or before the video broadcasting in a post-production process. It is clear that these techniques do not allow to create the true information, that is the entire frame of the scene filmed by a 16/9 camera, even if they are achieved in post-production.
All theses techniques deteriorate the overall image quality by adding false information (this added information not representing the actual missing part of the image), by suppressing information or by distorting the image when using information intrinsic to the 4/3 format image.
SUMMARY OF THE INVENTION
The object of the invention is to overcome the aforementioned drawbacks.
To this end, the subject of the invention is a format conversion process for a video sequence made up of a succession of frames with a given format to convert these frames into frames with a larger format, characterized in that
it carries out a motion estimation of the current frame relatively to a previous extended view,
it compensates in motion the previous extended view relatively to the current frame,
it updates the previous extended view by taking into account data from the current frame to give an updated extended view becoming the previous extended view for the motion estimation of the next current frame,
it completes the current frame with data from the up-dated extended view to provide the frame with a larger format.
Another subject of the present invention is a format conversion process for a video sequence made up of a succession of frames of a given format to convert these frames into frames with a larger format, characterized in that this conversion is carried out in two passes, one to estimate the motion between successive frames and to built an extended view of the sequence with the frames compensated in motion, the other by positioning each frame of the sequence relatively to the extended view by taking into account the calculated motion and by completing it with extended view data corresponding to the larger format.
According to a particular aspect of the invention, the process is characterized in that the motion estimation is a global motion robust estimation based on an affine modelization of the 2D apparent motion.
According to another particular aspect of the invention, the process is characterized in that the motion estimation is based on the spatio-temporal gradients of the frame luminance.
The invention also relates to a 16/9 television set characterized in that it comprises a converter implementing the format conversion process.
This invention aims at generating a full 16/9 frame from a 4/3 format frame by using an extended view memory built from successive frames of the video plan.
The claimed extended view generation process consists of accumulating successive 4/3 frames and mixing them to produce a bigger one, ideally at the 16/9 format or more. If the camera and the scene background are totally static, this process will produce a final frame with exactly the same size as the 4/3 frame. But as soon as the camera moves (and especially when a panning motion is applied), a larger part of the scene is seen through the successive frames of the video plan, and hence it is possible to produce a larger frame of the scene. If this larger frame is stored in an extended view memory, the 4/3 frame can be completed by this extended view to produce the 16/9 frame of the scene as if it was seen by a 16/9 camera.
Reconstructing the missing parts of the 16/9 frame by using an extended view memory built from successive frames of the video plan allows to get 16/9 frames without distortion or false information, increasing the image quality.
REFERENCES:
patent: 5045939 (1991-09-01), Okayama et al.
patent: 5168362 (1992-12-01), Yoshida
patent: 5218436 (1993-06-01), Sugiyama et al.
patent: 5220423 (1993-06-01), Chikuma
patent: 5243421 (1993-09-01), Nagata et al.
patent: 5262856 (1993-11-01), Lippman et al.
patent: 5287188 (1994-02-01), Saeger et al.
patent: 514 819 (1992-11-01), None
patent: 592 136 (1994-04-01), None
patent: 734 155 (1996-09-01), None
François Edouard
Guillotel Philippe
Vial Jean-François
Kurdyla Ronald H.
Laks Joseph J.
Lee Michael H.
Thomson Licensing S.A.
Tripoli Joseph S.
LandOfFree
Frame format conversion process does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Frame format conversion process, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Frame format conversion process will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2865153