Television – Image signal processing circuitry specific to television – Motion vector generation
Reexamination Certificate
1999-11-19
2001-11-13
Kostak, Victor R. (Department: 2611)
Television
Image signal processing circuitry specific to television
Motion vector generation
C348S448000, C348S571000
Reexamination Certificate
active
06317165
ABSTRACT:
FIELD OF THE INVENTION
This invention pertains generally to the field of computer graphics and more particularly to de-interlacing and enhancement of video data for display by digital computer systems.
BACKGROUND OF THE INVENTION
Video data originally developed for television screens must be reformatted before it can be displayed on most computer displays. Television screens typically require data in 2:1 interlaced format, which means a full frame of data is comprised of two spatially and temporally offset fields, typically referred to as odd and even fields. Computer displays typically require non-interlaced data. Displaying video data produced for standard televisions on personal computers therefore generally requires that the video data be converted from an interlaced format to a non-interlaced format.
The two most common conversion techniques are spatial line doubling and field recombining. Spatial line doubling, which is embodied in a technique referred to as “Bob” supported by the Microsoft Corporation, involves taking one field at a time and spatially interpolating to obtain the missing lines, usually by averaging the line above and below each missing one. Field recombining, which is embodied in a technique referred to as “Weave” supported by the Microsoft Corporation, involves interleaving both fields back together to get a spatially complete frame. The former approach (“Bob”) is better suited for video with high motion content but produces a clearly visible loss of resolution for relatively static scenes. The latter technique (“Weave”) is better suited for relatively static scenes but produces highly objectionable artifacts called feathering or ghosting when significant motion is present. Current and past commercially available Personal Computer (PC) systems have generally been unable to determine whether or not a live video source has motion, hence “Bob” is typically used because it produces less objectionable artifacts.
Certain conversion techniques produce much higher quality images by detecting the presence of motion in local areas of each field and using a motion-weighted average of the spatially and temporally interpolated values computed for the missing pixels. When the presence of film converted to video is detected, even higher quality is produced by recombining the appropriate fields. Such techniques produce a much higher quality video output than the Bob or Weave approaches described above.
Such techniques however, have traditionally only been available for the PC user in the form of a standalone display processor box. An example of such a display processor box is the Faroudja LD200 product by Faroudja Incorporated. Such a system operates as a standalone real-time display processor and is independent of the constraints and operating conditions, including timing and bandwidth constraints, of a typical PC graphics subsystem. Its timing, control and programming mechanisms are therefore decoupled from the PC environment. A number of techniques exist to perform processing on the video data to produce line-doubled and enhanced output, but the accompanying programming, and timing and control mechanisms are appropriate for a standalone box and not for an integrated core inside a PC's graphics accelerator.
De-interlacing by line-doubling inherently involves creation of additional data, including at least two continuous streams that are related by a multiple of a base clock. Additional clock rates are required by varying widths, multiplexing and demultiplexing of chroma at different stages, upsampling for enhancement, and downsampling for output to constrained channel. It is typical for traditional standalone video systems like the Faroudja LD 200 to operate continuously on the incoming real-time video, for example 525 lines per frame for NTSC, and use various clocks that are multiples of the base video clock to control the data. This type of mixing of control and clocking is very difficult to handle in the so-called back-end processing (route & place, design for testability, design rules checking) necessary in an integrated core that is part of a complex graphics accelerator ASIC (Application Specific Integrated Circuit). In addition, in such standalone systems there is no provision for non-deterministic arrival of data, as is often the case for PC subsystems that use shared buses, or non-deterministic processing of data downstream when it is merged with other data streams such as graphics. There is also no provision for frame-by-frame interaction that is possible in a PC environment and which adds significant value by providing tighter coupling of the multiple media.
In summary, conventional motion-adaptive video de-interlacing and enhancement modules use isochronous, clock-based controls that are suitable for standalone display processors, but have significant deficiencies in the context of a PC multimedia subsystem, especially if the video processing functions are embedded inside a multimedia controller such as the ViRGE graphics accelerator available from S
3
Incorporated. Typical standalone display processors with de-interlacing and enhancement capability are not designed for tight coupling with a PC system and therefore do not have the mechanisms to facilitate such interaction. Conventional PC video de-interlacing modules use very simple processing which does not pose the kinds of problems or options that a sophisticated motion-adaptive de-interlacing and enhancement module does, hence the simple timing and control mechanisms do not extend to the latter.
SUMMARY OF THE INVENTION
In accordance with a principal object of the present invention, a robust and flexible timing interface is provided to control a set of video streams related by multiples of a base clock, as would typically be produced by a high quality video de-interlacing and enhancing system, in a manner that is optimal for a deep-submicron integrated core suitable for use inside a PC multimedia accelerator, or a video processor integrated circuit (IC) that works in conjunction with a PC multimedia accelerator. In a first aspect of the invention, a video de-interlacing system for receiving interlaced video data at a non-deterministic rate and for generating non-interlaced data as a function of the interlaced video data comprises a plurality of processing units, at least some of the processing units requiring clocking rates that differ from clocking rates required by other processing units. A timing generator responds to a base clock and to a data valid signal, which is indicative of arrival of a portion of the interlaced video data, by causing generation of a plurality of enable signals, each of the enable signals enabling a corresponding one of the clocking rates required by the processing units.
Advantageously, the control mechanism allows processing of streams of video whose instantaneous arrival time is non-deterministic, although the averaged time over a sufficiently large time interval is determined by a real-time video specification such as CCIR
601
as specified by the International Radio Consultative Committee.
In accordance with another object of the invention, passive and active mechanisms are provided for obtaining high quality image capture using a multimedia accelerator that provides de-interlacing and enhancement in accordance with the aforementioned principles. Passive mechanisms refer to specific quantities related to picture quality that are computed and exported to external devices via readable status registers. Active mechanisms refer to programming that can be done on a frame-by-frame basis to influence the quality of the following frame or frames. Video capture embodiments employing such principles advantageously allow capture of high quality frames of video and avoid capture of frames of video that may include the presence of significant motion, and therefore appear blurry, or that occur at a scene change, or that occur at a bad edit point in the video. Such frames may go unnoticed when viewing the moving video but may be undesirable when viewed in a captured, still ima
Balram Nikhil
Filor Lutz
Ishii Takatoshi
Li Qiang
Tong Sai-Kit
Carr & Ferrell LLP
Kostak Victor R.
S3 Graphics Co., Ltd.
LandOfFree
System and method for selective capture of video frames does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with System and method for selective capture of video frames, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and System and method for selective capture of video frames will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2612049