Image analysis – Image enhancement or restoration
Reexamination Certificate
1999-09-24
2003-02-18
Lee, Thomas D. (Department: 2724)
Image analysis
Image enhancement or restoration
C382S260000, C382S236000, C348S402100, C348S413100, C348S416100
Reexamination Certificate
active
06522785
ABSTRACT:
FIELD OF THE INVENTION
This invention relates generally to the processing of image, sound or other correlated signals, and more particularly, to a method, apparatus, and article of manufacture for restoring a deteriorated signal to an undeteriorated signal.
BACKGROUND OF THE INVENTION
Conventionally, to restore an image that is deteriorated in image quality it is necessary to analyze the cause of the deterioration, determine a deterioration model function, and apply its inverse function to the deteriorated image. Various causes of deteriorations are possible, such as a uniform movement of a camera (imaging device such as a video camera) and blurring caused by the optical system of a camera. Therefore, in restoring an image, different model functions may be used for respective causes of deteriorations. Unless the cause of deterioration is found, it is difficult to restore a deteriorated image because a model function cannot be determined.
In addition, it is frequently the case that even if a model function of a deterioration is established, there is no inverse function for restoration that corresponds to the model function. In such a case, it is difficult to perform evaluation for determining the optimum model.
Conventionally, error recovery has been achieved by correlation evaluation. For example, some recovery choices have been implemented using a conventional error pixel recovery method.
FIG. 1A
shows a conventional error recovery block diagram. Using neighboring data, which are shown in
FIG. 1B
, spatial inclinations of the target data are detected. In this example, the inclinations regarding four directions are evaluated according to the formulae which are shown in FIG.
1
C. An interpolation filter is chosen where the inclination value, E
i
, is the smallest among four values. In addition to the spatial inclination, a motion factor is also evaluated for error recovery. In the case of the motion area, a selected spatial filter is used for error recovery. On the other hand, the previous frame data at the same location as the target data are used for error recovery. This evaluation is performed in the evaluation block of FIG.
1
A.
The conventional error recovery process shown in
FIGS. 1A-1C
may cause many serious degradations on changing data, especially on object edges. Actual signal distribution typically varies widely, so these problems are likely to occur. Therefore, there is a need for a way to restore a deteriorated signal to an undeteriorated signal which minimizes degradations on changing data.
SUMMARY OF THE INVENTION
The present invention provides a method, apparatus, and article of manufacture for restoring a deteriorated signal to an undeteriorated signal. A deteriorated signal consists of a plurality of deteriorated and undeteriorated data points. For each deteriorated data point, a plurality of class types is created based upon characteristics of the area containing the deteriorated data point. The data point is classified with respect to one of the plurality of class types and assigned a corresponding input signal class. The undeteriorated signal is generated by adaptive filtering of the input signal in accordance with the input signal classification results. More than one classification method may optionally be used to create the plurality of class types. Created classes may include a motion class, an error class, a spatial class or a spatial activity class. An adaptive class tap structure may optionally be used to create the plurality of class types. An adaptive filter tap structure may optionally be used base on the corresponding plurality of class types. Filter tap expansion may optionally be used to reduce the number of filter coefficients. The deteriorated input signal is modified by preprocessing peripheral erroneous data. A spatial class may optionally be modified according to spatial symmetry.
REFERENCES:
patent: 3311879 (1967-03-01), Daher
patent: 3805232 (1974-04-01), Allen
patent: 4361853 (1982-11-01), Remy et al.
patent: 4381519 (1983-04-01), Wilkinson et al.
patent: 4419693 (1983-12-01), Wilkinson et al.
patent: 4438438 (1984-03-01), Arens et al.
patent: 4532628 (1985-07-01), Matthews
patent: 4574393 (1986-03-01), Blackwell et al.
patent: 4586082 (1986-04-01), Wilkinson
patent: 4656514 (1987-04-01), Wilkinson et al.
patent: 4675735 (1987-06-01), Wilkinson et al.
patent: 4703351 (1987-10-01), Kondo
patent: 4703352 (1987-10-01), Kondo
patent: 4710811 (1987-12-01), Kondo
patent: 4722003 (1988-01-01), Kondo
patent: 4729021 (1988-03-01), Kondo
patent: 4772947 (1988-09-01), Kondo
patent: 4788589 (1988-11-01), Kondo
patent: 4807033 (1989-02-01), Keesen et al.
patent: 4815078 (1989-03-01), Shimura
patent: 4845560 (1989-07-01), Kondo et al.
patent: 4890161 (1989-12-01), Kondo
patent: 4924310 (1990-05-01), Von Brandt
patent: 4953023 (1990-08-01), Kondo
patent: 4975915 (1990-12-01), Sako et al.
patent: 4979040 (1990-12-01), Masumoto
patent: 5023710 (1991-06-01), Kondo et al.
patent: 5043810 (1991-08-01), Vreeswijk et al.
patent: 5086489 (1992-02-01), Shimura
patent: 5093872 (1992-03-01), Tutt
patent: 5101446 (1992-03-01), Resnikoff et al.
patent: 5122873 (1992-06-01), Golin
patent: 5134479 (1992-07-01), Ohishi
patent: 5142537 (1992-08-01), Kutner et al.
patent: 5150210 (1992-09-01), Hoshi et al.
patent: 5159452 (1992-10-01), Kinoshita et al.
patent: 5166987 (1992-11-01), Kageyama
patent: 5177797 (1993-01-01), Takenaka et al.
patent: 5185746 (1993-02-01), Tanaka et al.
patent: 5196931 (1993-03-01), Kondo
patent: 5208816 (1993-05-01), Seshardi et al.
patent: 5237424 (1993-08-01), Nishino et al.
patent: 5238318 (1993-08-01), Araki
patent: 5241381 (1993-08-01), Kondo
patent: 5243428 (1993-09-01), Challapali et al.
patent: 5247363 (1993-09-01), Sun et al.
patent: 5258835 (1993-11-01), Kato
patent: 5307175 (1994-04-01), Seachman
patent: 5327502 (1994-07-01), Katata et al.
patent: 5337087 (1994-08-01), Mishima
patent: 5359694 (1994-10-01), Concordel
patent: 5379072 (1995-01-01), Kondo
patent: 5398078 (1995-03-01), Masuda et al.
patent: 5400076 (1995-03-01), Iwamura
patent: 5406334 (1995-04-01), Kondo et al.
patent: 5416651 (1995-05-01), Uetake et al.
patent: 5416847 (1995-05-01), Boze
patent: 5428403 (1995-06-01), Andrew et al.
patent: 5434716 (1995-07-01), Sugiyama et al.
patent: 5438369 (1995-08-01), Citta et al.
patent: 5446456 (1995-08-01), Seo
patent: 5455629 (1995-10-01), Sun et al.
patent: 5469216 (1995-11-01), Takahashi et al.
patent: 5469474 (1995-11-01), Kitabatake
patent: 5471501 (1995-11-01), Parr et al.
patent: 5473479 (1995-12-01), Takahura
patent: 5481554 (1996-01-01), Kondo
patent: 5481627 (1996-01-01), Kim
patent: 5495298 (1996-02-01), Uchida et al.
patent: 5499057 (1996-03-01), Kondo et al.
patent: 5528608 (1996-06-01), Shimizume
patent: 5546130 (1996-08-01), Hackett et al.
patent: 5557420 (1996-09-01), Yanagihara et al.
patent: 5557479 (1996-09-01), Yanagihara
patent: 5568196 (1996-10-01), Hamada et al.
patent: 5577053 (1996-11-01), Dent
patent: 5579051 (1996-11-01), Murakami et al.
patent: 5594807 (1997-01-01), Liu
patent: 5598214 (1997-01-01), Kondo et al.
patent: 5617135 (1997-04-01), Noda et al.
patent: 5617333 (1997-04-01), Oyamada et al.
patent: 5625715 (1997-04-01), Trew et al.
patent: 5636316 (1997-06-01), Oku et al.
patent: 5649053 (1997-07-01), Kim
patent: 5663764 (1997-09-01), Kondo et al.
patent: 5673357 (1997-09-01), Shima
patent: 5677734 (1997-10-01), Oikawa et al.
patent: 5689302 (1997-11-01), Jones
patent: 5699475 (1997-12-01), Oguro et al.
patent: 5703889 (1997-12-01), Shimoda et al.
patent: 5724099 (1998-03-01), Hamdi et al.
patent: 5724396 (1998-03-01), Brailean et al.
patent: 5737022 (1998-04-01), Yamaguchi et al.
patent: 5751361 (1998-05-01), Kim
patent: 5751743 (1998-05-01), Takazawa
patent: 5751862 (1998-05-01), Williams et al.
patent: 5778097 (1998-07-01), Nikerson
patent: 5786857 (1998-07-01), Yamaguchi
patent: 5790195 (1998-08-01), Ohsawa
patent: 5796786 (1998-08-01), Lee
patent: 5805762 (1998-09-01), Boyce et al.
patent: 5809041 (1998-09-01), Shikakura et al.
patent: 5809231 (1998-09-01), Yokoyama et al.
paten
Carey William Knox
Carrig James J.
Fujimori Yasuhiro
Kondo Tetsujiro
Lee Thomas D.
Sony Corporation
LandOfFree
Classified adaptive error recovery method and apparatus does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Classified adaptive error recovery method and apparatus, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Classified adaptive error recovery method and apparatus will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3140842