Image analysis – Image enhancement or restoration – Image filter
Reexamination Certificate
1999-02-12
2001-02-20
Rogers, Scott (Department: 2724)
Image analysis
Image enhancement or restoration
Image filter
C382S275000, C348S844000, C348S607000, C348S241000
Reexamination Certificate
active
06192161
ABSTRACT:
FIELD OF THE INVENTION
This invention relates generally to the processing of image, sound or other correlated signals, and more particularly, to a method, apparatus, and article of manufacture for restoring a deteriorated signal to an undeteriorated signal.
BACKGROUND OF THE INVENTION
Conventionally, to restore an image that is deteriorated in image quality it is necessary to analyze the cause of the deterioration, determine a deterioration model function, and apply its inverse function to the deteriorated image. Various causes of deteriorations are possible, such as a uniform movement of a camera (imaging device such as a video camera) and blurring caused by the optical system of a camera. Therefore, in restoring an image, different model functions may be used for respective causes of deteriorations. Unless the cause of deterioration is found, it is difficult to restore a deteriorated image because a model function cannot be determined.
In addition, it is frequently the case that even if a model function of a deterioration is established, there is no inverse function for restoration that corresponds to the model function. In such a case, it is difficult to perform evaluation for determining the optimum model.
Conventionally, error recovery has been achieved by correlation evaluation. For example, some recovery choices have been implemented using a conventional error pixel recovery method.
FIG. 1A
shows a conventional error recovery block diagram. Using neighboring data, which are shown in
FIG. 1B
, spatial inclinations of the target data are detected. In this example, the inclinations regarding four directions are evaluated according to the formulae which are shown in FIG.
1
C. An interpolation filter is chosen where the inclination value, E
i
, is the smallest among four values. In addition to the spatial inclination, a motion factor is also evaluated for error recovery. In the case of the motion area, a selected spatial filter is used for error recovery. On the other hand, the previous frame data at the same location as the target data are used for error recovery. This evaluation is performed in the evaluation block of FIG.
1
A.
The conventional error recovery process shown in
FIGS. 1A-1C
may cause many serious degradations on changing data, especially on object edges. Actual signal distribution typically varies widely, so these problems are likely to occur. Therefore, there is a need for a way to restore a deteriorated signal to an undeteriorated signal which minimizes degradations on changing data.
SUMMARY OF THE INVENTION
The present invention provides a method, apparatus, and article of manufacture for restoring a deteriorated signal to an undeteriorated signal. A deteriorated signal consists of a plurality of deteriorated and undeteriorated data points. For each deteriorated data point, a plurality of class types is created based upon characteristics of the area containing the deteriorated data point. The data point is classified with respect to one of the plurality of class types and assigned a corresponding input signal class. The undeteriorated signal is generated by adaptive filtering of the input signal in accordance with the input signal classification results. More than one classification method may optionally be used to create the plurality of class types. Created classes may include a motion class, an error class, a spatial class or a spatial activity class. An adaptive class tap structure may optionally be used to create the plurality of class types. An adaptive filter tap structure may optionally be used base on the corresponding plurality of class types. Filter tap expansion may optionally be used to reduce the number of filter coefficients. The deteriorated input signal may optionally be modified by preprocessing peripheral erroneous data. A spatial class may optionally be modified according to spatial symmetry.
REFERENCES:
patent: 3311879 (1967-03-01), Daher
patent: 3805232 (1974-04-01), Allen
patent: 4381519 (1983-04-01), Wilkinson et al.
patent: 4419693 (1983-12-01), Wilkinson et al.
patent: 4703351 (1987-10-01), Kondo
patent: 4703352 (1987-10-01), Kondo
patent: 4710811 (1987-12-01), Kondo
patent: 4722003 (1988-01-01), Kondo
patent: 4729021 (1988-03-01), Kondo
patent: 4772947 (1988-09-01), Kondo
patent: 4788589 (1988-11-01), Kondo
patent: 4815078 (1989-03-01), Shimura
patent: 4845560 (1989-07-01), Kondo et al.
patent: 4890161 (1989-12-01), Kondo
patent: 4924310 (1990-05-01), Von Brandt
patent: 4953023 (1990-08-01), Kondo
patent: 4975915 (1990-12-01), Sako et al.
patent: 5023710 (1991-06-01), Kondo et al.
patent: 5122873 (1992-06-01), Golin
patent: 5142537 (1992-08-01), Kutner et al.
patent: 5159452 (1992-10-01), Kinoshita et al.
patent: 5196931 (1993-03-01), Kondo
patent: 5208816 (1993-05-01), Seshardi et al.
patent: 5237424 (1993-08-01), Nishino et al.
patent: 5241381 (1993-08-01), Kondo
patent: 5258835 (1993-11-01), Kato
patent: 5327502 (1994-07-01), Katata et al.
patent: 5359694 (1994-10-01), Concordel
patent: 5379072 (1995-01-01), Kondo
patent: 5398078 (1995-03-01), Masuda et al.
patent: 5416651 (1995-05-01), Uetake et al.
patent: 5416847 (1995-05-01), Boze
patent: 5428403 (1995-06-01), Andrew et al.
patent: 5434716 (1995-07-01), Sugiyama et al.
patent: 5438369 (1995-08-01), Citta et al.
patent: 5469216 (1995-11-01), Takahashi et al.
patent: 5471501 (1995-11-01), Parr et al.
patent: 5481554 (1996-01-01), Kondo
patent: 5481627 (1996-01-01), Kim
patent: 5495298 (1996-02-01), Uchida et al.
patent: 5528608 (1996-06-01), Shimizume
patent: 5598214 (1997-01-01), Kondo et al.
patent: 5617333 (1997-04-01), Oyamada et al.
patent: 5625715 (1997-04-01), Trew et al.
patent: 5663764 (1997-09-01), Kondo et al.
patent: 5703889 (1997-12-01), Shimoda et al.
patent: 5751743 (1998-05-01), Takizawa
patent: 5790195 (1998-08-01), Ohsawa
patent: 5796786 (1998-08-01), Lee
patent: 5805762 (1998-09-01), Boyce et al.
patent: 5852470 (1998-12-01), Kondo et al.
patent: 5946044 (1999-08-01), Kondo et al.
patent: 0 527 611 (1992-08-01), None
patent: 0 558 016 (1993-02-01), None
patent: 0 596 826 (1993-11-01), None
patent: 0 610 587 (1993-12-01), None
patent: 0 680 209 (1995-04-01), None
patent: 0 833 517 (1998-04-01), None
patent: 7-67028 (1995-03-01), None
Kondo, et al., “Adaptive Dynamic Range Coding Scheme for Future HDTV Digital VTR”, Fourth International Workshop on HDTV and Beyond, Sep. 4-6, Turin, Italy.
Kondo, et al., “A New Concealment Method for Digital VCR's”, IEEE Visual Signal Processing and Communication, pp. 20-22, Sep. 1993, Melbourne, Australia.
Park, et al., “A Simple Concealment for ATM Bursty Cell Loss”, IEEE Transactions on Consumer Electronics, No. 3, Aug. 1993, pp. 704-709.
Tom, et al., “Packet Video for Cell Loss Protection Using Deinterleaving and Scrambling”, ICASSP 91: 1991 International Conference on Acoustics, Speech and Signal Processing, vol. 4, pp. 2857-2860, Apr. 1991.
NHK Laboratories Note, “Error Correction, Concealment and Shuffling”, No. 424, Mar. 1994, pp. 29-44.
Translation of Japanese Patent #7-67028, 30 pgs.
Kondo, et al., “Adaptive Dynamic Range Coding Scheme for Future Consumer Digital VTR”, pp. 219-226.
Kim, et al., “Bit Rate Reduction Algorithm for a Digital VCR”, IEEE Transactions on Consumer Electronics, vol. 37, No.3, Aug. 1, 1992, pp. 267-274.
R. C. Gonzalez, et al., “Digital Image Processing”, Addison Wesley Publishing Company, Inc., 1992, pp. 346-348.
R. Aravind, et al., “Image and Video Coding Standards”, AT&T Technical Journal, Jan./Feb. 1993, pp. 67-88.
Zhu, et al., “Coding and Cell-Loss Recovery in DCT-Based Packet Video”, IEEE Transactions on Circuits and Systems for Video Technology, Jun. 3, 1993, No. 3, NY.
International Search Report, PCT/US98/22347, Mar. 16, 1999, 2 pgs.
International Search Report, PCT/US95/22531, Apr. 1, 1999, 1pg.
International Search Report, PCT/US98/22411, Feb. 25, 1999, 1 pg.
International Search Report, PCT/US98/22412, Oct. 5, 1999, 5 pgs.
Japanese Patent No. 05304659 and translation of Abstract.
Japanese Patent No. 05244578 and translation of Abstract.
Japanese Patent No. 053004
Carrig James J.
Fujimori Yasuhiro
Ghosal Sugata
Kondo Tetsujiro
Blakely , Sokoloff, Taylor & Zafman LLP
Rogers Scott
Sony Corporation
LandOfFree
Method and apparatus for adaptive filter tap selection... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for adaptive filter tap selection..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for adaptive filter tap selection... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2611112