Image analysis – Color image processing – Image segmentation using color
Reexamination Certificate
2000-03-22
2003-10-07
Mariam, Daniel G. (Department: 2621)
Image analysis
Color image processing
Image segmentation using color
C382S162000, C382S165000, C382S166000, C382S167000, C382S173000, C382S260000, C382S274000, C382S282000, C358S515000, C358S520000, C358S532000, C358S538000
Reexamination Certificate
active
06631206
ABSTRACT:
BACKGROUND OF THE INVENTION
This invention relates to color image processing techniques, and more particularly to a process for filtering the hue component of HSI image data.
Color image processing techniques often are used in image enhancement, video encoding, video editing and computer vision applications. Exemplary techniques include image tracking which relates to the identification of an image object within each a sequence of image frames. Another technique, image segmentation relates to the identification of boundaries and edges of image objects in an image frame.
“HSI” refers to the Hue, Saturation, Intensity color model for presenting color data. There are many different color models (also referred to as color domains or color spaces) developed for the representation and manipulation of color data. Color monitors typically use a Red, Green, Blue (RGB) color model. Color printers typically use a Cyan, Yellow, Magenta (CYM) or a Cyan, Yellow, Magenta, Black (CYMK) color model. Color television broadcast signals typically use a luminance, intensity, color difference (YIQ) color model, where I and Q relate to chrominance.
The Hue Saturation Intensity (HSI) color model closely resembles the color sensing properties of human vision. The intensity component is related to the luminance component decoupled from the color. The hue and saturation components are related to the way in which a human perceives color. Such relation to human vision makes it desirable to use the HSI color model for color image processing techniques, such as image enhancement and image segmentation.
The input image data for color image processing techniques typically is in RGB format. Unfortunately the transformation from RGB to HSI color space and from HSI to RGB color space is very nonlinear and complicated in comparison to the conversion formulas among the other color models. As an example, when an RGB image is degraded by random noise, the nonlinearity in the conversion formulae causes the noise distribution in HSI color space to be nonuniform. Further, the noise distribution in HSI color space depends on the intensity and saturation values of the input data. For example, when the intensity value is small, the noise in the saturation and hue is large. This creates problems in using the HSI color model for image processing techniques, such as image enhancement and image segmentation. Accordingly, there is a need for a method which reduces the magnitude of the noise or the nonuniformity of the noise variance in HSI color space.
SUMMARY OF THE INVENTION
According to the invention, a method for filtering an angular signal avoids errors in averaging and differencing operations.
According to an aspect of this invention, components of an angular signal (e.g. hue) are separated into groups based upon the sign of a corresponding filter coefficient a, for the respective component and the range of the angular (e.g., hue) component value v
i
. In one group, the filter component a
i
is positive and the angular (e.g. hue) component value v
i
is within the range (0, &pgr;). In another group, the filter component a
i
is positive and the angular (e.g. hue) component value v
i
is within the range (&pgr;, 2&pgr;). In yet another group, the filter component a
i
is negative and the angular (e.g. hue) component value v
i
is within the range (0, &pgr;). In still another group, the filter component a
i
is negative and the angular (e.g. hue) component value v
i
is within the range (&pgr;, 2&pgr;). Note that the signal in each group falls into either (0, &pgr;) or (&pgr;, 2&pgr;). Also, the filter coefficients in each group are either all positive or all negative.
According to another aspect of the invention, a weighted mean is computed for each of the groups, resulting in corresponding computed mean values. The range of angular signals is restricted to be either (0, &pgr;) or (&pgr;, 2&pgr;) so that the rounding effects are avoided. Also, the filter coefficients are restricted to being nonnegative to avoid substraction among multiple angular signals.
According to another aspect of the invention, the weighted mean of the resulting values having positive filter coefficients and the weighted mean of the resulting values having negative filter coefficients are derived. The computed value is redefined if needed to be in modulus 2&pgr; (e.g., F
P
=F
P
MOD 2&pgr;).
According to another aspect of the invention, a weighted distance of the two values (weighted mean for values having positive coefficients and the weighted mean for values having negative coefficients) is derived. The result is the filtered hue value for a given image data pixel. A filtered hue value is obtained in the same manner for each image pixel of a desired image object or of a given image frame.
HSI filtering is applied to an image frame of HSI data to reduce and more uniformly distribute noise while preserving image feature edges. In one implementation for a sequence of image frames, such filtering allows for improved image object tracking ability and improved image object segmentation.
According to another aspect of the invention, a method is provided for segmenting an image frame of pixel data, in which the image frame includes a plurality of pixels. For each pixel of the image frame, the corresponding pixel data is converted into hue, saturation, intensity color space. The HSI pixel data then is filtered. Object segmentation then is performed to define a set of filtered HSI pixel data corresponding to the image object. The image frame then is encoded in which pixel data corresponding to the image object is encoded at a higher bit rate than other pixel data.
An advantage of the invention is that image segmentation techniques are performed in HSI color space where color sensing properties more closely resemble human vision. According to another advantage of this invention, object boundaries are preserved while noise level is significantly reduced and the noise variance is made more uniform.
REFERENCES:
patent: 4819077 (1989-04-01), Kikuchi et al.
patent: 5949914 (1999-09-01), Yuen
patent: 5959693 (1999-09-01), Wu et al.
patent: 5995164 (1999-11-01), Tsyrganovich
patent: 6226401 (2001-05-01), Yamafuji et al.
patent: 6229580 (2001-05-01), Inoue
Mital, et al discloses “colour vision for industrial applications”, IEEE, pp. 519-522, 1989.*
Ladley, et al discloses “fundamentals of true-color image processing”, IEEE, pp. 791-795, 1990.*
Lin, et al discloses “color image segmentation using modified HSI system for road following”, IEEE, pp. 1998-2003, 1991.*
Welch, et al discloses “image processing using the HSI color space”, IEEE, pp. 722-725,1991.*
Parsiani discloses “isolated noise detection and reduction in color images”, IEEE, pp. 741-743, 1993.*
Sobottka, et al discloses “segmentation and tracking of faces in color images”, IEEE, pp. 236-241, 1996.*
Sparling, et al discloses “photoelastic analysis using chromatic interpretation of digitized video”, IEEE, pp. 417-418, 1997.*
Terillon, et al discloses “automatic detection of human faces in natural scene images by use of a skin color model and of invariant moments”, IEEE, pp. 112-117,1998.*
Herodotou, et al discloses “a color segmentation scheme for object-based video coding”, IEEE, pp. 25-29,1998.*
Carron et al.; “Color Edge Detector Using Jointly Hue, Saturation and Intensity,” IEEE Publ. 0-8186-6950-0/94 ; 1994.
Gonzalez et al.; “Digital Image Processing,” Addison-Wesley Pub Co.; pp. 228-237; 1992.
Nikolaidis et al.; “Nonlinear Processing and Analysis of Angular Signals,” IEEE Transactions on Signal Processing, vol. 46, No. 12, Dec. 1998.
Perez et al.; “Toward Color Image Segmentation in Analog VLSI: Algorithm and Hardware,” International Journal of Computer Vision, vol. 12:1, 1994.
Nevatia, Ramakant; “A Color Edge Detector and Its Use in Scene Segmentation;” IEEE Transactions on Systems, Man and Cybernetics, vol. SMC-7, No. 11, Nov. 1977.
Papoulis, Athanasios; “Probality, Random Variables, and Stochastic Processes” Third Edition, McGraw-Hill, Inc.; 1991.
Cheng Taiyi
Kim Yongmin
Park Hyun Wook
Koda Steven P.
Mariam Daniel G.
University of Washington
LandOfFree
Image filtering in HSI color space does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Image filtering in HSI color space, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Image filtering in HSI color space will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3121539