Pulse or digital communications – Bandwidth reduction or expansion – Television or motion video signal
Reexamination Certificate
1998-10-22
2002-02-19
Rao, Andy (Department: 2713)
Pulse or digital communications
Bandwidth reduction or expansion
Television or motion video signal
C348S699000, C348S700000
Reexamination Certificate
active
06349113
ABSTRACT:
BACKGROUND OF THE INVENTION
The present invention relates generally to the processing of video image sequences. More specifically, the present invention relates to the detection of moving cast shadows within video image sequences so that object segmentation can be performed.
Shadows occur in a wide variety of scenes, including a wide variety of scenes in sequential video images. If shadows are identified in video images, they can provide a great deal of information about the shape, relative position, and surface characteristics of objects in a scene. Although humans can easily distinguish shadows from objects, identifying shadows by computers is more difficult. For example, identifying shadows by computers involves object segmentation, the separation of an object, its shadow and the background which can have stationary portions and moving portions.
Identifying shadows by computers is even more difficult with cast shadows that are moving from one video image to the next video image. Known methods and systems have been developed to attempt to detect moving cast shadows. For example, one known method performs shadow detection with a static camera providing the image by subdividing an image into blocks and computing the luminance contrast for each block; blocks are identified as moving cast shadows where the luminance contrast changes from pixel to pixel within a block. See Skiftstad, K. and Jain, R., “Illumination Independent Change Detection for Real World Image Sequences,” Computer Vision, Graphics, and Image Processing 46, 387-99 (1989).
This known method, however, suffers from shortcomings. Specifically, it cannot distinguish a moving cast shadow from a moving object where the object lacks texture, i.e., lacks sharp contrast within the object.
SUMMARY OF THE INVENTION
An image region changed by a moving cast shadow from a first image to a second image is detected. For each pixel within a change detection mask (a binary mask indicating image areas of difference between the first image and the second image) and a set of neighboring pixels, the following steps are performed. Whether the pixel and the set of neighboring pixels include a static background edge or no edge is determined. Whether the pixel and the set of neighboring pixels include an edge with a spatial signal step width greater than a threshold is determined. Whether the pixel and the set of neighboring pixels have a uniform temporal change of illumination is determined. The pixel is classified as being changed by a moving cast shadow when at least two of the above-mentioned determinations succeed for the pixel or when at least one determination from the above-mentioned determinations succeeds for a majority of the set of neighboring pixels.
In another embodiment of the present invention, detected image regions are used to estimate the two-dimensional shape of moving objects in image sequences even in the presence of moving cast shadows. In another embodiment, detected image regions are temporarily integrated to represent the total of moving cast shadows.
REFERENCES:
patent: 5481628 (1996-01-01), Ghaderi
patent: 5557684 (1996-09-01), Wang et al.
patent: 5631976 (1997-05-01), Bolle et al.
patent: 5832115 (1998-11-01), Rosenberg
patent: 5940538 (1999-08-01), Spiegel et al.
patent: 6026183 (2000-02-01), Talluri et al.
patent: 6069918 (2000-05-01), Meyer et al.
patent: 6075875 (2000-06-01), Gu
Marciej Orkisz, “Moving Objects Locations in Complex Scenes Filmed by a Fixed Camera”, vol. 9, No. 4, Sep. 1992, pp. 325-346.
Hyung-Il Choi et al., “Motion Interpretation by Analyzing Difference Images”, Journal of Systems Architecture, Elsevier Science B.V., Mar. 1, 1997, pp. 307-316.
P. Stelmaszyk et al, “Dynamic Scenes Analysis by Moving Edges Detection”, 1985, pp. 1181-1193.
Image Segmentation Based on Object Oriented Mapping Parameter Estimation, Michael Hötter and Robert Thomas, Signal Processing 15 (1988), p. 315-334.
Illumination Independent Change Detection for Real World Image Sequences, K. Skifstad and R. Jain, Computer Vision, Graphics, and Image Processing, pp. 387-399, vol. 46, No. 3, Jun. 1989.
Shadow Segmentation and Classification in a Constrained Environment C. Jiang and M. Ward, Image Understanding, pp. 213-225, vol. 59, No. 2, Mar. 1994.
Image Segmentation Based on Object Oriented Mapping Parameter Estimation, M. Hötter and R. Thoma, Signal Processing, pp. 315-334, vol. 15, No. 3, Oct. 1988.
Mech Roland
Ostermann Joern
Stauder Jurgen
AT&T Corp.
Kenyon & Kenyon
Rao Andy
LandOfFree
Method for detecting moving cast shadows object segmentation does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method for detecting moving cast shadows object segmentation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method for detecting moving cast shadows object segmentation will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-2948215