Image analysis – Color image processing – Image segmentation using color
Reexamination Certificate
2000-04-25
2004-10-05
Mehta, Bhavesh M. (Department: 2625)
Image analysis
Color image processing
Image segmentation using color
C382S165000, C382S190000, C382S209000, C382S218000, C382S278000, C707S793000, C707S793000
Reexamination Certificate
active
06801657
ABSTRACT:
The present invention relates to a method and apparatus for representing a colour image or a region of an image for searching purposes, and a method and apparatus for searching for colour images or image regions.
Searching techniques based on image content for retrieving still images and video from, for example, multimedia databases are known. Various image features, including colour, texture, edge information, shape and motion, have been used for such techniques. Applications of such techniques include Internet search engines, interactive TV, telemedlcine and teleshopping.
For the purposes of retrieval of images from an image database, images or regions of images are represented by descriptors, including descriptors based on colours within the image. Various different types of colour-based descriptors are known, including the average colour of an image region, statistical moments based on colour variation within an image region, a representative colour, such as the colour that covers the largest area of an image region, and colour histograms, where a histogram is derived for an image region by counting the number of pixels in the region of each of a set of predetermined colours.
A known content-based image retrieval system is QBIC (query by image content) (see U.S. Pat. No. 5,579,471, MPEG document M4582/P165: Colour Descriptors for MPEG-7 by IBM Almaden Research Center). In one of the modes of operation of that system, each image in a database is divided into blocks. Each block is grouped into subsets of similar colours and the largest such subset is selected. The average colour of the selected subset is chosen as the representative colour of the respective block. The representative colour information for the image is stored in the database. A query in the database can be made by selecting a query image. Representative colour information for the query image is derived in the same manner as described above. The query information is then compared with the information for the images stored in the database using an algorithm to locate the closest matches.
MPEG document M4582/P437 and U.S. Pat. No. 5,586,197 disclose a similar approach, but using a more flexible method of dividing an image into blocks and a different method of comparing images. In another variation, described in MPEG document M4582/P576: Colour representation for visual objects, a single value for each of two representative colours per region are used.
Several techniques for representing images based on colour histograms have been developed such as MPEG document M4582/P76: A colour descriptor for MPEG-7: Variable-Bin colour histogram. Other techniques use statistical descriptions of the colour distribution in an image region. For example, MPEG document M4582/P549: Colour Descriptor by using picture information measure of subregions in video sequences discloses a technique whereby an image is divided into high and low entropy regions and colour distribution features are calculated for each type of region. MPEG document M4852/P319: MPEG-7 Colour Descriptor Proposal describes using a mean and a covariance value as descriptors for an image region.
All the approaches described above have important shortcomings. Some of them, in particular colour histogram techniques, are highly accurate, but require relatively large amounts of storage and processing time. Other methods, such as the ones using one or two representative colours, have high storage and computational efficiency but are not precise enough. The statistical descriptors are a compromise between those two types of techniques, but they can suffer from lack of flexibility, especially in case where colours of pixels vary widely within a region.
The present invention provides a method of representing an image by approximating the colour distribution using a number of component distributions, each corresponding to a representative colour in an image region, to derive descriptors of the image region.
The invention also provides a method of searching for images using such descriptors.
The invention also provides a computer program for implementing said methods and a computer-readable medium storing such a computer program. The computer-readable medium may be a separable medium such as a floppy disc or CD-ROM or memory such as RAM.
REFERENCES:
patent: 5579471 (1996-11-01), Barber et al.
patent: 5641596 (1997-06-01), Gray et al.
patent: 5652881 (1997-07-01), Takahashi et al.
patent: 5819288 (1998-10-01), De Bonet
patent: 5852823 (1998-12-01), De Bonet
patent: 5873080 (1999-02-01), Coden et al.
patent: 5899999 (1999-05-01), De Bonet
patent: 5949904 (1999-09-01), Delp
patent: 6026411 (2000-02-01), Delp
patent: 6181818 (2001-01-01), Sato et al.
patent: 6246804 (2001-06-01), Sato et al.
patent: 6335985 (2002-01-01), Sambonsugi et al.
patent: 6345274 (2002-02-01), Zhu et al.
patent: 6373979 (2002-04-01), Wang
patent: 6411953 (2002-06-01), Ganapathy et al.
patent: 6477272 (2002-11-01), Krumm et al.
patent: 0643358 (1995-03-01), None
patent: 0643358 (1995-03-01), None
patent: 0643358 (1995-03-01), None
patent: 0997846 (2000-05-01), None
patent: WO9931605 (1999-06-01), None
D. Androutsos et al., “Vector Angular Distance Measure for Indexing and Retrieval of Color”, vol. 3656, Jan. 1999, pp. 604-613.
Zaher Aghbari et al., “New Indexing Method for Content-Based video Retrieval and Clustering for MPEG Video Database”, Nov. 1997, pp. 140-149.
JP-A-11-096364, Apr. 9, 1999, Abstract only.
SPIE, vol. 2670, pp. 29-40, “Color Indexing with Weak Spatial Constraints,” Markus Stricker et al.
Internal Organisation of Standardisation, ISO/IEC JTC1/SC29/WG11 MPEG99/N2695, Seoul, Mar. 1999, “MPEG-7 Visual par tof eXperimentation Model Version 1.0”.
S1—Proposal Id. P437, Kazuyo Ikeda et al., Canon, Inc., Proposal of MPEG-7 Still Image Description Scheme.
S2—Technical Summary of Color Descriptors for MPEG7 (p. 165-167), IBM Almaden Research Center.
S3—Internal Organization for Standardization, ISO/IEC JTC1/SC29/WG11/MPEG 99/P576 Lancaster, “Color Representation for Visual Objects,” Jan. 31, 1999.
S4—Internal Organization for Standardization, ISO/IEC JTC1/SC29/WG11/P “A Color Descriptor for MPEG-7: Variable Bin Color Histogram”, Feb. 1999.
S5—MPEG 7 Proposals, Kyuheon Kim.
Kassa Yosef
Mehta Bhavesh M.
Mitsubiki Denki Kabushiki Kaisha
LandOfFree
Method and apparatus for representing and searching for... does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Method and apparatus for representing and searching for..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and apparatus for representing and searching for... will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-3313856