Content-based visualization and user-modeling for...

Details Content-based visualization and user-modeling for... Content-based visualization and user-modeling for...

2001-04-20

2004-09-14

Robinson, Greta (Department: 2177)

Data processing: database and file management or data structures

Database design

Data structure types

C707S793000, C707S793000, C382S305000

Reexamination Certificate

active

06792434

ABSTRACT:

FIELD OF THE INVENTION
This invention relates generally to computer-based systems which provide access to multimedia databases, and more particularly to systems that visualize multimedia objects according to media characteristics.
BACKGROUND OF THE INVENTION
Traditional browsing and navigating in a large multimedia database, for example, image, video, or audio databases, is often disorienting unless a user can form a mental picture of the entire database. Content-based visualization can provide an efficient approach for browsing and navigating multimedia databases.
MEDIA FEATURES
Many browsing and retrieval systems are feature based. For example, color, texture and structure for images, color and motion for videos, ceptrum, pitch, zero crossing rate, and temporal trajectories for audio. Color is one of the most widely used features for content-based image/video analysis. It is relatively robust to background complication and independent of image size and orientation. Color histograms are the most commonly used color feature representation. While histograms are useful because they are relatively insensitive to position and orientation changes, they do not capture spatial relationship of color regions, and thus, color histograms have limited discriminating power.
One can also use color moments. There, the color distribution of an image is interpreted as a probability distribution, and the color distribution can be uniquely characterized by its moments. Characterizing a 1-D color distribution with the first three moments of color is more robust and more efficient than working with color histograms.
Texture refers to the visual pattern with properties of homogeneity that do not result from the presence of a single color or intensity. Texture contains important information about the arrangement of surfaces and the relationship of the surfaces to the surrounding environment. Texture can be represented by wavelets by processing an image into a wavelet filter bank to decompose the image into wavelet levels having a number of bands. Each band captures the feature of some scale and orientation of the original image. For each band, the standard deviation of wavelet coefficients can be extracted.
Structure is a more general feature than texture and shape. Structure captures information such as rough object size, structural complexity, loops in edges, etc. Structure does not require an uniform texture region, nor a closed shape contour. Edge-based structure features can be extracted by a so-called “water-filling algorithm,” see X. Zhou, Y. Rui and T. S. Huang, “
Water
-
filling algorithm: A novel way for image feature extraction based on edge maps,”
in Proc. IEEE Intl. Conf. On Image Proc., Japan, 1999, and X. S. Zhou and T. S. Huang, “
Edge
-
based structural feature for content
-
based image retrieval,”
Pattern Recognition Letters, Vol 22/5, April 2001. pp. 457-468.
SUMMARY OF THE INVENTION
The invention visualizes multimedia objects, such as multiple images, on an output devices based on media features such as color, texture, structure, audio ceptrum, textual semantics, or any combination thereof. The vizualization can use the actual objects, or visual icons representing the objects. The resulting arrangement of multimedia objects automatically clusters objects having similar features. An original high-dimensional feature space is reduced to display space, i.e., locations having coordinates x and y, by principle component analysis (PCA).
Furthermore, the invention provides a process that optimizes the display by maximizing visibility, while minimizing deviation from the original locations of the objects. Given the original PCA-based visualization, the constrained non-linear optimization process adjust the location and size of the multimedia objects in order to minimize overlap while maintaining fidelity to the original locations of the objects which are indicative of mutual similarities. Furthermore, the appearance of specific objects in the display can be enhanced using a relevancy score.
More particularly, the invention provides a method for visualizing image objects. The method assigns a feature vector to each image. The feature vector of each image is reduced to a location vector having a dimensionality of a display device. A cost function is evaluated to determine an optimal location vector for each image, and each image is displayed on a display device according to the optimal location vector. The reducing can use principle component analysis.


REFERENCES:
patent: 5839103 (1998-11-01), Mammone et al.
patent: 5915250 (1999-06-01), Jain et al.
patent: 5918223 (1999-06-01), Blum et al.
patent: 5983251 (1999-11-01), Martens et al.
patent: 5987456 (1999-11-01), Ravela et al.
patent: 6173275 (2001-01-01), Caid et al.
patent: 6240423 (2001-05-01), Hirata
patent: 6243492 (2001-06-01), Kamei
patent: 6400846 (2002-06-01), Lin et al.
patent: 6597818 (2003-07-01), Kumar et al.
patent: 6608923 (2003-08-01), Zhang et al.
Hiroike et al., “Visualization of Information Spaces to Retrieve and Browsw Image Data”; Third International Conference on Visual Information Systems, Springer-Verlag, pp. 155-162, 1999.*
Hiroike et al., “Visualization for Similarity-Based Image Retrieval Systems”; pp. 171-176, 1999.
Hiroike et al., “Visualization of Information Spaces to Retrieve and Browse Image Data”; Third International Conference on Visual Information Systems, Springer-Verlag, pp. 155-162, 1999.
Musha et al., “An Interface for Visualizing Feature Space in Image Retrieval”; MVA'98, IAPR Workshop on Machine Vision Applications, 1998, pp. 447-450.
Yossi Rubner, “Perceptual Metrics for Image Database Navigation”; Dissertation submitted to Department of Computer Science of Stanford University, May, 1999.

Affiliated with

Also associated with

Rating

Content-based visualization and user-modeling for... does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Content-based visualization and user-modeling for..., we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Content-based visualization and user-modeling for... will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3262081