Automatic image annotation using semantic distance learning

Data processing: database and file management or data structures – Database and file access – Preparing data for information retrieval

Reexamination Certificate

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

C707S803000, C382S224000

Reexamination Certificate

active

07890512

ABSTRACT:
Images are automatically annotated using semantic distance learning. Training images are manually annotated and partitioned into semantic clusters. Semantic distance functions (SDFs) are learned for the clusters. The SDF for each cluster is used to compute semantic distance scores between a new image and each image in the cluster. The scores for each cluster are used to generate a ranking list which ranks each image in the cluster according to its semantic distance from the new image. An association probability is estimated for each cluster which specifies the probability of the new image being semantically associated with the cluster. Cluster-specific probabilistic annotations for the new image are generated from the manual annotations for the images in each cluster. The association probabilities and cluster-specific probabilistic annotations for all the clusters are used to generate final annotations for the new image.

REFERENCES:
patent: 7035467 (2006-04-01), Nicponski
patent: 7068309 (2006-06-01), Toyama et al.
patent: 7349895 (2008-03-01), Liu et al.
patent: 2002/0055955 (2002-05-01), Lloyd-Jones et al.
patent: 2004/0205482 (2004-10-01), Basu et al.
patent: 2006/0007315 (2006-01-01), Singh
patent: 2006/0029276 (2006-02-01), Nagahashi et al.
patent: 2006/0173909 (2006-08-01), Carlson et al.
patent: 2007/0083492 (2007-04-01), Hohimer et al.
patent: 2007/0293265 (2007-12-01), Fei et al.
patent: 2008/0021928 (2008-01-01), Yagnik
patent: 2008/0114601 (2008-05-01), Boyle et al.
patent: 2009/0154795 (2009-06-01), Tan et al.
Coherent Image Annotation by Learning Semantic Distance, Tao Mei et al., pp. 1-8, IEEE 2008.
Carneiro, et al., “Formulating Semantic Image Annotation as a Supervised Learning Problem”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005, pp. 1-6.
Jin, et al., “Effective Automatic Image Annotation Via a Coherent Language Model and Active Learning”, Proceedings of the 12th annual ACM international conference on Multimedia, Oct. 10-16, 2004, pp. 892-899.
Monay, et al., “On Image Auto-Annotation with Latent Space Models”, Proceedings of the eleventh ACM international conference on Multimedia, Nov. 2-8, 2003, pp. 275-278.
Glotin, et al., “Fast Image Auto-Annotation with Visual Vector Approximation Clusters”, Workshop CBMI, 2005, 8 pages.
Carneiro, et al., “A Database Centric View of Semantic Image Annotation and Retrieval”, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, Aug. 15-19, 2005, pp. 559-566.
Liu, et al., “An Adaptive Graph Model for Automatic image Annotation”, Proceedings of the 8th ACM international workshop on Multimedia information retrieval, Oct. 26-27, 2006, pp. 61-69.
Ng, et al., “On Spectral Clustering: Analysis and an Algorithm”, Advances in Neural Information Processing Systems (NIPS) 14, 2002, 8 pages.
“Gaussian Mixture Models”, http://www.autonlab.org/tutorials/gmm.html.
S. Towers, “Kernel Probability Density Estimation Methods”, Prepared for Conference on Advanced Statistical Techniques in Partide Physics, Durham, May 18-22, 2002, pp. 107-111.
Barnard, et al., “Matching words and pictures”, Journal of Machine Learning Research, 2003, pp. 1107-1135.
Cortes, et al., “Support-vector networks”, Machine Learning, 1995, 20(3), pp. 273-297.
Datta, et al., “Image retrieval: Ideas, influences, and trends of the new age”, ACM Computing Surveys, vol. 40, No. 2, Article 5, Apr. 2008, pp. 5:1-5:60.
Feng, et al., “Multiple bemoulli relevance models for image and video annotation”, in Proceedings of CVPR, Jun. 2004, pp. 1002-1009.
He, et al., “Generalized manifold ranking based image retrieval”, . IEEE Transaction on Image Processing, 2006, pp. 3170-3177.
Jeon, et al., “Automatic image annotation and retrieval using cross-media relevance models”, In Proceedings of SIGIR, 2003, pp. 119-126.
“Photography image database”, http://www.stat.psu.edu/˜jiali/index.download.html.
Jia Li, “A mutual semantic endorsement approach to image retrieval and context provision”, In Proceedings of ACM international workshop on Multimedia information retrieval, 2005, pp. 173-182.
Li, et al., “Automatic linguistic indexing of pictures by a statistical modeling approach”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, No. 9, Sep. 2003, pp. 1075-1088.
Li, et al., “Image annotation by large-scale content-based image retrieval”, in Proceedings of ACM Multimedia, 2006, pp. 607-610.
Pelleg, et al., “Extending K-means with efficient estimation of the number of clusters”, In Proceedings of International Conference on Machine Learning, 2000, pp. 727-734.
Roth, et al., “Optimal cluster preserving embedding of nonmetric proximity data”, IEEE Trans. on Pattern Analysis and Machine Intelligence, 25(12): 2003, pp. 1540-1551.
Rui, et al., “A search-based web image annotation method”, In Proceedings of ICME, 2007, pp. 655-658.
Smeulders, et al., “Content based image retrieval at the end of the early years”, IEEE Trans. on Pattern Analysis and Machine Intelligence, 2000, pp. 1349-1380.
Wang, et al., “Automatic video annotation by semisupervised learning with kernel density estimation”, In Proceedings of ACM Multimedia, 2006, pp. 967-976.
Wang, et al., “Annosearch: Image autoannotation by search”, In Proceedings of CVPR, 2006, pp. 1483-1490.
Wu, et al., “Formulating context-dependent similarity functions”, Proceedings of ACM Multimedia, 2005, pp. 725-734.
Yang, et al., “Region-based image annotation using asymmetrical support vector machine-based multiple-instance learning”, . In Proceedings of CVPR, 2006, pp. 2057-2063.
Yu, et al., “Toward robust disance metric analysis for similarity estimation”, In Proceedings of CVPR, 2006, pp. 316-322.

LandOfFree

Say what you really think

Search LandOfFree.com for the USA inventors and patents. Rate them and share your experience with other people.

Rating

Automatic image annotation using semantic distance learning does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Automatic image annotation using semantic distance learning, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Automatic image annotation using semantic distance learning will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFUS-PAI-O-2634175

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.