Data processing: database and file management or data structures – Database design – Data structure types
Reexamination Certificate
2004-07-28
2009-12-01
To, Baoquoc N (Department: 2162)
Data processing: database and file management or data structures
Database design
Data structure types
C707S793000, C707S793000
Reexamination Certificate
active
07627556
ABSTRACT:
A multimedia object retrieval and annotation system integrates an annotation process with object retrieval and relevance feedback processes. The annotation process annotates multimedia objects, such as digital images, with semantically relevant keywords. The annotation process is performed in background, hidden from the user, as the user conducts normal searches. The annotation process is “semi-automatic” in that it utilizes both keyword-based information retrieval and content-based image retrieval techniques to automatically search for multimedia objects, and then encourages users to provide feedback on the retrieved objects. The user identifies objects as either relevant or irrelevant to the query keywords and based on this feedback, the system automatically annotates the objects with semantically relevant keywords and/or updates associations between the keywords and objects. As the retrieval-feedback-annotation cycle is repeated, the annotation coverage and accuracy of future searches continues to improve.
REFERENCES:
patent: 5020019 (1991-05-01), Ogawa
patent: 5572728 (1996-11-01), Tada et al.
patent: 5579471 (1996-11-01), Barber et al.
patent: 5594809 (1997-01-01), Kopec et al.
patent: 5721938 (1998-02-01), Stuckey
patent: 5855015 (1998-12-01), Shoham
patent: 5870754 (1999-02-01), Dimitrova et al.
patent: 5899999 (1999-05-01), De Bonet
patent: 5983237 (1999-11-01), Jain et al.
patent: 5995978 (1999-11-01), Cullen et al.
patent: 6041335 (2000-03-01), Merritt et al.
patent: 6076088 (2000-06-01), Paik et al.
patent: 6092080 (2000-07-01), Gustman
patent: 6105055 (2000-08-01), Pizano et al.
patent: 6285995 (2001-09-01), Abdel-Mottaleb et al.
patent: 6301586 (2001-10-01), Yang et al.
patent: 6314420 (2001-11-01), Lang et al.
patent: 6324545 (2001-11-01), Morag
patent: 6369811 (2002-04-01), Graham et al.
patent: 6408293 (2002-06-01), Aggarwal et al.
patent: 6442538 (2002-08-01), Nojima
patent: 6504571 (2003-01-01), Narayanaswami et al.
patent: 6557042 (2003-04-01), He et al.
patent: 6574632 (2003-06-01), Fox et al.
patent: 6643643 (2003-11-01), Lee et al.
patent: 6728706 (2004-04-01), Aggarwal et al.
patent: 6751613 (2004-06-01), Lee et al.
patent: 6915292 (2005-07-01), Lee et al.
patent: 2002/0069218 (2002-06-01), Sull et al.
patent: 2007/0033170 (2007-02-01), Sull et al.
patent: 2007/0033292 (2007-02-01), Sull et al.
patent: 2007/0033515 (2007-02-01), Sull et al.
patent: 2007/0033521 (2007-02-01), Sull et al.
patent: 2007/0033533 (2007-02-01), Sull
patent: 2007/0038612 (2007-02-01), Sull et al.
patent: 2007/0044010 (2007-02-01), Sull et al.
patent: 07021198 (1995-01-01), None
patent: 11039325 (1999-02-01), None
patent: 2000048041 (2000-02-01), None
patent: 2000112959 (2000-04-01), None
patent: WO0045342 (2000-08-01), None
Atsushi et al. (A flexible content-based image retrieval system with scene discription word), MUltimedia Computing and System p. 201-208, Jun. 17-23, 1996.
Amano et al., “A Flexible Content-Based Image Retrieval System with Combined Scene Description Keyword,” Jun. 17-23, 1996, IEEE Multimedia Computing and System, pp. 201-208.
Lai et al, “PBIR-MM: multimodal image retrieval and annotation,” 2002 ISBN: 1-58113-620-X, pp. 421-422.
Shevade et al., “Vidya: An experiential annotation system,” 2003 ISBN: 1-508113, pp. 91-98.
Japanese Notice of Rejection mailed on Aug. 24, 2007, Japanese Patent App# 2007-169625.
Jing, et al., “Keyword Propagation for Image Retrieval”, at <<http://ieeexplore.ieee.org/search/srchabstract.jsp? arnumber=1329206&isnumber=29377&pu>>, IEEE, 2006, pp. 5.
Kim, et al., “QCluster: Relevance Feedback using Adaptive Clustering for Content-based Image Retrieval”, at <<http:// portal.acm.org/citation.cfm?id=872829&coll=ACM&dl=ACM&CFID=35393061&...>>, ACM, 2003, pp. 17.
Lu, et al., “A Unified Framework for Semantics and Feature Relevance Feedback in Image Retrieval Systems”, at <<http://portal.acm.org/citation.cfm?id=354403&dl=>>, ACM, 2000, pp. 7.
Ozetekin, et al., “Expert Agreement and Content Based Reranking in a Meta Search Environment Using Mearf”, at <<http://portal.acm.org/citation.cfm?id=511490&coll=ACM&dl=ACM&CFID=35392214&...>>>>, ACM, 2002, pp. 17.
Shyu, et al., “A Unified Framework for Image Database Clustering and Content-based Retrieval”, at <<http://portal.acm.org/citation.cfm?id=1032609&coll=ACM&dl=ACM&CFID=35392214&...>>, ACM, 2004, pp. 7.
Zhuang, et al., “Web-based Image Retrieval: a Hybrid Approach”, at <<http://ieeexplore.ieee.org/search/srchabstract.jsp?amumber=934659&isnumber=20228&pu..>>, IEEE, 2006, pp. 10.
Uehara, et al., Miracles : Multimedia Information RetrievAL, Classification, and Exploration System—Application to Web Document Retrieval, Technical Report of the Institute of Electronics, Information and Communication Engineers, Japan, May 2, 2000, vol. 100, No. 31, pp. 17-24.
Official Notice of Rejection for Japanese Patent Application No. 2007-169625, Mailed on Feb. 5, 2008, 7 pgs.
Datta, et al, “Image Retrieval: Ideas, Influences, and Trends of the New Age”, ACM Computing Survey (CSUR), vol. 40, Issue 2, Article 5, Apr. 2008, pp. 5-1-5-60.
Wang, et al, “Automatic Image Annotation and Retrieval Using Weighted Feature Selection”, IEEE Sympossium, Dec. 13-15, 2004, pp. 435-442.
Liu Wen-Yin
Zhang Hong-Jiang
Lee & Hayes PLLC
Microsoft Corporation
To Baoquoc N
LandOfFree
Semi-automatic annotation of multimedia objects does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Semi-automatic annotation of multimedia objects, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Semi-automatic annotation of multimedia objects will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4107378