Data processing: database and file management or data structures – Database design – Data structure types
Reexamination Certificate
2005-09-21
2008-11-25
Ly, Cheyne D (Department: 2168)
Data processing: database and file management or data structures
Database design
Data structure types
Reexamination Certificate
active
07457825
ABSTRACT:
A method and system for generating a search request from a multimodal query that includes a query image and query text is provided. The multimodal query system identifies images of a collection that are textually related to the query image based on similarity between words associated with each image and the query text. The multimodal query system then selects those images of the identified images that are visually related to the query image. The multimodal query system may formulate a search request based on keywords of web pages that contain the selected images and submit that search request to a search engine service.
REFERENCES:
patent: 5873080 (1999-02-01), Coden et al.
patent: 2002/0168117 (2002-11-01), Lee et al.
patent: 2006/0218192 (2006-09-01), Gopalakrishnan
Chang et al., IEEE Multimedia, vol. 4, Issue 3, Jul. 1997, pp. 12-20.
Muneesawang et al., Advances in multimedia information processing, PCM 2004, Oct. 29, 2004, pp. 642-649.
Srihari et al., information Retrieval, vol. 2, 2000, pp. 245-275.
Goh et al., MM'04, Oct. 10-16, 2004, New York, New York, pp. 564-571.
Bodner, Richard C. and Song, Fei, “Knowledge-Based Approaches to Query Expansion in Information Retrieval,” Advances of Artificial Intelligence (pp. 146-158), 1996, New York Springer, 14 pages.
Carson, Chad, Belongie, Serge, Greenspan, Hayit, Malik, Jitendra, “Blobworld: Image Segmentation Using Expectation-Maximization and its Application to Image Querying,” IEEE Trans. on PAMI, vol. 24, No. 8, 2002 (16 pages).
Chang, Edward, Li, Chen, Wang, James, Mork, Peter, Wiederhold, Gio, “Searching Near-Replicas of Images Via Clustering,” Proceedings of SPIE Multimedia Storage and Archiving System VI, vol. 3846, Boston Sep. 1999 (17 pages).
Flickner, Myron, Sawhney, Harprett, Niblack, Wayne, Ashley, Jonathan, Huang, Qian, Dom, Byron, Gorkani, Monika, Hafner, Jim, Lee, Denis, Petkovic, Dragutin, Steele, David, Yanker, Peter, “Query by Image and Video Content: The QBIC System,” IEEE Computer Special Issue on Content-Based Retrieval, vol. 28, No. 9, Sep. 1995 (10 pages).
Hare, Jonathon S., and Lewis, Paul H., “Content-Based Image Retrieval Using a Mobile Device as a Novel Interface,” In Proc. of SPIE Storage and Retrieval Methods and Applications for Multimedia 2005, vol. 5682, Jan. 2005 (12 pages).
Jaimes, Alejandro, Chang, Shih-Fu, Loui, Alexander C., “Detection of Non-Identical Duplicate Consumer Photographs,” in Proceedings of the Fourth Pacific Rim Conference on Multimedia; vol. 1, Singapore, Dec. 2003 (4 pages).
Ke, Yan, Sukthankar, Rahul, Huston, Larry, “Efficient Near-Duplicate Detection and Sub-Image Retrieval,” In Proc. of ACM Multimedia, Nov. 2004 (7 pages).
Kim, Changick, “Content-Based Image Copy Detection,” Signal Processing: Image Communication, vol. 18, No. 3, Mar. 2003 (16 pages).
Miller, George A., “WordNet: A Lexical Database for English,” Communications of the ACM, vol. 38, No. 11, Nov. 1995 (3 pages).
Noda, Makiko, Sonobe, Hirotaka, Takagi, Saeko, Yoshimoto, Fujiichi, “Cosmos: Convenient Image Retrieval System of Flowers for Mobile Computing Situations,” Proceedings of the IASTED Conference on Information Systems and Databases, Tokyo, Japan, Sep. 2002 (6 pages).
Obdrzalek, Stepan and Matas, Jiri, “Image Retrieval Using Local Compact DCT-Based Representation,” In Proceedings of the 25th DAGM Pattern Recognition Symposium 2003, Germany, Sep. 2003 (8 pages).
Sebe, N., Tian, Q., Loupias, E., Lew, M., Huang, T., “Evaluation of Salient Point Techniques,” Image and Vision Computing, vol. 21, 2003 (10 pages).
Sivic, Josef and Zisserman, Andrew, “Video Google: A Text Retrieval Approach to Object Matching in Videos,” Proceedings of the Ninth IEEE International Conference on Computer Vision, Oct. 2003 (8 pages).
Smith, John, R., and Chang, Shih-Fu, “VisualSEEk: A Fully Automated Content-Based Image Query System,” In Proceedings of ACM Multimedia, Boston, Nov. 1996 (12 pages).
Sonobe, Hirotaka, Takagi, Saeko and Yoshimoto, Fujichi, “Mobile Computing System for Fish Image Retrieval,” Proceedings of International Workshop on Advanced Image Technology, Singapore, Jan. 2004 (6 pages).
Vorhees, Ellen M., “Query Explansion Using Lexical-Semantic Relations,” Proceedings of the 17th Annual ACM SIGIR Conference, Dublin, Ireland, 1994 (9 pages).
Wang, James Ze, Wiederhold, Gio, Firschein, Oscar, Wei, Sha Xin, “Content-Based Image Indexing and Searching Using Daubechies' Wavelets,” International Journal on Digital Libraries, vol. 1, No. 4, Springer-Verlag 1998 (18 pages).
Yeh, Tom, Tollmar, Konrad, Darrell, Trevor, “Searching the Web with Mobile Images for Location Recognition,” Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04), 2004 (6 pages).
Yeh, Tom, Grauman, Kristen, Tollmar, Konrad and Darrell, Trevor, “A Picture is Worth a Thousand Keywords: Image-Based Object Search of a Mobile Platform,”Proceedings of CHI 2005, Portland, Apr. 2004 (4 pages).
Chen, Zheng, Wenyin, Liu, Hu, Chunhui, Li, Mingjing, Zhang, Hongjiang, “iFind: A Web Image Search Engine,” SIGIR'01, Sep. 9-12, 2001, ACM (1 page).
W3C Architecture Domain, “Document Object Model (DOM),” Jan. 19, 2005, Copyright 1997-2005 W3C, 3 pages (Accessed Aug. 5, 2005).
Google, “Google Short Message Service (SMS),” Copyright 2005 Google, 1 page(Accessed Nov. 11, 2005).
Yahoo!Mobile, Copyright 2005 Yahoo! (Accessed Nov. 11, 2005) (1 page) http://mobile.yahoo.com/.
Tae-Gyu, Kim; “Camera Phones to Get 99% of Local Market in 2005,” The Korea Times, Nov. 22, 2004 (2 pages).
Google Mobile Search, 2005 Google, [Accessed Nov. 9, 2005], (1 page) http://www.google.com/xhtml/help?hl=en&lr=&ie=UTF-8.
Porter, M.F., “An algorithm for suffix stripping,” Program, vol. 14, No. 3, 1980, 7 pages.
Fan Xin
Li Ming Jing
Li Zhiwei
Ma Wei-Ying
Xie Xing
Ly Cheyne D
Microsoft Corporation
Perkins Coie LLP
LandOfFree
Generating search requests from multimodal queries does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Generating search requests from multimodal queries, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Generating search requests from multimodal queries will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4023853