Data processing: database and file management or data structures – Database and file access
Reexamination Certificate
2008-09-09
2011-10-11
Coby, Frantz (Department: 2156)
Data processing: database and file management or data structures
Database and file access
C707S706000, C707S707000, C707S708000, C707S709000, C707S758000, C707S769000, C707S770000
Reexamination Certificate
active
08037043
ABSTRACT:
An information retrieval system is described for retrieving a list of documents such as web pages or other items from a document index in response to a user query. In an embodiment a prediction engine is used to predict both explicit relevance information such as judgment labels and implicit relevance information such as click data. In an embodiment the predicted relevance information is applied to a stored utility function that describes user satisfaction with a search session. This produces utility scores for proposed lists of documents. Using the utility scores one of the lists of documents is selected. In this way different sources of relevance information are combined into a single information retrieval system in a principled and effective manner which gives improved performance.
REFERENCES:
patent: 6507841 (2003-01-01), Riverieulx de Varax
patent: 6662177 (2003-12-01), Martino et al.
patent: 7680752 (2010-03-01), Clune, III et al.
patent: 2004/0267730 (2004-12-01), Dumais et al.
patent: 2005/0125390 (2005-06-01), Hurst-Hiller et al.
patent: 2006/0200460 (2006-09-01), Meyerzon et al.
patent: 2006/0253428 (2006-11-01), Katariya et al.
patent: 2007/0100824 (2007-05-01), Richardson et al.
patent: 2007/0208730 (2007-09-01), Agichtein et al.
patent: 2008/0104045 (2008-05-01), Cohen et al.
patent: 2008/0114751 (2008-05-01), Cramer et al.
patent: 2008/0281809 (2008-11-01), Anderson et al.
patent: 2009/0265341 (2009-10-01), Nordahl
patent: 2009/0327224 (2009-12-01), White et al.
patent: 2009/0327270 (2009-12-01), Teevan et al.
patent: 2010/0083217 (2010-04-01), Dalal et al.
patent: 2010/0169179 (2010-07-01), Ramer et al.
patent: WO2007139610 (2007-12-01), None
Agichtein, et al, “Improving Web Search Ranking by Incorporating User Behavior Information”, retrieved at <<http:// www.mathcs.emory.edu/˜eugene/papers/sigir2006ranking.pdf>>, ACM, 2006, pp, 1-8.
Agrawal, et al, “Diversifying Search Results”, SIGIR, 2008, pp. 1-8.
“An Outline of Generalized Linear Models”, CRC Press, 2nd Edition, 1989, pp. 21-32.
Broder, “A Taxonomy of Web Search”, retrieved at <<http://www.sigir.org/forum/F2002/broder.pdf>>, available at least as early as Jul. 15, 2008, IBM Research, pp. 1-8.
Burges, et al, “Learning to Rank with Nonsmooth Cost Functions”, retrieved at <<http://research.microsoft.com/˜cburges/papers/lambdarank.pdf, NIPS, 2006, pp. 1-8.
Chen, “Probabilistic Models for Retrieving Fewer Relevant Documents”, ACM, 2006, pp. 1-8.
Chu, “Gaussian Processes for Ordinal Regression”, Journal of Machine Learning Research 6, 2005, pp. 1019-1041.
Cox, et al, “The Bayesian Image Retrieval System, PicHunter: Theory, Implementation, and Psychophysical Experiments”, IEEE Transactions on Image Processing, vol. 9, No. 1, Jan. 2000, pp. 20-37.
Fox, et al, “Evaluating Implicit Measures to Improve Web Search”, ACM, vol. 23, No. 2, Apr. 2005, pp. 147-166.
Jarvelin, et al, “IR Evaluation Methods for Retrieving Highly Relevant Documents”, retrieved at <<http://www.info.uta.fi/tutkimus/fire/archive/KJJKSIGIR00.pdf>>, Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2000, pp. 41-48.
Joachims, “Optimizing Search Engines using Clickthrough Data”, ACM, 2002, pp. 1-10.
Joachims, et al, “Search Engines that Learn from Implicit Feedback”, retreived at <<http://ieeexplore.ieee.org/xpls/abs—all.jsp?tp=&arnumber=4292009&isnumber=4291993>>, IEEE, 2007, pp. 34-40.
Lafferty, et al, “Document Language Models, Query Models, and Risk Minimization for Information Retrieval”, ACM, 2001, pp. 1-9.
“Learning Retrieval Functions from Implicit Feedback”, retrieved Jul. 16, 2008 at <<http://www.cs.cornell.edu/People/tj/career/>>, Cornell University, pp. 1-4.
Lim, et al, “Variational Bayesian Approach to Movie Rating Prediction”, ACM, 2007, pp. 1-7.
McCullagh, et al, “An outline of generalized linear models”, Chapter 2, CRC Press, 2nd Edition, 1990.
Minka, “A Family of Algorithms for Approximate Bayesian Inference”, retrieved at <<http://vismod.media.mit.edu/pub/tech-reports/TR-533.pdf>>, Massachusetts Institute of Technology, Jan. 12, 2001, pp. 1-75.
Najork, et al, “Hits on the Web: How Does it Compare?”, retrieved at <<http://research.microsoft.com/˜najork/sigir2007.pdf>>, ACM SIGIR, Jul. 23-27, 2007, pp. 1-8.
Radlinski, et al, “Learning Diverse Rankings with Multi-Armed Bandits”, retrieved at http://icml2008,cs.helsinki.fi/ papers/264.pdf>>, Proceedings of the 25th International Conference on Machine Learning, 2008, pp. 1-8.
Radlinski, et al, “Query Chains: Learning to Rank from Implicit Feedback”, retrieved at <<http://www.cs.cornell.edu/people/tj/publications/radlinski—joachims—05a.pdf>>, ACM, 2005, pp: 1-10.
Robertson, et al, “Simple BM25 Extension to Multiple Weighted Fields”, retrieved at <<http://portal.acm.org/citation.cfm?id=1031181>>, CIKm, 2004, pp. 42-49.
Robertson, “The Probability Ranking Principle in IR”, Journal of Documentation, vol. 33, 1977, pp. 294-304.
Shen, et al, “Context-Sensitive Information Retrieval Using Implicit Feedback”, retrieved at <<http://portal.acm.org/citation.cfm?id=1076045>>, ACM, 2005, pp. 43-50.
Taylor, et al, “SoftRank: Optimizing Non-Smooth Rank Metrics”, ACM 2008, pp. 77-86.
Wong, et al, “Information Retrieval Based on Axiomatic Decision Theory”, Gernal Systems, 1991, Volumen 19(2), 23 (2) pp. 101-117.
Zoeter, et al, “A Decision Theoretic Framework for Implicit Relevance Feedback”, Microsoft Research Cambridge, Dec. 7-8, 2007, pp. 1-12.
Zoeter, “Bayesian Generalized Linear Models in a Terabyte World”, retrieved at <<http://www.ieeexplore.ieee.org/xpl/freeabs—all.jsp?tp=&arnumber=4383733&isnumber=4383645>>, IEEE Conference on Image and Signal Processing and Analysis, 2007, pp. 1-6.
Zoeter, et al, “Gaussian Quadrature Based Expectation Propagation”, retrieved at <<http://eprints.pascal-network.org/archive/00001870/01/zoeter—quadep.pdf>>, available at least as early as Jul. 15, 2008, Faculty of Science, University of Nijmegen, pp. 1-8.
Zoeter, “Slides—A Decision Theoretic Framework for Implicit Relevance Feedback”, NIPS, Dec. 2007, pp. 1-8.
Craswell Nicholas
Guiver John P.
Snelson Edward Lloyd
Szummer Martin
Taylor Michael J.
Coby Frantz
Lee & Hayes PLLC
Microsoft Corporation
LandOfFree
Information retrieval system does not yet have a rating. At this time, there are no reviews or comments for this patent.
If you have personal experience with Information retrieval system, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Information retrieval system will most certainly appreciate the feedback.
Profile ID: LFUS-PAI-O-4273434