Decision-theoretic web-crawling and predicting web-page change

Details Decision-theoretic web-crawling and predicting web-page change Decision-theoretic web-crawling and predicting web-page change

2007-12-18

2007-12-18

Mofiz, Apu (Department: 2161)

Data processing: database and file management or data structures

Database design

Data structure types

C707S793000

Reexamination Certificate

active

10777365

ABSTRACT:
Systems and methods are described that facilitate predictive web-crawling in a computer environment. Aspects of the invention provide for predictive, utility-based, and decision theoretic probability assessments of changes in subsets of web pages, enhancing web-crawling ability and ensuring that web page information is maintained in a fresh state. Additionally, the invention facilitates selective crawling of pages with a high probability of change.

REFERENCES:
patent: 2004/0225644 (2004-11-01), Squillante et al.
J. L. Wolf, et al., Optimal Crawling Strategies for Web Search Engines, WWW2002, May 7-11, 2002, Honolulu, Hawaii.
J L Wolf, et al., “Optimal crawling strategies for web search engines”, 2002, pp. 136-147, Retrieved from the Internet: URL:http://delivery.ac,.org/10.1145/520000/511465/p136-wolf.pdf>.
J Cho, et al., “Effective page refresh policies for Web crawlers”, vol. 28, No. 4, Dec. 2003, pp. 390-426, Retrieved from the Internet: URL:http://delivery.acm.org/10.1145/960000/958945/p390-cho.pdf>.
H Bullot, et al., “A data-mining approach for optimizing performance of an incremental crawler”, Oct. 13, 2003, pp. 610-615.
P Baldi, et al., “Modeling the Internet and the Web: Probabilistic Methods and Algorithms”, Sep. 10, 2003, pp. 149-170, Retrieved from the Internet: URL:http://www3.interscience.wiley.com/cgi-bin/booktext/105057041/BOOKPDFSTART>.
Partial European Search Report mailed Sep. 21, 2006, for European Patent Application Ser. No. EP 05 10 0622, 4 Pages.

Affiliated with

Also associated with

Rating

Decision-theoretic web-crawling and predicting web-page change does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Decision-theoretic web-crawling and predicting web-page change, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Decision-theoretic web-crawling and predicting web-page change will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-3829134