Method and system for preventing web crawling detection

Details Method and system for preventing web crawling detection Method and system for preventing web crawling detection

2011-05-31

2011-05-31

Patel, Ashok B (Department: 2491)

Electrical computers and digital processing systems: multicomput

Computer-to-computer session/connection establishing

Session/connection parameter setting

C709S223000, C709S238000, C726S012000, C726S022000, C726S023000, C707S709000

Reexamination Certificate

active

07953868

ABSTRACT:
A method and system for preventing a detection of web crawling. A randomizing HTTP proxy server receives a first request from a web crawler to scan a website and forwards the first request to a randomly selected first proxy computer. The first proxy computer utilizes a first network address translation (NAT)-enabled router to forward the first request to the website. A NAT algorithm associates a first source Internet Protocol (IP) address with the first request. The randomizing HTTP proxy server receives a second web crawler-initiated request to scan the website and forwards the second request to a randomly selected second proxy computer. The second proxy computer utilizes a second NAT-enabled router to forward the second request to the website. The NAT algorithm associates a second source IP address with the second request. The web server identifies the first and second source IP addresses as being different.

REFERENCES:
patent: 5919257 (1999-07-01), Trostle
patent: 6418453 (2002-07-01), Kraft et al.
patent: 6662230 (2003-12-01), Eichstaedt et al.
patent: 7139747 (2006-11-01), Najork
patent: 7286476 (2007-10-01), Helmy et al.
patent: 7516194 (2009-04-01), Lamkins et al.
patent: 7561575 (2009-07-01), Biswas et al.
patent: 7680949 (2010-03-01), Ishiyama et al.
patent: 2002/0059399 (2002-05-01), Learmonth
patent: 2003/0225722 (2003-12-01), Brown et al.
patent: 2003/0227487 (2003-12-01), Hugh
patent: 2005/0021738 (2005-01-01), Goeller et al.
patent: 2005/0021745 (2005-01-01), Bookman et al.
patent: 2005/0071766 (2005-03-01), Brill et al.
patent: 2005/0125412 (2005-06-01), Glover
patent: 2005/0198099 (2005-09-01), Motsinger et al.
Traditional IP Network Address Translator, Network Working Group, Jan. 2001.
Address Allocation for Private Internets. Network Working Group, Cisco Systems, Feb. 1996.

Affiliated with

Also associated with

Rating

Method and system for preventing web crawling detection does not yet have a rating. At this time, there are no reviews or comments for this patent.

If you have personal experience with Method and system for preventing web crawling detection, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Method and system for preventing web crawling detection will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFUS-PAI-O-2659153