Web Hosting Talk







View Full Version : How to Forbid Bad Bots


gdtechind
11-27-2008, 10:49 AM
How to Forbid Bad Bots

Is there any script which can check if some IP is trying to scrape the website and to put its entry in htaccess file to stop it from getting on server in future.
I have heard about honeypot project, but not aware how it can be used.
Thanks





__________________Link Building Services and SEO. Get Best Prices for Domains - Secure payments via paypal using the Resellerclub interface. Sub Resellers invited.

yah0m
11-27-2008, 12:54 PM
Like blocking scanners? I found this

bager
11-27-2008, 03:17 PM
Check for user agent string. Usually bots don't send or send some weird user agent string. It's not something you should rely on because the string comes from client side and can be changed, but better to have little protection than nothing.

chardonnay
11-30-2008, 02:14 AM
My website is hit daily by the same Albanian spammer who peddles cialis, viagara and sex. Any suggestions on how to block this guy? he registers about 5 times a day with crazy names.

gdtechind
11-30-2008, 02:31 AM
Quote:



Originally Posted by chardonnay


My website is hit daily by the same Albanian spammer who peddles cialis, viagara and sex. Any suggestions on how to block this guy? he registers about 5 times a day with crazy names.


For you, the easy solution is to ban his IP range.





__________________Link Building Services and SEO. Get Best Prices for Domains - Secure payments via paypal using the Resellerclub interface. Sub Resellers invited.

chardonnay
11-30-2008, 02:34 AM
thank you, but user registration has to be activated by an admin, so he never gets a chance to post, thus his IP is not known. but isn't there a place in the cpanel that logs all visitors IP addresses daily?

gdtechind
11-30-2008, 02:41 AM
Quote:



Originally Posted by chardonnay


thank you, but user registration has to be activated by an admin, so he never gets a chance to post, thus his IP is not known. but isn't there a place in the cpanel that logs all visitors IP addresses daily?


check in raw access logs, search for his username (which he signed up with).
And ban his ip using Cpanel or .htaccess file.





__________________Link Building Services and SEO. Get Best Prices for Domains - Secure payments via paypal using the Resellerclub interface. Sub Resellers invited.

csparks
11-30-2008, 11:20 PM
You could setup recaptcha or some other captcha system, that will keep bots from signing up.





__________________
Craig Sparks | Web Developerhttp://www.jexlabs.com

hosting guru
12-01-2008, 02:51 PM
You can block users by forbidding the Internet Protocol adderess,this is generally whats done.
however if you need to block big(Bots) from seeing a particular pag on your website then you can use robots.txt





__________________
Dr.Parastar Web Hosting FAQ Web Hosting Analysis

Carl_Heinz
12-02-2008, 06:32 PM
thanks ...