Results 1 to 4 of 4
Thread: Robots flood my server...
-
07-26-2009, 10:28 PM #1WHT Addict
- Join Date
- Dec 2006
- Posts
- 131
Robots flood my server...
Hey guys,
I use Outpost Firewall to view active connections to my server. If I don't restart the httpd service on a regular basis my server will grind to a halt from being flooded by robots.
I currently have the service set up to restart at Midnight and Noon every day. Sometimes that's enough, lately it's not. For example, I checked an hour ago and I had 385 connections to httpd. At least 50% of the connections were robots - tons of the same IP addresses and they're just crawling the site.
Almost all of the connections show up as less than 1kb bytes received and 0 bytes sent per connection.
I already have a good 20 connections by these robots and the connection time shows as 11 minutes... I just browsed to a web gallery page on my site figuring that'd be mildly "intensive" on connections with all the thumbnails and my connections aren't lasting more than one minute.
So, what's with all these connections that are lasting 10+ minutes? I've even got one connection that has an Uptime of 30 minutes, bytes sent 65811, bytes received 180. It seems like something with these robots doesn't terminate correctly...
Any ideas on what to do so these connections quit jamming my server up? It's like a very very slow DOS...Windows 2008 R2 SP1 x64
Core2Quad Q9650; 8GB ddr2
-
07-26-2009, 11:16 PM #2******* Unleaded
- Join Date
- Feb 2004
- Posts
- 3,849
apache?
search on slowlorisedgedirector.com
managed dns global failover and load balance (gslb)
exactstate.com
uptime report for webhostingtalk.com
-
07-27-2009, 02:14 AM #3PING PONG
- Join Date
- May 2009
- Location
- SLASH ROOT
- Posts
- 867
May I know your OS and webserver used?
█ WebHostRepo.com
█ Linux | Windows | VPS | Cloud
█ Outsourced Technical Support since 2009
█ sales@webhostrepo.com
-
07-27-2009, 08:09 AM #4WHT Addict
- Join Date
- Dec 2006
- Posts
- 131
Similar Threads
-
Directing Robots With Robots.txt
By Nullified in forum Web Design and ContentReplies: 0Last Post: 02-27-2005, 12:12 PM -
How can Hacker Flood the server?
By learnerman in forum Hosting Security and TechnologyReplies: 2Last Post: 01-20-2005, 08:09 PM -
Server Matrix aka TP / Flood Gaurd
By sysc in forum Dedicated ServerReplies: 13Last Post: 09-12-2004, 03:40 AM -
How do you Manage Robots Flood
By Imago in forum Dedicated ServerReplies: 0Last Post: 03-19-2004, 06:03 AM -
1 basic Flood script and server down !
By blackmoont in forum Hosting Security and TechnologyReplies: 6Last Post: 07-30-2003, 02:47 PM