Web Hosting Talk







View Full Version : What is this spider?


freakysid
03-21-2002, 03:41 AM
Yesterday around 12 noon, I got vigourously spidered by something/someone. My server burst to 680kb/s which, considering it is has low traffic (relative to a server pushing virtual hosting), has really skewed my MRTG graphs of eth0. :stickout

So who the heck is this?

IP: 198.234.197.226
user agent: Mozilla/4.0 (compatible; BorderManager 3.0)

Any clues? :confused:

serve-you
03-21-2002, 04:01 AM
The only BorderManager I know of is a Novell product http://www.novell.com/products/bordermanager/index.html . It could be someone hammering you from behind a proxy.

Edit: Actually, it's probably the proxy spidering your entire network.

-Dan

freakysid
03-21-2002, 05:27 AM
Thanks - yeah I noticed that it was a novell product. Oh well, I guess someone just leached the site for some reason.

serve-you
03-21-2002, 05:30 AM
More than likely someone hit your site a few times, so the proxy decided that it would save the users from having to d/l the data, and grabbed it all to cache.

-Dan