Web Hosting Talk







View Full Version : Google is crashing my servers... time to ban it?


realvaluehosting
06-05-2006, 07:18 AM
I run a webmaster discussion forums and for last 2 months I have started getting too much traffic from Google that can't be handled a single dedicated server. It looks that I am on the top on Google SERPs for almost all the popular keywords, therefore, I am getting this much of traffic. I have upgraded the server hardware but it looks that it is still not enough. I earn almost nothing from my forums while I am spending good money running the forums. Google has become an headache for me due to the quantity of traffic he is sending. which even crashes my server sometime. I am planning to ban Google to crawl my forums...

Good morning Madam...

Ah!

ezbnc
06-05-2006, 07:25 AM
Wow that’s a first someone complaining about Google :) Google loves updated pages sounds like your forum is probably busy so Google loves it.

Jeff - Exceed
06-05-2006, 07:28 AM
May I suggest a robots.txt file?

hitmeback
06-05-2006, 08:13 AM
it is better you start making money of it rather banning this gifted traffic .

sasha
06-05-2006, 08:24 AM
Google is not perfect and sometimes it gets stuck in some kind of loop. I had couple sites where I had to block google. WIht robots.txt I blocked it from accessing some content (additional product details and product images) which in no way affected the ranking of the sites but it did stop large bandwidth spikes few times though the month.

2Macs Jim
06-05-2006, 11:59 AM
I have never heard anyone complain about getting to much traffic before! I would say start offering advertising, banners, etc and start making some money on it.

Richard
06-05-2006, 12:57 PM
E-mail Google. This isn't the first time websites have reported Google going crazy.

hitmeback
06-05-2006, 01:10 PM
whts the email adress? :)

Dan541
06-05-2006, 11:05 PM
http://www.robotstxt.org/wc/active/html/googlebot.html

JayC
06-07-2006, 08:27 PM
E-mail Google. This isn't the first time websites have reported Google going crazy.That would be the recommended approach if googlebot is spidering your site too aggressively. That's not the case here.

There are four possible course of action: implement robots.txt to reduce the number of pages that Google can index, use .htaccess to keep some users out, put ads in place to take advantage of the "problem," or do some "reverse SEO" so that the site won't rank as well.

That last one could be kind of fun, actually.

KGIII
06-07-2006, 11:34 PM
They also want log files (if you don't mind) when you report this happening IIRC.

KGIII

JayC
06-08-2006, 12:27 PM
They also want log files (if you don't mind) when you report this happening IIRC.
Again, that's if it's a googlebot problem. In this case it's a ranking "problem." Contacting Google won't help -- they won't manually reduce the rankings. :)

KGIII
06-08-2006, 10:22 PM
Yup... My bad. I was under the impression that the spidering was what they wanted to ban because it was the spider that was crashing it (now I see that it was the traffic). Hmm... That'd be a shame but maybe they can add some ads to help fund the forum? I think most people are capable of accepting that they get ads here and there in exchange for a good service.

KGIII

ZasGC
06-08-2006, 11:20 PM
Just use a robots.txt file and block some stuff

shockuk
06-14-2006, 03:32 PM
You should be making money off this free traffic and living the high life ;)

There is no reason I can see to ban google (or visitors from google searches). Simply make some money, and buy much better hardware and/or more servers (start with a seperate MySQL server, it'll help alot). If your traffic is as much as you're making it out to be, this website could be a nice little money earner for you.