Results 1 to 25 of 29
Thread: Google Attacks my site?
-
03-18-2004, 12:45 PM #1Junior Guru Wannabe
- Join Date
- Sep 2003
- Location
- Pittsburgh, PA
- Posts
- 98
Google Attacks my site?
Heh,
Usually I get 12 unique requests from googlebots per day (maybe different pages get different bots), today I check stats and BAM, there's like 25+ googlebot visits.
The other day my site went from PR1 to PR5 maybe the increase did that.
I dont really mind but does anyone know whats happening
Dimitry
-
03-18-2004, 01:27 PM #2Web Hosting Master
- Join Date
- Sep 2002
- Posts
- 876
They are spidering your site, call it attacking if you wish I guess.
-
03-18-2004, 01:34 PM #3Web Hosting Resource Master
- Join Date
- May 2001
- Location
- Colorado, USA
- Posts
- 814
Are you using a robots.txt file to stop them?
Web Hosting Resource Kit - Web Hosting Reviews & Hosting Tutorials
-
03-18-2004, 01:42 PM #4Aspiring Evangelist
- Join Date
- Apr 2003
- Location
- North Carolina USA
- Posts
- 414
GoogleBot has hit our auction site 504 times so far this month... an average of 28 times a day.
I'm not complaining
-
03-18-2004, 02:31 PM #5Junior Guru Wannabe
- Join Date
- Sep 2003
- Location
- Pittsburgh, PA
- Posts
- 98
Originally posted by daveman
They are spidering your site, call it attacking if you wish I guess.
Anyways, I guess its normal from what Two_A_T says.
Dimitry
-
03-18-2004, 02:40 PM #6Web Hosting Master
- Join Date
- Aug 2000
- Location
- NYC
- Posts
- 6,623
Originally posted by DimitryVC
Usually I get 12 unique requests from googlebots per day (maybe different pages get different bots), today I check stats and BAM, there's like 25+ googlebot visits.
The other day my site went from PR1 to PR5 maybe the increase did that.
And yes, googlebot hits come from a large number of IP addresses -- what you referred to as "different bots."Specializing in SEO and PPC management.
-
03-18-2004, 03:04 PM #7Junior Guru Wannabe
- Join Date
- Sep 2003
- Location
- Pittsburgh, PA
- Posts
- 98
Sounds good.
Thanks for the explanation
Dimitry
-
03-18-2004, 05:37 PM #8WHT Addict
- Join Date
- Apr 2002
- Posts
- 110
So far my record is 800 hits in 1 day.
I`m not complaining thoughLinux/CPanel/WHM Tutorials & How-Tos
Dedicated Server Tutorials
-
03-18-2004, 06:28 PM #9Web Hosting Master
- Join Date
- Aug 2000
- Location
- NYC
- Posts
- 6,623
Originally posted by ToddW
So far my record is 800 hits in 1 day.
I`m not complaining though
...is NOT getting a lot of hits from GoogleBot."Specializing in SEO and PPC management.
-
03-18-2004, 06:48 PM #10WHT Addict
- Join Date
- Apr 2002
- Posts
- 110
Originally posted by JayC
"The only thing worse than getting a lot of hits from GoogleBot
...is NOT getting a lot of hits from GoogleBot."Linux/CPanel/WHM Tutorials & How-Tos
Dedicated Server Tutorials
-
03-18-2004, 10:53 PM #11Newbie
- Join Date
- Mar 2004
- Posts
- 20
I have noticed something, I have left many (casue I am lazy) old pages on my site, these are some pages that I have updated with other designs and templates.
It seems that Google and Yahoo have pick these pages up and I get a ton of traffic from them,
I can't get in trouble or anything for these old pages? they still have content and links to my main index?
Just wondering"A man's worth is not measured in the numbers in his bank account, but in the number of people that call him friend"
Your friends at MyTurnkeyBusiness.com
-
03-18-2004, 11:06 PM #12Web Hosting Master
- Join Date
- Feb 2004
- Location
- Australia (Crikey)
- Posts
- 2,271
the more googlebot hits your site the better, it means google thinks your site is important or that you frequently change your site content (this is very true with forums)
-
03-18-2004, 11:08 PM #13Aspiring Evangelist
- Join Date
- Apr 2003
- Location
- North Carolina USA
- Posts
- 414
Originally posted by turnkey
I have noticed something, I have left many (casue I am lazy) old pages on my site, these are some pages that I have updated with other designs and templates.
It seems that Google and Yahoo have pick these pages up and I get a ton of traffic from them,
I can't get in trouble or anything for these old pages? they still have content and links to my main index?
Just wondering
Seriously, though.. I don't see how you could get in trouble or even WHO you could get in trouble with unless the content of those pages is illegal in some way. If they are getting traffic then use it to your advantage.
-
03-19-2004, 11:49 AM #14Junior Guru Wannabe
- Join Date
- Nov 2003
- Posts
- 98
There are currently 268 member(s) and 812 guest(s) on the boards. Our Record is 1352 on 03-01-2004 at 09:51 PM.
I bet you 300 of those guests are spiders, someone in WHTirc a few weeks ago said WHT currently has 500+ Google bot's indexing.
-
03-19-2004, 11:54 AM #15Newbie
- Join Date
- Mar 2004
- Posts
- 25
I say the more google hits my site the better.
-
03-20-2004, 03:03 PM #16Web Hosting Master
- Join Date
- Jan 2004
- Location
- Ellesmere Port, Wirral, UK
- Posts
- 1,540
Originally posted by JayC
"The only thing worse than getting a lot of hits from GoogleBot
...is NOT getting a lot of hits from GoogleBot."BTi-Hosting.co.uk High quality hosting, low low prices.
One step ahead of the competition - Today IS tomorrow.
FraudWise.Net - Fight the fraud!
-
03-21-2004, 04:54 PM #17Web Hosting Evangelist
- Join Date
- Aug 2003
- Posts
- 459
Is it possible to buy the software those Google Spiders Use ?
I wanna get myself a Google Spider!
-
03-21-2004, 05:03 PM #18Web Hosting Master
- Join Date
- Jan 2002
- Location
- Scotland, UK
- Posts
- 2,688
Originally posted by DJ Plasma
Is it possible to buy the software those Google Spiders Use ?
http://www.google.com/appliance
-
03-21-2004, 06:08 PM #19Junior Guru Wannabe
- Join Date
- Sep 2003
- Location
- Pittsburgh, PA
- Posts
- 98
Originally posted by DJ Plasma
Is it possible to buy the software those Google Spiders Use ?
I wanna get myself a Google Spider!
Of course google's technology is FAAR beyond that.
Dimitry
-
03-21-2004, 06:20 PM #20Web Hosting Master
- Join Date
- Aug 2003
- Posts
- 2,733
Probably the web crawler/spider
-
03-22-2004, 05:08 AM #21Retired Moderator
- Join Date
- Jul 2002
- Location
- Kuwait
- Posts
- 10,620
800/day!!
Bashar Al-Abdulhadi - KuwaitNET Internet Services Serving customers since 1997
Kuwait's First Webhosting and Domain Registration provider - an ICANN Accredited Registrar
Twitter: Bashar Al-Abdulhadi
-
03-22-2004, 11:31 AM #22Junior Guru Wannabe
- Join Date
- Dec 2001
- Posts
- 45
Googlebot is a double edged sword imo. I run an ASP based forum on my site and have noticed up to 15 *guests* spidering the site, sometimes for half an hour, but in other cases 6-7 hours.
This means that I am getting good recognition, coming near the top for my preferred search terms, but having googlebot spider the forums in such a way is consuming bandwidth and adding extra strain to the server.
I have attempted to get Googlebot away from the fourms using a robots.txt file which appears to eb useless and some ASP script which checks for Googles IP range. The latter seemed to be working well until a few weeks ago.
-
03-22-2004, 01:20 PM #23Junior Guru Wannabe
- Join Date
- Sep 2003
- Location
- Pittsburgh, PA
- Posts
- 98
There's a Vbulletin hack that will say "Spider" or something along those lines in the Who's Online Part.
In your case this is obviously different (for one, you are running a diff. forum :p) BUT the hack refers http://www.iplists.com/ to get the last known lists of IPs of spiders of popular search engines in cluding google.
Id recommend updating your IP lists that your script uses with the latest from that site
Hope that helps a little.
Dimitry
-
03-22-2004, 01:51 PM #24Web Hosting Master
- Join Date
- Feb 2004
- Posts
- 600
how do you view your pagerank?
Dating Revolution Method - Book on how to meet and attract women
-
03-22-2004, 01:56 PM #25Junior Guru Wannabe
- Join Date
- Nov 2003
- Posts
- 98
get the google toolbar