Page 1 of 2 12 LastLast
Results 1 to 25 of 29
  1. #1
    Join Date
    Sep 2003
    Location
    Pittsburgh, PA
    Posts
    98

    Google Attacks my site?

    Heh,
    Usually I get 12 unique requests from googlebots per day (maybe different pages get different bots), today I check stats and BAM, there's like 25+ googlebot visits.

    The other day my site went from PR1 to PR5 maybe the increase did that.

    I dont really mind but does anyone know whats happening

    Dimitry
    Attached Thumbnails Attached Thumbnails google.gif  

  2. #2
    They are spidering your site, call it attacking if you wish I guess.
    Advanced Forum Hosting
    http://www.boardnation.com
    Easily build a community today!

  3. #3
    Join Date
    May 2001
    Location
    Colorado, USA
    Posts
    814
    Are you using a robots.txt file to stop them?
    Web Hosting Resource Kit - Web Hosting Reviews & Hosting Tutorials

  4. #4
    Join Date
    Apr 2003
    Location
    North Carolina USA
    Posts
    414
    GoogleBot has hit our auction site 504 times so far this month... an average of 28 times a day.

    I'm not complaining

  5. #5
    Join Date
    Sep 2003
    Location
    Pittsburgh, PA
    Posts
    98
    Originally posted by daveman
    They are spidering your site, call it attacking if you wish I guess.
    Lol, I know that. That was just my title because of the number of bots today.

    Anyways, I guess its normal from what Two_A_T says.
    Dimitry

  6. #6
    Join Date
    Aug 2000
    Location
    NYC
    Posts
    6,623
    Originally posted by DimitryVC
    Usually I get 12 unique requests from googlebots per day (maybe different pages get different bots), today I check stats and BAM, there's like 25+ googlebot visits.

    The other day my site went from PR1 to PR5 maybe the increase did that.
    The higher the PageRank the more deeply and frequently they'll tend to spider your site. They also won't generally spider you as deeply every day -- those 25 hits today may be followed by only a couple tomorrow. If they detect that the site is updated frequently, they'll generally crawl more frequently.

    And yes, googlebot hits come from a large number of IP addresses -- what you referred to as "different bots."
    Specializing in SEO and PPC management.

  7. #7
    Join Date
    Sep 2003
    Location
    Pittsburgh, PA
    Posts
    98
    Sounds good.
    Thanks for the explanation

    Dimitry

  8. #8
    So far my record is 800 hits in 1 day.
    I`m not complaining though
    Linux/CPanel/WHM Tutorials & How-Tos
    Dedicated Server Tutorials

  9. #9
    Join Date
    Aug 2000
    Location
    NYC
    Posts
    6,623
    Originally posted by ToddW
    So far my record is 800 hits in 1 day.
    I`m not complaining though
    "The only thing worse than getting a lot of hits from GoogleBot
    ...is NOT getting a lot of hits from GoogleBot."
    Specializing in SEO and PPC management.

  10. #10
    Originally posted by JayC
    "The only thing worse than getting a lot of hits from GoogleBot
    ...is NOT getting a lot of hits from GoogleBot."
    What page of the bible is that on
    Linux/CPanel/WHM Tutorials & How-Tos
    Dedicated Server Tutorials

  11. #11
    I have noticed something, I have left many (casue I am lazy) old pages on my site, these are some pages that I have updated with other designs and templates.

    It seems that Google and Yahoo have pick these pages up and I get a ton of traffic from them,

    I can't get in trouble or anything for these old pages? they still have content and links to my main index?

    Just wondering
    "A man's worth is not measured in the numbers in his bank account, but in the number of people that call him friend"

    Your friends at MyTurnkeyBusiness.com

  12. #12
    Join Date
    Feb 2004
    Location
    Australia (Crikey)
    Posts
    2,271
    the more googlebot hits your site the better, it means google thinks your site is important or that you frequently change your site content (this is very true with forums)

  13. #13
    Join Date
    Apr 2003
    Location
    North Carolina USA
    Posts
    414
    Originally posted by turnkey
    I have noticed something, I have left many (casue I am lazy) old pages on my site, these are some pages that I have updated with other designs and templates.

    It seems that Google and Yahoo have pick these pages up and I get a ton of traffic from them,

    I can't get in trouble or anything for these old pages? they still have content and links to my main index?

    Just wondering
    You better get your passport ready and flee the country.. the search engine police are gonna get you!!

    Seriously, though.. I don't see how you could get in trouble or even WHO you could get in trouble with unless the content of those pages is illegal in some way. If they are getting traffic then use it to your advantage.

  14. #14
    There are currently 268 member(s) and 812 guest(s) on the boards. Our Record is 1352 on 03-01-2004 at 09:51 PM.


    I bet you 300 of those guests are spiders, someone in WHTirc a few weeks ago said WHT currently has 500+ Google bot's indexing.

  15. #15
    I say the more google hits my site the better.

  16. #16
    Join Date
    Jan 2004
    Location
    Ellesmere Port, Wirral, UK
    Posts
    1,540
    Originally posted by JayC
    "The only thing worse than getting a lot of hits from GoogleBot
    ...is NOT getting a lot of hits from GoogleBot."
    Amen to that.
    BTi-Hosting.co.uk High quality hosting, low low prices.
    One step ahead of the competition - Today IS tomorrow.
    FraudWise.Net - Fight the fraud!

  17. #17
    Join Date
    Aug 2003
    Posts
    459
    Is it possible to buy the software those Google Spiders Use ?

    I wanna get myself a Google Spider!


  18. #18
    Join Date
    Jan 2002
    Location
    Scotland, UK
    Posts
    2,688
    Originally posted by DJ Plasma
    Is it possible to buy the software those Google Spiders Use ?
    The Google Search Appliance.

    http://www.google.com/appliance

  19. #19
    Join Date
    Sep 2003
    Location
    Pittsburgh, PA
    Posts
    98
    Originally posted by DJ Plasma
    Is it possible to buy the software those Google Spiders Use ?

    I wanna get myself a Google Spider!

    In basic terms its a program that loads a website (ie. youdomain.com), gets the info of that main page (meta tags and other stuff), then continues to grab all the links and do the same with each link (never ending process if you link to other sites and htey link to other sites, etc. etc.)

    Of course google's technology is FAAR beyond that.
    Dimitry

  20. #20
    Join Date
    Aug 2003
    Posts
    2,733
    Probably the web crawler/spider

  21. #21
    Join Date
    Jul 2002
    Location
    Kuwait
    Posts
    10,620
    800/day!!
    Bashar Al-Abdulhadi - KuwaitNET Internet Services Serving customers since 1997
    Kuwait's First Webhosting and Domain Registration provider - an ICANN Accredited Registrar

    Twitter: Bashar Al-Abdulhadi

  22. #22
    Googlebot is a double edged sword imo. I run an ASP based forum on my site and have noticed up to 15 *guests* spidering the site, sometimes for half an hour, but in other cases 6-7 hours.

    This means that I am getting good recognition, coming near the top for my preferred search terms, but having googlebot spider the forums in such a way is consuming bandwidth and adding extra strain to the server.

    I have attempted to get Googlebot away from the fourms using a robots.txt file which appears to eb useless and some ASP script which checks for Googles IP range. The latter seemed to be working well until a few weeks ago.

  23. #23
    Join Date
    Sep 2003
    Location
    Pittsburgh, PA
    Posts
    98
    There's a Vbulletin hack that will say "Spider" or something along those lines in the Who's Online Part.

    In your case this is obviously different (for one, you are running a diff. forum :p) BUT the hack refers http://www.iplists.com/ to get the last known lists of IPs of spiders of popular search engines in cluding google.

    Id recommend updating your IP lists that your script uses with the latest from that site

    Hope that helps a little.
    Dimitry

  24. #24
    Join Date
    Feb 2004
    Posts
    600
    how do you view your pagerank?
    Dating Revolution Method - Book on how to meet and attract women

  25. #25
    get the google toolbar

Page 1 of 2 12 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •