Results 1 to 22 of 22

Thread: Google Bots

  1. #1
    Join Date
    May 2002
    Posts
    69

    Google Bots

    Guys,
    Not that I'm complaining, but I have three google bots just sort of hanging out on my site. I have about 200 pages online now, but they have been there for almost an hour. Anyone ever hear of anything like this happening?
    http://evilpuppy.com
    where developers gather...

  2. #2
    Join Date
    Feb 2002
    Posts
    267
    It's called deep crawling, that's a good thing

  3. #3
    Join Date
    Oct 2001
    Posts
    307
    The best way to fix this is to link to my site on many of your pages. Use the text "domain hosting" for the link.

    (PSA)
    I know you're not complaining, but visitors wanting to actually block this should research "robots.txt" robot exclusion standard...
    (/PSA)
    Adam
    GetWebSpace.com
    Personal Life Timed Out Due To Inactivity

  4. #4
    Join Date
    Nov 2001
    Posts
    857
    While you are linking to getweb's site could you link to mine as well..
    <?
    header("Location: http://www.hostevolve.com/");
    ?>

  5. #5
    Join Date
    May 2002
    Posts
    69
    Originally posted by getweb
    The best way to fix this is to link to my site on many of your pages. Use the text "domain hosting" for the link.

    (PSA)
    I know you're not complaining, but visitors wanting to actually block this should research "robots.txt" robot exclusion standard...
    (/PSA)
    Oh, that's great, lol

    http://evilpuppy.com
    where developers gather...

  6. #6
    Join Date
    Apr 2002
    Location
    Auckland - New Zealand
    Posts
    1,572
    ermm and I'll settle for a link from the text "web hosting" Cheers

  7. #7
    Join Date
    May 2002
    Posts
    69
    Just curious,
    how long does it usually take to get listed in google once bots have been to your site?
    http://evilpuppy.com
    where developers gather...

  8. #8
    Join Date
    Aug 2002
    Location
    England
    Posts
    145
    Upto a couple of weeks I beleive.
    Josh Powell.
    ServerSpotCheck - Is your website down?
    Skimpylink - Not as tiny as some but much cuter!

  9. #9
    Join Date
    May 2002
    Location
    UK
    Posts
    2,994
    If they decide to list it.... it seems they don't list every site they crawl

  10. #10
    You can get into google just an hour before you have an link from someones site that is been crawling at the right time.

    If you got a friend that have a page with high pagerank you will get into google in a few days if he put a link to the page.

    /Ove

  11. #11
    Join Date
    May 2002
    Location
    UK
    Posts
    2,994
    I believe it's true that they do rank based on sites that link to you, however it would be very rare to get a high page rank within days.

    More likely it'll take months to get anywhere in a search engine.

    BTW what does everyone think about paid inclusion.... personally I hate it and I think those search engines will suffer so long as there are the likes of google out there doing it for free. (especially those that ONLY take inclusion from payment)

  12. #12
    The PFI is good i think, you pay and you get in there.

    If the site is new its propably the best way to improve your ranking because you will see the result of the work you have done in 48 hours. If you not are satisfight with the result you have just change the site and wait 2 days and you will see what effect it has been.

    If the site is optimized good it will not take long for the traffic to come, but dont forget to hunt good links that work will never end.

    Be sure that you are in the odp and the search engines will come to you.

  13. #13
    Join Date
    May 2002
    Posts
    69
    hmm...
    I got the number 1 , 2 and 4 spots under my primary key words. Not bad.

    Thanks all.
    http://evilpuppy.com
    where developers gather...

  14. #14
    Join Date
    May 2002
    Location
    UK
    Posts
    2,994
    Google can be strange sometimes.

    I one of sites to 1st result for my keywords... two days later if disappeared from Google completely and then two weeks later it was back to 1st result.

  15. #15
    That is called the google dance :-)

    Iam sure you will have the listing in the end of this mounth and it will be stable then. Google is updating on the fly and then we will see this rotating results, that is why its important to have links from high pagerank pages.

  16. #16
    On a similir note, there exists Alexa which uses the google search engine.

    Does any body know how to get a picture of our homepage up on Alexa (when a user does a search)? :-) Would be a nice thing to have.
    Walter Landman
    Simplicato - Email Hosting

  17. #17
    It's great to have them at your site .. that means you can get some free traffic
    Web Hosting Stuff - Over 10,000+ Hosting Companies Listed
    http://www.webhostingstuff.com

  18. #18
    How would one know if a there is a google bot 'hanging out' on one's site?

  19. #19
    Originally posted by BSHbrian
    How would one know if a there is a google bot 'hanging out' on one's site?
    See your stats ... usually a good stats program will say "Googlebot" under client types ...
    Web Hosting Stuff - Over 10,000+ Hosting Companies Listed
    http://www.webhostingstuff.com

  20. #20
    Originally posted by wlandman
    On a similir note, there exists Alexa which uses the google search engine.

    Does any body know how to get a picture of our homepage up on Alexa (when a user does a search)? :-) Would be a nice thing to have.
    I think when your traffic cross a certain threshold (probably based on their ranking), they will automatically do a screenshot with their next update.
    Web Hosting Stuff - Over 10,000+ Hosting Companies Listed
    http://www.webhostingstuff.com

  21. #21
    Join Date
    May 2002
    Location
    UK
    Posts
    2,994
    Which one uses the 'slurp' crawler? I think it might be inktomi but I'm not 100%. I see that sometimes... also I get a lot of mirago.

  22. #22
    Slurp is Inktomi.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •