Results 1 to 5 of 5
  1. #1
    Join Date
    Nov 2007

    Fetch robots.txt failed?


    Here is my robots.txt

    Last 3 days server downtime, then Google tell me "fetch" it.

    After done, I got error:

    Can anyone tell me why this happen?

      0 Not allowed!

  2. #2
    It could simply be that Google's servers still see it down. Such as Caching, etc. I wouldn't panic, try it again
      0 Not allowed!

  3. #3
    Join Date
    Mar 2013
    Quote Originally Posted by bigu_c View Post
    Last 3 days server downtime
    That's the problem. Change host, 3 days downtime are not acceptable.
      0 Not allowed!

  4. #4
    I would make sure your .htaccess file isn't redirecting the googlebot. Then, maybe use a head-checker to ensure that the file isn't returning a 404, 501(i think) or 301.
      0 Not allowed!

  5. #5
    I had this same problem a couple weeks ago. If you have not changed anything yourself I would say your server was probably down at the time of crawling. Just Fetch as google in webmaster tools and wait. It can take a while for these errors to go away.
      0 Not allowed!

Similar Threads

  1. robots.txt help
    By HA Jack in forum SEO / SEM Discussions
    Replies: 3
    Last Post: 07-14-2013, 06:02 AM
  2. Which is better Robots.txt or Meta Robots Tag?
    By nitsingh in forum SEO / SEM Discussions
    Replies: 10
    Last Post: 03-01-2013, 04:08 PM
  3. robots.txt
    By Southprojects in forum Hosting Security and Technology
    Replies: 3
    Last Post: 02-04-2013, 01:37 PM
  4. Directing Robots With Robots.txt
    By Nullified in forum Web Design and Content
    Replies: 0
    Last Post: 02-27-2005, 12:12 PM
  5. Robots.txt
    By Naresh in forum Web Design and Content
    Replies: 3
    Last Post: 08-26-2004, 02:44 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts