It just blocks access for the Fasterfox bots to the site.
Kevin Cheri : Senior Server Administrator / Freelancer : 9+ years Exp, reach me out for any help Server Optimization Expert / Mysql Guru / Migration Specialist
Skype : lynxmaestro
Gmail : [email protected]
Yes, it will tell fasterbox user agent not to crawl any pages of that website. I don't what is fasterbox is; I haven't seen it yet. But if it is a malicious bot, there is chances that it do not respect the robots.txt file and can ignore the rules. Also I have seen somewhere that Crawl-delay is not an SEO friendly command, and do not recognize by some well known crawlers ( like google ). So avoid using it for general crawl rules.
I see in my robots txt with these texts.
Could you explain whats the meaning of this code?
Is there anything blocks or its looks like fine?
As other members have said, it Disallow Fasterfox bot to stop crawling your website. Like this you can give instructions to bots you don't want to crwal your website. Also, you can set instruction to crwal your website with
Firefox users use an extension called “Fasterfox”. This extension “pre-fetches” links on a page so that if the user were to click on a link it would load much faster because its already been downloaded. This may be more convenient for viewer, but is a major problem for many webmasters who are low on bandwidth.