Hi there,

I have this robots.txt code and was wondering how i use it to stop SE from spidering my root directory:

User-Agent: *
Disallow:

Hi,

this should be just fine:

User-agent: *
Disallow: /


But, once again, it will only work with robots following those directives (most well-known robots).

For more information:

http://www.robotstxt.org/wc/exclusion-admin.html

Regards,

G