I'm currently on a shared hosting plan and was wondering if robots.txt will still work? I'm trying to get one of my domain names removed from Archive.org.

robots.txt is simply read by the search engine from your website as any other file would be (such as index.html). You should have no problem using robots.txt in a shared hosting environment unless your host has put some sort of restriction on it (why would they do that?!)

Bottom line: robots.txt should work fine on your shared hosting plan :)

Thanks a lot!

Edit: Would it be a bad idea to also have the meta robots?

Yes, robots.txt will work on any type of hosting :)

It's just browsed by the search spiders, in which don't know what type of hosting you have, hehe.

Vcandle,

First, welcome to WHT!

Yes, you can use both.

Hi,
The robots.txt should be read by all search engines.
Some will also use a meta robot tag as well, like for revisit time and such. However, from what I read, most robots ignore the meta tag ones, but a few still use it.
It shouldn't hurt to use both, or just the robots.txt.

Tim L

Welcome to WHT,

You can use robots.txt without a problem

John

I'm trying to get one of my domain names removed from Archive.org.
This may be a bit off-topic, but:

I was delighted to discover that my site was included in the Internet Archive, and have found the Archive to be a wonderful resource. Why are you wanting to be removed from it?

Thank you.

Eliz.