Web Hosting Talk







View Full Version : How to get rid a website from search engine index?


hardjoko
12-21-2006, 04:07 AM
Hi,

Anyone knows?

Lev
12-21-2006, 04:29 AM
Do you mean from a specific search engine and then keep it that way or from all search engines and then keep it that way? Or temporarily remove one or a couple of pages? Be more specific.

Take a look at this page, its links provide an outline that works for most search engines:

http://www.google.com/support/webmasters/bin/answer.py?answer=35301&topic=8459

Webmaster7
12-21-2006, 05:48 AM
Hello!

You mean one of your sites, or from another person?
If it's from you, just disallow any bots in robots.txt

User-agent: *
Disallow:


With that in your robots.txt no honest crawler will check and index your website.
For all the others, you can just put the site inside a protected area.

hardjoko
12-21-2006, 05:48 AM
I mean I have 10 domain names that's not even hosted anymore. Somehow search engine yahoo don't get rid of it from the index.

anon-e-mouse
12-21-2006, 05:51 AM
They will eventually fall off. The result don't suddenly disappear when the site is gone.

Moved to web deisgn and content.

OnlineRack
12-22-2006, 02:56 AM
I have run into the same problem.... I had pages changed due to redesign so the old URLs were giving 404 errors.... it took more than 6 months to clear out.