How can we protect our files from the offline browsers. These software dump the complete site tree in hard disk with all the files.
Can we run ASP or PHP in cgi-bin directory.
Is there anyway we can protect our sites from offline browsers or similar softwares.

I use a two pronged approach that seems to mostly work.

1) use mod-rewrite to redirect them based on user-agent. I send them to a file explaining why I block offline browsers.
2) use mod-throttle to block anyone from downloading pages too quickly.

So anyone who is smart enough to 1) change the offline browser's user agent and 2) set it to download pages slowly can still get through. I don't care too much about them since I'm mostly trying to prevent the server from being overwhelmed with requests rather than trying to protect the content from being saved.

As a final step I will use mod-rewrite to block an IP if I notice fishy behavior. I usually only block an IP for a short time since they could be dynamic. A day or so usually sends the message.

Jolly,

One way or another your site can be saved.
You can installed the above apache module to decrease the chances of it being stolen, but it's not 100%.

Originally posted by jnestor
I use a two pronged approach that seems to mostly work.

1) use mod-rewrite to redirect them based on user-agent. I send them to a file explaining why I block offline browsers.
2) use mod-throttle to block anyone from downloading pages too quickly.


Where can I get more info about the mod-throtle and mod-rewrite.
What is the use of mod-bandwithlimit is it only to restrict the bandwith.