
02-14-2003, 11:45 AM
|
|
WHT Addict
|
|
Join Date: Mar 2002
Location: Minas Tirith
Posts: 137
|
|
Stopping Content Grabbers...?
Hi all,
Not sure if this is the right forum, but I was wondering if anyone knows of a way to stop content grabbers?
In my logs, I'm seeing someone use TelePort Pro, and consume almost 70 MB of transfer in one day. I'm not nearing my bandwidth limit yet, but I really don't want a single individual to suck up all the resources, either.
On another msg board, someone suggested using the PHP function sleep() at the end of my files, but I looked it up at php.net and I'm not sure that's what I'd want, considering that it would probably slow down loading...?
I also googled for TelePort Pro, and they claim to be able to get into password-protected areas as well. I have an admin area that I don't link to anywhere, but visit myself, protected by .htaccess. Would this pose as a security issue as well?
Any input would be appreciated!
__________________
~Aralanthiriel
There is an island of opportunity in the middle of every difficulty. Miss the island, though, and you're pretty much doomed.
|

02-14-2003, 12:48 PM
|
|
Hail Eris !
|
|
Join Date: Oct 2002
Location: Canada
Posts: 3,100
|
|
Hello, my name is Sasha and I am content ripper  The best wat to protect from me is using rules in the .haccess file that will treat requests differently if it has GnetBot in the id string. I do make this string change randomly so you might have to look at denying my IPs as well. I have no problem riping the content from your site that is password protected, but I would need to know username and password, so no worries there.
Just a side note, I do get a premission to rip the content from any sites i am doing this for, and I store as much static info in the DB to minimize bandwidth usage on reccuring rips.
|

02-14-2003, 12:55 PM
|
|
WHT Addict
|
|
Join Date: Mar 2002
Location: Minas Tirith
Posts: 137
|
|
Thanks for your comments. I'll look into the .htaccess solution.
Edited.
__________________
~Aralanthiriel
There is an island of opportunity in the middle of every difficulty. Miss the island, though, and you're pretty much doomed.
Last edited by Aralanthir; 02-14-2003 at 01:22 PM.
|

02-14-2003, 01:10 PM
|
|
Web Hosting Master
|
|
Join Date: May 2002
Location: Modesto, CA
Posts: 3,414
|
|
Yea... sasha... you wierdo!
Next time answer the post with just one line and mispell things and use horrible grammar!
__________________
dotGig
<:<: [Fruit eating linux administrator]
|

02-14-2003, 01:19 PM
|
|
Newbie
|
|
Join Date: Jan 2003
Posts: 16
|
|
I found that mod_rewrite is a nifty utility to use ;-)
__________________
WebTraks Internet
info@webtraks.com
www.webtraks.com
|

02-14-2003, 01:20 PM
|
|
WHT Addict
|
|
Join Date: Mar 2002
Location: Minas Tirith
Posts: 137
|
|
Chill out, Samuel, I wasn't trying to insult him or anything. I just thought his wording was a bit unorthodox, making it seem like he was talking directly *to* me about ripping my site.
Other than that, his response was helpful.
Sorry if you seem insulted by this. I didn't mean any harm.
EDIT: My bad. Sasha's a guy. *sigh* It's too early in the morning...
__________________
~Aralanthiriel
There is an island of opportunity in the middle of every difficulty. Miss the island, though, and you're pretty much doomed.
|

02-14-2003, 01:21 PM
|
|
Hail Eris !
|
|
Join Date: Oct 2002
Location: Canada
Posts: 3,100
|
|
Quote:
Originally posted by Samuel
Yea... sasha... you wierdo!
Next time answer the post with just one line and mispell things and use horrible grammar!
|
I nver used anything called grammmar.

|

02-14-2003, 01:23 PM
|
|
Web Hosting Master
|
|
Join Date: May 2002
Location: Modesto, CA
Posts: 3,414
|
|
hahah, yes "Her" response was.... lol sasha is a big dude (Like 7 foot tall)
__________________
dotGig
<:<: [Fruit eating linux administrator]
|

02-14-2003, 01:23 PM
|
|
Hail Eris !
|
|
Join Date: Oct 2002
Location: Canada
Posts: 3,100
|
|
Thank you Aralanthir, my knight. I was not insulted at all.
|

02-14-2003, 01:26 PM
|
|
WHT Addict
|
|
Join Date: Mar 2002
Location: Minas Tirith
Posts: 137
|
|
Quote:
Originally posted by Samuel
hahah, yes "Her" response was.... lol sasha is a big dude (Like 7 foot tall)
|
LOL. Oopsies. Most of the people in the communities I meet tend to be female, so I always end up defaulting to "she."
7 feet tall... I think I should hide now...
__________________
~Aralanthiriel
There is an island of opportunity in the middle of every difficulty. Miss the island, though, and you're pretty much doomed.
|

02-14-2003, 01:28 PM
|
|
Web Hosting Master
|
|
Join Date: May 2002
Location: Modesto, CA
Posts: 3,414
|
|
lol@my knight hahaha
the cold is starting to make you wilt
__________________
dotGig
<:<: [Fruit eating linux administrator]
|
| Thread Tools |
Search this Thread |
|
|
|
| Display Modes |
Linear Mode
|
| Postbit Selector |
|
|
Posting Rules
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is Off
|
|
|
|
|
|
| Login: |
|
|
| Advertisement: |
|
|
| Web Hosting News: |
|
|
|