hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : Hosting Security and Technology : Stopping Content Grabbers...?
Reply

Hosting Security and Technology Configuring and optimizing web hosting servers and operating systems, developing administration scripts, building servers, protecting against hackers, and general security (SSL certificates, etc.)
Forum Jump

Stopping Content Grabbers...?

Reply Post New Thread In Hosting Security and Technology Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #1  
Old 02-14-2003, 11:45 AM
Aralanthir Aralanthir is offline
WHT Addict
 
Join Date: Mar 2002
Location: Minas Tirith
Posts: 137

Stopping Content Grabbers...?


Hi all,

Not sure if this is the right forum, but I was wondering if anyone knows of a way to stop content grabbers?

In my logs, I'm seeing someone use TelePort Pro, and consume almost 70 MB of transfer in one day. I'm not nearing my bandwidth limit yet, but I really don't want a single individual to suck up all the resources, either.

On another msg board, someone suggested using the PHP function sleep() at the end of my files, but I looked it up at php.net and I'm not sure that's what I'd want, considering that it would probably slow down loading...?

I also googled for TelePort Pro, and they claim to be able to get into password-protected areas as well. I have an admin area that I don't link to anywhere, but visit myself, protected by .htaccess. Would this pose as a security issue as well?

Any input would be appreciated!

__________________
~Aralanthiriel

There is an island of opportunity in the middle of every difficulty. Miss the island, though, and you're pretty much doomed.

Reply With Quote


Sponsored Links
  #2  
Old 02-14-2003, 12:48 PM
sasha sasha is offline
Hail Eris !
 
Join Date: Oct 2002
Location: Canada
Posts: 3,100
Hello, my name is Sasha and I am content ripper The best wat to protect from me is using rules in the .haccess file that will treat requests differently if it has GnetBot in the id string. I do make this string change randomly so you might have to look at denying my IPs as well. I have no problem riping the content from your site that is password protected, but I would need to know username and password, so no worries there.

Just a side note, I do get a premission to rip the content from any sites i am doing this for, and I store as much static info in the DB to minimize bandwidth usage on reccuring rips.

Reply With Quote
  #3  
Old 02-14-2003, 12:55 PM
Aralanthir Aralanthir is offline
WHT Addict
 
Join Date: Mar 2002
Location: Minas Tirith
Posts: 137
Thanks for your comments. I'll look into the .htaccess solution.

Edited.

__________________
~Aralanthiriel

There is an island of opportunity in the middle of every difficulty. Miss the island, though, and you're pretty much doomed.


Last edited by Aralanthir; 02-14-2003 at 01:22 PM.
Reply With Quote
Sponsored Links
  #4  
Old 02-14-2003, 01:10 PM
Samuel Samuel is offline
Web Hosting Master
 
Join Date: May 2002
Location: Modesto, CA
Posts: 3,414
Yea... sasha... you wierdo!

Next time answer the post with just one line and mispell things and use horrible grammar!

__________________
dotGig
<:<: [Fruit eating linux administrator]

Reply With Quote
  #5  
Old 02-14-2003, 01:19 PM
WebTraks WebTraks is offline
Newbie
 
Join Date: Jan 2003
Posts: 16
I found that mod_rewrite is a nifty utility to use ;-)

__________________
WebTraks Internet
info@webtraks.com
www.webtraks.com

Reply With Quote
  #6  
Old 02-14-2003, 01:20 PM
Aralanthir Aralanthir is offline
WHT Addict
 
Join Date: Mar 2002
Location: Minas Tirith
Posts: 137
Chill out, Samuel, I wasn't trying to insult him or anything. I just thought his wording was a bit unorthodox, making it seem like he was talking directly *to* me about ripping my site.

Other than that, his response was helpful.

Sorry if you seem insulted by this. I didn't mean any harm.

EDIT: My bad. Sasha's a guy. *sigh* It's too early in the morning...

__________________
~Aralanthiriel

There is an island of opportunity in the middle of every difficulty. Miss the island, though, and you're pretty much doomed.

Reply With Quote
  #7  
Old 02-14-2003, 01:21 PM
sasha sasha is offline
Hail Eris !
 
Join Date: Oct 2002
Location: Canada
Posts: 3,100
Quote:
Originally posted by Samuel
Yea... sasha... you wierdo!

Next time answer the post with just one line and mispell things and use horrible grammar!
I nver used anything called grammmar.



Reply With Quote
  #8  
Old 02-14-2003, 01:23 PM
Samuel Samuel is offline
Web Hosting Master
 
Join Date: May 2002
Location: Modesto, CA
Posts: 3,414
hahah, yes "Her" response was.... lol sasha is a big dude (Like 7 foot tall)

__________________
dotGig
<:<: [Fruit eating linux administrator]

Reply With Quote
  #9  
Old 02-14-2003, 01:23 PM
sasha sasha is offline
Hail Eris !
 
Join Date: Oct 2002
Location: Canada
Posts: 3,100
Thank you Aralanthir, my knight. I was not insulted at all.

Reply With Quote
  #10  
Old 02-14-2003, 01:26 PM
Aralanthir Aralanthir is offline
WHT Addict
 
Join Date: Mar 2002
Location: Minas Tirith
Posts: 137
Quote:
Originally posted by Samuel
hahah, yes "Her" response was.... lol sasha is a big dude (Like 7 foot tall)
LOL. Oopsies. Most of the people in the communities I meet tend to be female, so I always end up defaulting to "she."

7 feet tall... I think I should hide now...

__________________
~Aralanthiriel

There is an island of opportunity in the middle of every difficulty. Miss the island, though, and you're pretty much doomed.

Reply With Quote
  #11  
Old 02-14-2003, 01:28 PM
Samuel Samuel is offline
Web Hosting Master
 
Join Date: May 2002
Location: Modesto, CA
Posts: 3,414
lol@my knight hahaha

the cold is starting to make you wilt

__________________
dotGig
<:<: [Fruit eating linux administrator]

Reply With Quote
Reply

Related posts from TheWhir.com
Title Type Date Posted
Mozilla Firefox 23 Will Block Mix SSL Content by Default Web Hosting News 2013-04-12 11:39:07
Will Backpage be the death of the Communications Decency Act? Blog 2013-02-05 18:52:05
New Social Platform PaperShare Connects Cloud Computing Industry through Content Web Hosting News 2011-12-19 15:14:29
Hacker Group Anonymous Targets Web Hosting Firm Over Child Porn Claims Web Hosting News 2011-10-25 00:31:33
Web Hosting Program We Stop Badware Starts Adding New Participants Web Hosting News 2011-08-26 16:57:00


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
Advertisement:
Web Hosting News:



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?