Results 1 to 5 of 5
  1. #1
    Join Date
    Oct 2005
    Posts
    396

    Strange urls in 404 logs

    I just found hundreds of rubbish urls in awstats for a particular domain. Is this referrer spam or something more serious and can I do something about this?

    I have attached a screenshot. Thanks in advance.

  2. #2
    You don't really need to worry about it, and there's not much you can do about it.

  3. #3
    Did you try and visit the referrers direct link to see if they are leeching any of your images or content there?

  4. #4
    Join Date
    Aug 2008
    Location
    Ontario, California
    Posts
    49
    I would recommend setting up a robots.txt file, though, even if it is just empty.

    http://www.robotstxt.org/

  5. #5
    Join Date
    Oct 2005
    Posts
    396
    Thanks for chipping in, everyone.

    Quote Originally Posted by TheITAdvisory View Post
    Did you try and visit the referrers direct link to see if they are leeching any of your images or content there?
    I tried this and only got 404s. I went ahead and disabled hotlinking in the control panel, anyway.

    Quote Originally Posted by LinkLine_1 View Post
    I would recommend setting up a robots.txt file, though, even if it is just empty.

    http://www.robotstxt.org/
    Thanks for the suggestion.
    Last edited by ramdak5000; 08-18-2008 at 12:21 AM. Reason: addition

  6. Newsletters

    Subscribe Now & Get The WHT Quick Start Guide!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •