Results 1 to 6 of 6
  1. #1
    Join Date
    Dec 2004
    Posts
    729

    Log parsing software (Get all sites visted by a certain IP address)

    I have some log files that I need to monitor the traffic on. The log files are in a typical log format format (IP, Timestamp, site, etc)

    I need something that will take this log file and group all the sites by the IP address so it would return something like the following:

    XXX.XXX.XXX.59
    site1.com
    site2.com
    site3.com

    XXX.XXX.XXX.60
    site1.com
    site3.com
    site4.com

    etc.. All of the ones that I have seen so far either show you all the hosts (XXX.XXX.XXX.XXX) or all of the URL's, but do not link the two together. Any suggestions?
    Who is General Fault, and why is he reading my disk?

  2. #2
    Join Date
    Feb 2008
    Location
    Farnham, Surrey, UK
    Posts
    69
    I'm not quite sure what you mean by "typical log format", but take a look at AWStats, its a free stats app which uses a Perl script to take it from the raw form.

    The problem here maybe however the format your logs are in.

    Nick
    nickcharlton.org.uk - My Tech Blog

  3. #3
    Join Date
    Dec 2004
    Posts
    729
    Awstats does not provide the breakdown that I need that i've found unfortunantly, as it is more for logging traffic of a visted website, and not for logging what websites people are visiting.
    Who is General Fault, and why is he reading my disk?

  4. #4
    Join Date
    Feb 2008
    Location
    Farnham, Surrey, UK
    Posts
    69
    Do you have shell access/just web access/or would you prefer a web based solution?

    Nick
    nickcharlton.org.uk - My Tech Blog

  5. #5
    Join Date
    Dec 2004
    Posts
    729
    I do have shell access, and no, it doesn't need to be web based.
    Who is General Fault, and why is he reading my disk?

  6. #6
    Get splunk. We index millions of files without a slow down.

    splunk.com

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •