Results 1 to 3 of 3
  1. #1
    Join Date
    Sep 2002
    Location
    Newmarket, UK
    Posts
    10

    Question Web analytics reports - acceptable response?

    We generate some very large custom server logs in order to generate web analytics reports which include much more data than a standard server log.
    For one site the gzipped daily log files are about 10MB and this equates to daily PIs of approx 500k.
    Now, we have used some cutting edge database technology to process this data fast enough to provide the customer with reports in real time - how fast would people say was acceptable.
    At the moment, for example, running a monthly PIs report in real time takes 20-30 seconds to produce a web based report (graphs are SVG) - would you be happy with this or is it still too slow?

    Your comments would be much appreciated.

  2. #2
    For a log that could be 500+ megs in size, for example, that's not so bad. The faster the better, but processing is still processing. Just make sure the processes for the log generating software doesn't cause you problems. Limit the size and the priority. I think that's acceptable. It's not so bad to wait 20 or 30 seconds to have a log generated. Most people won't be viewing them daily anyway. That is, of course, my opinion.
    Robert McGregor
    URL: http://www.2host.com
    Email: robertm@(nospam)2host.com

  3. #3
    Join Date
    Sep 2002
    Location
    Newmarket, UK
    Posts
    10
    Yes, I was concerned about the logging software itself but we have managed to get that working very efficiently so that the overhead is almost the same as that of the writing of a 'standard' log file. This software (ISAPI/IIS and module/Apache) then sends the completed logs to a DB elsewhere which keeps the web server nice and 'clean'.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •