Web Hosting Talk







View Full Version : Incremental processing ?


dutchie
04-22-2001, 01:32 PM
Webalizer is suppose to "remember" the hits and traffic of all the days its been running.

A particular site on my raq however, has a lot of datatraffic (2 or 3 gig a day), and for this site, webalizer only shows the last 2 days.

I read on the webalizer site about "Incremental processing", it has something to do with large logs, and a lot of rotating.
Do i need to turn this option on ? has anyone turned it on in their webalizer.conf ?

My english just isn't good enough to understand the chapter in the readme file completely so i thought i'd check first :)

Chicken
04-22-2001, 05:40 PM
I have the same problem, and did something I thought would have fixed it but it didn't. *curses RaQs logs*

Have to remember to look into the webalizer read me's to see what can be done. Bahhhh.

Gilby
04-22-2001, 06:49 PM
Originally posted by dutchie
Webalizer is suppose to "remember" the hits and traffic of all the days its been running.

Webalizer remembers the hits and traffic by the month, so if you process a log that was rotated in the middle of the month, it will just use the info in the current log for that month. When incremental processing is used, it remembers where it left off and adds that to the stats that are remembered instead of wiping it out for the month and reprocessing it.

When using webalizer with incremental processing off, it is intended to have the logs rotated at the beginning of the month which is fine for most websites. But for websites with high traffic, you'll probably need to rotate the logs more often so the log files aren't too big and that's what incremental processing is for.

Since the RAQ doesn't rotate the logs on the first of the month, it'd be best to turn on incremental processing.

jnestor
04-23-2001, 03:29 PM
Yeah, you need to turn on incremental processing. I just modified the webalizer.pl and added -p but I guess you could also do it in webalizer.conf by uncommenting Incremental and changing it to yes.

I also changed webalizer.pl to run based on the log rotation rather than being run directly by cron since I seemed to entirely miss some days logs.