View Full Version : Webalizer again?
dutchie 03-17-2001, 10:58 AM I installed webalizer on my RaQ, and it works fine for most sites except one very busy one.
This particular sites has more then 50.000 hits a day.
What can be the problem ?
I think it was Chicken who said that webalizer takes longer to update on the sites that receive a lot of hits. It took webalizer almost 3 days to update the stats of one of the sites on my RaQ3.
Chicken 03-17-2001, 01:08 PM I've read this before about webalizer, and the problem was with the log rotation. Your logs will rotate depending on two factors: scheduled time, and/or size.
What happens with busy sites is that the large logs are rotated, before webalizer has a chance to read them. I'm not sure what the fix is, if there is a fix, etc., but I believe this is what is happening.
dutchie 03-18-2001, 05:23 AM I noticed i forgot to install the log-rotate patch from cobalt, i guess this could have something to do with it :)
dutchie 03-19-2001, 04:33 AM well it still don't work.
When i type in
ls /etc/rc.d/rc3.d/*crond*
i get:
/etc/rc.d/rc3.d/S40crond /etc/rc.d/rc3.d/S40crond.rpmorig
How can i check if webalizer is scheduled to run ?
dutchie 03-19-2001, 04:37 AM i did crontab -l and got :
# DO NOT EDIT THIS FILE - edit the master and reinstall.
# (/cr0n installed on Tue Feb 13 20:14:47 2001)
# (Cron version -- $Id: crontab.c,v 2.13 1994/01/17 03:20:37 vixie Exp $)
*/5 * * * * /usr/sbin/init
Does this help ?
WreckRman2 03-19-2001, 06:14 AM I had this problem and it was due to the fact that my /tmp directory wasn't large enough to complete the process.
As a fix I created a /home/tmp directory and then created a soft link from /tmp to /home/tmp
Works now...
dutchie 03-19-2001, 07:29 AM Ah that sounds like it could be the case.
The sites it isn't working for, are giving quota errors (usedup diskspace).
Can descripe me in detail how to make these dirs and links ?
Thanks !
dutchie 03-19-2001, 06:54 PM I just had a user with a 80mb space limit, who had only 9mb files on his site, and couldn't upload because he had reached his limit !
Someone please give me a solution.
SI-Chris 03-19-2001, 08:20 PM Originally posted by dutchie
I just had a user with a 80mb space limit, who had only 9mb files on his site, and couldn't upload because he had reached his limit !
Someone please give me a solution.
Did you check their e-mail usage? Sometimes people set their e-mail clients so they don't delete the messages off the server, and these can accumulate (especially if they're sending photos or other attachments).
dutchie 03-19-2001, 08:26 PM i just did.
He received 1 mail from 8k.
i have 2 problems
Webalizer don't work for these 2 sites, and they are (sometimes for a short period) out of diskspace.
Félix C.Courtemanche 03-20-2001, 12:33 AM If webalizer run when they are short of space, it may probably not be able to work properly as the files written must obey to the quota.
Now, as the logs rotate before webalizer run, there is no easy way to solve it.
We have done this, but I do not support nor recommend doign it if you are not sure of what you are doing.
move: /etc/cron.daily/webalizer.pl to /usr/sbin
edit: /etc/logrotate.d/apache
add: /usr/sbin/webalizer.pl
after:
postrotate
/bin/kill -USR1 `cat /var/run/httpd.pid`
this will force a webalizer run right after the logs are splitted bu before they are rotated.
dutchie 03-20-2001, 04:29 AM Originally posted by Félix C.Courtemanche
We have done this, but I do not support nor recommend doign it if you are not sure of what you are doing.
[/B]
The problem is that i have no idea of what i'm doing :)
What if i move webalizer for a day or 2 to cron.hourly ?
Just to see if he hits right at a certain time.
Would that work ?
dutchie 03-20-2001, 07:55 AM or let the raq process the logs more often ?
I just found out the web.log's of these sites are over 37Mb
There must be a solution to this ?
dutchie 03-21-2001, 07:29 AM I increased the diskspace for each site to solve this :(
Webalizer now makes stats for all sites, but it won't run automaticly, only by hand.
Someone a clue on this one ?
Good Questions dutchie!! I am waitting for an answer too ;-)
dutchie 03-22-2001, 06:00 AM Originally posted by Félix C.Courtemanche
We have done this, but I do not support nor recommend doign it if you are not sure of what you are doing.
move: /etc/cron.daily/webalizer.pl to /usr/sbin
edit: /etc/logrotate.d/apache
add: /usr/sbin/webalizer.pl
after:
postrotate
/bin/kill -USR1 `cat /var/run/httpd.pid`
this will force a webalizer run right after the logs are splitted bu before they are rotated.
>Felix,
If i type this in just as you wrote it, will i be ok ?
I don't need a written guarantee, and i won't look you up if it fails :) but i need to try something !
(It turns out webalizer does not always even work if i run it by hand).
Starhost 03-22-2001, 08:03 AM I did it ands it works fine for me (atleast for the moment :):))
Chicken 03-22-2001, 10:28 AM You'll be ok. All this is doing, is taking webalizer *out* of a daily timed run and switching it to run based on when the logs actually rotate (which actually seems like a better idea anyhow). I might switch mine to this, although I don't have any problems (there's that- 'if it ain't broke...' thing).
Starhost 03-22-2001, 10:44 AM Will webalizer run everyday though?
Chicken 03-22-2001, 10:56 AM I believe the logs rotate daily, though there is also a 2MB limit which it will rotate at as well.
dutchie 03-22-2001, 06:59 PM Thanks for helping me out here.
dutchie 03-22-2001, 07:07 PM Uhm ehh (blush)
How do i edit apache ?
When i download it first to my computer, i get a mesh.
Editing true my FTP prog don't work.
dutchie 03-22-2001, 07:22 PM Nevermind, i discovered Pico :)
dutchie 03-23-2001, 08:31 AM Well after all this..it still won't work :(
It seems my logs just won't rotate, i have logs as big as 38 mb !
How can i check if cron is running ?
And could i move logrotate from cron.daily to cron.quarterdaily?
|