Web Hosting Talk







View Full Version : Webalizer again?


dutchie
03-17-2001, 10:58 AM
I installed webalizer on my RaQ, and it works fine for most sites except one very busy one.

This particular sites has more then 50.000 hits a day.

What can be the problem ?

Dim8
03-17-2001, 01:00 PM
I think it was Chicken who said that webalizer takes longer to update on the sites that receive a lot of hits. It took webalizer almost 3 days to update the stats of one of the sites on my RaQ3.

Chicken
03-17-2001, 01:08 PM
I've read this before about webalizer, and the problem was with the log rotation. Your logs will rotate depending on two factors: scheduled time, and/or size.

What happens with busy sites is that the large logs are rotated, before webalizer has a chance to read them. I'm not sure what the fix is, if there is a fix, etc., but I believe this is what is happening.

dutchie
03-18-2001, 05:23 AM
I noticed i forgot to install the log-rotate patch from cobalt, i guess this could have something to do with it :)

dutchie
03-19-2001, 04:33 AM
well it still don't work.

When i type in
ls /etc/rc.d/rc3.d/*crond*

i get:
/etc/rc.d/rc3.d/S40crond /etc/rc.d/rc3.d/S40crond.rpmorig

How can i check if webalizer is scheduled to run ?

dutchie
03-19-2001, 04:37 AM
i did crontab -l and got :

# DO NOT EDIT THIS FILE - edit the master and reinstall.
# (/cr0n installed on Tue Feb 13 20:14:47 2001)
# (Cron version -- $Id: crontab.c,v 2.13 1994/01/17 03:20:37 vixie Exp $)
*/5 * * * * /usr/sbin/init

Does this help ?

WreckRman2
03-19-2001, 06:14 AM
I had this problem and it was due to the fact that my /tmp directory wasn't large enough to complete the process.

As a fix I created a /home/tmp directory and then created a soft link from /tmp to /home/tmp

Works now...

dutchie
03-19-2001, 07:29 AM
Ah that sounds like it could be the case.

The sites it isn't working for, are giving quota errors (usedup diskspace).

Can descripe me in detail how to make these dirs and links ?

Thanks !

dutchie
03-19-2001, 06:54 PM
I just had a user with a 80mb space limit, who had only 9mb files on his site, and couldn't upload because he had reached his limit !

Someone please give me a solution.

SI-Chris
03-19-2001, 08:20 PM
Originally posted by dutchie
I just had a user with a 80mb space limit, who had only 9mb files on his site, and couldn't upload because he had reached his limit !

Someone please give me a solution.
Did you check their e-mail usage? Sometimes people set their e-mail clients so they don't delete the messages off the server, and these can accumulate (especially if they're sending photos or other attachments).

dutchie
03-19-2001, 08:26 PM
i just did.

He received 1 mail from 8k.

i have 2 problems
Webalizer don't work for these 2 sites, and they are (sometimes for a short period) out of diskspace.

Félix C.Courtemanche
03-20-2001, 12:33 AM
If webalizer run when they are short of space, it may probably not be able to work properly as the files written must obey to the quota.

Now, as the logs rotate before webalizer run, there is no easy way to solve it.

We have done this, but I do not support nor recommend doign it if you are not sure of what you are doing.

move: /etc/cron.daily/webalizer.pl to /usr/sbin
edit: /etc/logrotate.d/apache
add: /usr/sbin/webalizer.pl
after:
postrotate
/bin/kill -USR1 `cat /var/run/httpd.pid`



this will force a webalizer run right after the logs are splitted bu before they are rotated.

dutchie
03-20-2001, 04:29 AM
Originally posted by Félix C.Courtemanche

We have done this, but I do not support nor recommend doign it if you are not sure of what you are doing.

[/B]

The problem is that i have no idea of what i'm doing :)

What if i move webalizer for a day or 2 to cron.hourly ?
Just to see if he hits right at a certain time.

Would that work ?

dutchie
03-20-2001, 07:55 AM
or let the raq process the logs more often ?

I just found out the web.log's of these sites are over 37Mb

There must be a solution to this ?

dutchie
03-21-2001, 07:29 AM
I increased the diskspace for each site to solve this :(

Webalizer now makes stats for all sites, but it won't run automaticly, only by hand.

Someone a clue on this one ?

jman
03-22-2001, 02:49 AM
Good Questions dutchie!! I am waitting for an answer too ;-)

dutchie
03-22-2001, 06:00 AM
Originally posted by Félix C.Courtemanche


We have done this, but I do not support nor recommend doign it if you are not sure of what you are doing.

move: /etc/cron.daily/webalizer.pl to /usr/sbin
edit: /etc/logrotate.d/apache
add: /usr/sbin/webalizer.pl
after:
postrotate
/bin/kill -USR1 `cat /var/run/httpd.pid`

this will force a webalizer run right after the logs are splitted bu before they are rotated.


>Felix,

If i type this in just as you wrote it, will i be ok ?
I don't need a written guarantee, and i won't look you up if it fails :) but i need to try something !
(It turns out webalizer does not always even work if i run it by hand).

Starhost
03-22-2001, 08:03 AM
I did it ands it works fine for me (atleast for the moment :):))

Chicken
03-22-2001, 10:28 AM
You'll be ok. All this is doing, is taking webalizer *out* of a daily timed run and switching it to run based on when the logs actually rotate (which actually seems like a better idea anyhow). I might switch mine to this, although I don't have any problems (there's that- 'if it ain't broke...' thing).

Starhost
03-22-2001, 10:44 AM
Will webalizer run everyday though?

Chicken
03-22-2001, 10:56 AM
I believe the logs rotate daily, though there is also a 2MB limit which it will rotate at as well.

dutchie
03-22-2001, 06:59 PM
Thanks for helping me out here.

dutchie
03-22-2001, 07:07 PM
Uhm ehh (blush)

How do i edit apache ?
When i download it first to my computer, i get a mesh.

Editing true my FTP prog don't work.

dutchie
03-22-2001, 07:22 PM
Nevermind, i discovered Pico :)

dutchie
03-23-2001, 08:31 AM
Well after all this..it still won't work :(

It seems my logs just won't rotate, i have logs as big as 38 mb !

How can i check if cron is running ?

And could i move logrotate from cron.daily to cron.quarterdaily?