Hello Guys,

I had Webalizer 1.3 installed at first. But it stopped working on 15 December so I did some tweaking to it that someone had posted on WHT.

But that also did'nt worked. So I uninstalled 1.3 and installed 2.01, but now I am getting an e-mail everyday with message:


Warning: Truncating oversized referrer field
Warning: Truncating oversized date field
Skipping bad record (108154)
Warning: Truncating oversized request field
Skipping bad record (108440)
Warning: Truncating oversized username
Skipping bad record (108468)
Warning: Truncating oversized date field
Skipping bad record (108706)
Skipping bad record (108733)
Warning: Truncating oversized date field
Skipping bad record (108831)
Warning: Truncating oversized referrer field
Error: Can't change directory to /home/sites/ns1.hostingbetter.com/users/stats/web
Error: Can't change directory to /home/sites/ns2.hostingbetter.com/users/stats/web
Skipping bad record (4035)
Error: Skipping record (bad date): [22/jan/2002:23:22:370] [4066]
Warning: Truncating oversized date field
Skipping bad record (4138)
Warning: Truncating oversized request field
Skipping bad record (13120)
Warning: Truncating oversized date field
Skipping bad record (4564)
Warning: Truncating oversized date field
Skipping bad record (4856)
Error: Skipping record (bad date): [22/jan/2002:09:3 -0700] [4874]
Error: Skipping record (bad date): [23/jan/2002:0:17 -0700] [5338]
Warning: Truncating oversized date field
Error: Skipping record (bad date): [23/jan/2002:02:07:0612:35:5 [5404]
Warning: Truncating oversized request field
Skipping bad record (5596)
Warning: Truncating oversized request field
Skipping bad record (16224)
Warning: Truncating oversized referrer field
Warning: Truncating oversized date field
Skipping bad record (7984)
Error: Can't change directory to /home/sites/ns2.aprilhost.com/users/stats/web
Warning: Truncating oversized date field
Skipping bad record (8300)
Error: Can't change directory to /home/sites/www.aprilhost.com/users/stats/web
Error: Can't open log file /home/sites/www.follow.ru/logs/web.log
Error: Can't open log file /home/sites/www.follow.ru/logs/web.log
Warning: Truncating oversized referrer field
Warning: Truncating oversized referrer field
Skipping bad record (46223)
Warning: Truncating oversized referrer field
Warning: Truncating oversized date field
Skipping bad record (46269)
Warning: Truncating oversized referrer field
Warning: Truncating oversized date field
Skipping bad record (46339)
Warning: Truncating oversized referrer field
Warning: Truncating oversized request field
Skipping bad record (46901)
Skipping bad record (46949)
Warning: Truncating oversized referrer field
Warning: Truncating oversized date field
Skipping bad record (47337)
Warning: Truncating oversized request field
Warning: Truncating oversized date field
Skipping bad record (49486)
Warning: Truncating oversized username
Skipping bad record (49510)
Warning: Truncating oversized username
Skipping bad record (49650)
Warning: Truncating oversized date field
Skipping bad record (49719)
Error: Skipping record (bad date): [23/:13 -0700] [49742]
Warning: Truncating oversized date field
Warning: Truncating oversized referrer field
Warning: Truncating oversized username
Skipping bad record (50019)
Warning: Truncating oversized referrer field
Warning: Truncating oversized date field
Skipping bad record (50374)
Warning: Truncating oversized username
Skipping bad record (50398)
Warning: Truncating oversized date field
Warning: Truncating oversized date field
Skipping bad record (51051)
Warning: Truncating oversized username
Skipping bad record (51122)
Warning: Truncating oversized username
Skipping bad record (51334)
Warning: Truncating oversized username
Skipping bad record (51378)
Warning: Truncating oversized username
Skipping bad record (51425)
Warning: Truncating oversized date field
Skipping bad record (51449)
Warning: Truncating oversized username
Warning: Truncating oversized date field
Skipping bad record (51496)
Skipping bad record (51615)
Warning: Truncating oversized referrer field
Warning: Truncating oversized username
Skipping bad record (52093)
Warning: Truncating oversized referrer field
Skipping bad record (52316)
Skipping bad record (6280)
Warning: Truncating oversized username
Skipping bad record (9215)
Warning: Truncating oversized date field
Skipping bad record (9577)
Error: Can't open log file /home/sites/www.cebratulum.com/logs/web.log
Error: Can't open log file /home/sites/www.cebratulum.com/logs/web.log
Warning: Truncating oversized date field
Skipping bad record (29436)
Skipping bad record (31681)
Warning: Truncating oversized date field
Skipping bad record (32576)
Warning: Truncating oversized date field
Warning: Truncating oversized referrer field
Skipping bad record (33849)
Warning: Truncating oversized referrer field
Warning: Truncating oversized username
Skipping bad record (34265)
Warning: Truncating oversized username
Skipping bad record (1518)
Warning: Truncating oversized date field
Skipping bad record (2189)
Skipping bad record (2626)
Warning: Truncating oversized request field
Skipping bad record (6522)
Skipping bad record (7820)
Warning: Truncating oversized date field
Skipping bad record (7986)
Warning: Truncating oversized referrer field
Skipping bad record (8784)
Warning: Truncating oversized date field
Skipping bad record (10847)
Warning: Truncating oversized username
Skipping bad record (10874)
Warning: Truncating oversized date field
Skipping bad record (13207)
Warning: Truncating oversized username
Skipping bad record (13274)
Warning: Truncating oversized username
Skipping bad record (13573)
Warning: Truncating oversized date field
Skipping bad record (32867)
Warning: Truncating oversized referrer field
Skipping bad record (33197)
Warning: Truncating oversized referrer field
Warning: Truncating oversized hostname
Skipping bad record (34280)
Warning: Truncating oversized request field
Skipping bad record (34604)
Warning: Truncating oversized request field
Skipping bad record (35949)
Warning: Truncating oversized referrer field
Warning: Truncating oversized request field
Skipping bad record (3709)
Error: Can't change directory to /home/sites/ns3.hostingbetter.com/users/stats/web
Warning: Truncating oversized date field
Skipping bad record (140761)
Warning: Truncating oversized username
Skipping bad record (141220)
Warning: Truncating oversized request field
Skipping bad record (142535)
Warning: Truncating oversized username
Skipping bad record (142700)
Warning: Truncating oversized request field
Skipping bad record (142893)
Warning: Truncating oversized date field
Skipping bad record (143229)
Warning: Truncating oversized username
Skipping bad record (143274)
Warning: Truncating oversized request field
Skipping bad record (143474)
Warning: Truncating oversized referrer field
Skipping bad record (143829)
Skipping bad record (143939)
Warning: Truncating oversized username
Skipping bad record (144093)
Warning: Truncating oversized date field
Skipping bad record (144250)
Warning: Truncating oversized date field
Skipping bad record (144320)
Warning: Truncating oversized request field
Skipping bad record (144364)
Skipping bad record (144385)
Warning: Truncating oversized date field
Skipping bad record (145216)
Warning: Truncating oversized date field
Skipping bad record (145281)
Warning: Truncating oversized username
Skipping bad record (145680)
Warning: Truncating oversized username
Skipping bad record (145710)
Warning: Truncating oversized referrer field
Warning: Truncating oversized username
Skipping bad record (145881)
Warning: Truncating oversized date field
Skipping bad record (145944)
Skipping bad record (146316)
Warning: Truncating oversized referrer field
Warning: Truncating oversized username
Skipping bad record (146404)
Warning: Truncating oversized request field
Skipping bad record (146490)
Skipping bad record (146750)
Warning: Truncating oversized date field
Skipping bad record (146794)
Warning: Truncating oversized request field
Skipping bad record (147138)
Warning: Truncating oversized request field
Skipping bad record (147292)
Skipping bad record (147413)
Warning: Truncating oversized date field
Skipping bad record (147457)
Warning: Truncating oversized username
Skipping bad record (147661)
Warning: Truncating oversized date field
Skipping bad record (147706)
Warning: Truncating oversized username
Skipping bad record (147772)
Warning: Truncating oversized request field
Skipping bad record (14762)
Warning: Truncating oversized date field
Skipping bad record (5968)
Warning: Truncating oversized referrer field
Warning: Truncating oversized date field
Skipping bad record (7409)
Warning: Truncating oversized date field
Skipping bad record (7822)
Warning: Truncating oversized request field
Skipping bad record (8563)
Warning: Truncating oversized date field
Skipping bad record (9822)
Warning: Truncating oversized referrer field
Warning: Truncating oversized username
Skipping bad record (1963)
Error: Can't open log file /home/sites/www.25k.net/logs/web.log
Error: Can't open log file /home/sites/www.25k.net/logs/web.log
Error: Can't open log file /home/sites/www.stevendomain.com/logs/web.log
Error: Can't open log file /home/sites/www.stevendomain.com/logs/web.log


Also there are few sites that don't have access to their Stats. I mean they can login to http://www.domain.com/~stats but there is nothing in it (i.e; blank directory). Please help me as soon as possible.


Salam,
-Omair

Re: Warning: Truncating oversized referrer field

I'm sure there is a mention (and fix) of this on the cobalt mailing-list archives. I recall I had that as well, can't remember how I fixed it...


Re:
Error: Can't open log file /home/sites/www.cebratulum.com/logs/web.log
Error: Can't open log file /home/sites/www.cebratulum.com/logs/web.log

This just means there is no log file to read in the directory.

You mentioned, "Also there are few sites that don't have access to their Stats. I mean they can login to http://www.domain.com/~stats but there is nothing in it (i.e; blank directory)."

Every site that doesn't have anything in that dir will be listed above "Error: Can't open log file..." and you should just go (via a web browser) to those URLs a few times (one should do it), which will create a logged entry in access, then be split to the sites' log dirs, and eventually read.

As I said, the "Truncating oversized..." can easily be fixed...

The sites that have blank webalizer directory already have few hundreds of visit daily :)


Salam,
-Omair

i found that if you havent created any users via the cpanel for those sites listed its not going to find logs.

As I told before those sites have few hundred visits already to them. Simply you can't upload any files without creating any users.


Salam,
-Omair

Originally posted by Omair Haroon
The sites that have blank webalizer directory already have few hundreds of visit daily :)
Ahhh, well then let's see if we can figure out whether webalizer or the server's splitlog functions are causing the problem. Go to the site's (sites' if more than one problem), and see what the log files look like, if there are any there, what the dates of the entires are (in other words, determine if there is anything for webalizer to read in the first place). If all of that is current, then the splitlog script is working and the problem is webalizer not reading those logs correctly (or at all in this case).

Edi: i can never remember if the script is splitlog or logsplit and I don't run a RaQ anymore so i can't check. Ignore my mistake if I've switched it above.

Well, I did "ls -l" on those domain logs directories and it shows that logs have not been generated since Jan 26 :(

Any idea why?


Salam,
-Omair

Then webalizer isn't the problem (at least not this problem), there is a problem with the splitlog (errr or whatever) script, or the running of it (supposed to be a cron job), anywhooo something along those lines. Try looking for both logsplit or splitlog at the cobalt archives (as I still can't recall the correct name).

Originally posted by Chicken
Then webalizer isn't the problem (at least not this problem), there is a problem with the splitlog (errr or whatever) script, or the running of it (supposed to be a cron job), anywhooo something along those lines. Try looking for both logsplit or splitlog at the cobalt archives (as I still can't recall the correct name).

As far as I recall, have talked about it withsome from sun. It is about the long URL which are dynamically generated. In newer versions the issue is solved in webalizer. Perhaps you are using version 1.3 and should consider to upgrade to 2.01 or higher.

It is not that hard to do!

No more nasty errors

Rob

I was able to solve the problem anyhow.

Solution:

First of all, in /var/lib/httpd the access_log was greater than 2gb, which should'nt be. So what I did was I renamed the access+log to access_log.old. The new access_log would be created automatically once your site receives even a single hit.

Then I also noticed that there was no entry for webalizer.pl in /etc/logrotate.d/apache so I edited it and inserted webalizer.pl to run before logs are rotated.

Then I ran split_logs and got a few log errors, which were easily solved by deleting them.

Last of all, I ran webalizer.pl and logrotate from the /etc/cron.daily folder. That did it all.


Salam,
-Omair