Here's my 0.02 on this one (good post btw).
I'm rather intense on data. I want to know what's going where and how much of it. So, managed to update MRTG configs to do (somewhat) what I'm after . Here's what this one will do:
Exim Additions:
Track Spam blocks
Track SpamCop blocks (they're usually the top blockers, but I like to know how much the rest is keeping track of).
Track Rejected email.
Other Additions:
Track Drive space (big one here!!:))
Track Apache Stats (busy/idle/uptime/hits/averages)
For Exim:
in /etc/mrtg/system, add
if [ "$TYPE" = "mail1" ]; then
INDATA=`grep "not permitted" /var/log/exim_rejectlog -c`
OUTDATA=`grep "verify fail" /var/log/exim_rejectlog -c`
fi
if [ "$TYPE" = "mailstats" ]; then
INDATA=`grep "<=" /var/log/exim_mainlog -c`
OUTDATA=`grep "=>" /var/log/exim_mainlog -c`
fi
if [ "$TYPE" = "mailblocked" ]; then
INDATA=`grep "H=" /var/log/exim_rejectlog -c`
OUTDATA=`grep "viruses" /var/log/exim_mainlog -c`
fi
if [ "$TYPE" = "mailspam" ]; then
INDATA=`grep "ISP" /var/log/exim_rejectlog -c`
OUTDATA=`grep "bl.spamcop" /var/log/exim_rejectlog -c`
fi
I'll cover all the mrtg.cfg additions later on in the post.
For Drives:
create a file called /etc/mrtg/drivestats.sh and put the following in it:
#!/bin/sh
df="/bin/df"
cut="/usr/bin/cut"
grep="/bin/grep"
part=$1
line=`$df -m -x nfs| grep "$part"`
libre=`echo $line|$cut -d" " -f 2`
utilise=`echo $line|$cut -d" " -f 3`
size=`mmcalc $libre/1024 | cut -d '=' -f2`
free=`mmcalc $utilise/1024 | cut -d '=' -f2`
echo $size
echo $free
For Webserver/Apache (please note: you MUST have server-status set to allow localhost for this to work in httpd.conf, and it MUST be running!)
Create a file called /etc/mrtg/webstat.pl
In there, add:
#!/usr/bin/perl
# depends on availability of status and extended status info from your
# Apache webserver -- your httpd.conf needs to include something like the
# following: (uncommented)
#<Location /server-status>
# SetHandler server-status
# Order allow,deny
# Allow from localhost
#</Location>
#ExtendedStatus On
# can return hits or bytes (counters)
@res = `lynx -dump http://localhost:80/server-status`;
foreach $res (@res) {
if ($res =~ /Server uptime: (.*)$/) { $up = $1; last } else { next }
if ($res =~ /Server at/) { $server = $res; last } else { next }
}
@res = `lynx -dump http://localhost:80/server-status?auto`;
foreach $res (@res) {
if ($res =~ /Total Accesses: (\d+)/) { $d1 = $1; next }
if ($res =~ /Total kBytes: (\d+)/) { $d2 = $1 / 1024; next }
if ($res =~ /BusyServers: (\d+)/) { $d3 = $1; next }
if ($res =~ /IdleServers: (\d+)/) { $d4 = $1; next }
if ($res =~ /ReqPerSec: (\d+)/) { $d5 = $1; next }
if ($res =~ /BytesPerSec: (\d+)/) { $d6 = $1; next }
if ($res =~ /BytesPerReq: (\d+)/) { $d7 = $1; next }
if ($res =~ /Uptime: (\d+)/) { $d8 = $1 / 60; next }
}
$d1 = int($d1);
$d2 = int($d2);
$d3 = int($d3);
d4 = int($d4);
$d5 = int($d5);
$d6 = int($d6);
$d7 = int($d7);
$d8 = int($d8 / 60);
if ($ARGV[0] eq "hits") {
print "$d1\n";
}
if ($ARGV[0] eq "bytes") {
print "$d2\n";
print "$d2\n";
}
if ($ARGV[0] eq "status") {
print "$d3\n";
print "$d4\n";
}
if ($ARGV[0] eq "busy") {
print "$d3\n";
}
if ($ARGV[0] eq "idle") {
print "$d4\n";
}
if ($ARGV[0] eq "rps") {
print "$d5\n";
}
if ($ARGV[0] eq "bps") {
print "$d6\n";
}
if ($ARGV[0] eq "bpr") {
print "$d7\n";
}
if ($ARGV[0] eq "uptime") {
print "$d8\n";
print "$d8\n";
print "$d8\n";
}
#print "$up\n";
#print "$server";
from shell, type the following (as root):
chmod a+x /etc/mrtg/webstats.pl
chmod a+x /etc/mrtg/drivestats.sh
and add the following to /etc/mrtg/system:
if [ "$TYPE" = "webhits" ]; then
INDATA=`/etc/mrtg/webstat.pl hits`
OUTDATA=`/etc/mrtg/webstat.pl hits `
fi
if [ "$TYPE" = "bytes2" ]; then
INDATA=`/etc/mrtg/webstat.pl bps`
OUTDATA=`/etc/mrtg/webstat.pl bpr `
LEGEND1=`/etc/mrtg/webstat.pl rps `
fi
if [ "$TYPE" = "webservers" ]; then
INDATA=`/etc/mrtg/webstat.pl busy`
OUTDATA=`/etc/mrtg/webstat.pl idle `
fi
Now, for the nuts and bolts of it all. At the top of mrtg.cfg, with the other file links, add:
<tr><td class="tableh">Apache Stats</td></tr><tr><td class="tablesh">
<a href=apache.html>- Apache Hits</a><br><a href=apache_up.html>- Apache Uptime</a><br>
<a href=apache_busy.html>- Server Status (Idle/Busy)</a><br>
<a href=apache_bytes2.html>- Data Breakdown (Bytes)</a><br><a href=apache_bytes.html>- Total Data Processed
</a><td> </td></tr>
<tr><td class="tableh">Exim Stats</td></tr><tr><td class="tablesh">
<a href=spam.html>- Spam Blocked</a><br><a href=rejected.html>- Other Rejected</a>
<br><a href=smtp.html>- SMTP Connections</a><br>
<a href=rejected2.html>- Viruses/Other Rejected</a><br><tr><td> </td></tr>
Tweak the following for YOUR server
<tr><td class="tableh">Drive Stats</td>
</tr><tr><td class="tablesh"><a href=hda1.html>- / </a><br>
<a href=hda2.html>- /var </a><br> <a href=hda4.html>- /home<br>
<a href=hdb1.html>- /backup</td></tr><tr><td> </td></tr>
Remember, ALL of the above must fit in one line. It's a VERY long line, but it must ALL fit there!! It can be done though, because I've done it myself.
Now, at the bottom (or somewhere near there) of mrtg.cfg, add:
Target[apache_up]: `/etc/mrtg/webstat.pl uptime`
Title[apache_up]: Apache Uptime
PageTop[apache_up]: Hours
YLegend[apache_up]: Hours
ShortLegend[apache_up]: Hours
LegendI[apache_up]: Uptime
LegendO[apache_up]: Uptime
Legend1[apache_up]: Uptime
Legend2[apache_up]: Uptime
#---------Apache uptime-----------------------
Target[apache_busy]: `/etc/mrtg/webstat.pl status`
YLegend[apache_busy]: Servers
ShortLegend[apache_busy]: Servers
LegendI[apache_busy]: Busy :
LegendO[apache_busy]: Idle :
Legend1[apache_busy]: Busy Servers
Legend2[apache_busy]: Idle Servers
Title[apache_busy]: Servers (Busy/Idle)
PageTop[apache_busy]: Servers (Busy/Idle)
#------------End Apache Hits------------------
#---------Apache uptime-----------------------
Target[apache_bytes2]: `/etc/mrtg/system bytes2`
YLegend[apache_bytes2]: Bytes
ShortLegend[apache_bytes2]: Bytes
LegendI[apache_bytes2]: Per Second
LegendO[apache_bytes2]: Per Request
Legend1[apache_bytes2]: Requests Per Second
Legend2[apache_bytes2]: Bytes Per Request
Title[apache_bytes2]: Byte Data
PageTop[apache_bytes2]: Byte Data
#------------End Apache Hits------------------
#---------Apache hits-----------------------
Title[apache]: Apache Webhits
Target[apache]: `/etc/mrtg/system webhits`
YLegend[apache]: Total Hits
ShortLegend[apache]: Total Hits
LegendI[apache]: Hits
LegendO[apache]: Hits
Legend1[apache]: Total Hits
Legend2[apache]: Total Hits
#------------End Apache Hits------------------
#---------Apache traffic-----------------------
Target[apache_bytes]: `/etc/mrtg/webstat.pl bytes`
YLegend[apache_bytes]: Bytes
ShortLegend[apache_bytes]: Meg
LegendI[apache_bytes]:
LegendO[apache_bytes]: Apache Traffic:
Legend1[apache_bytes]: Apache Traffic:
Legend2[apache_bytes]: Apache Traffic:
Title[apache_bytes]: WebServer Traffic
PageTop[apache_bytes]: APACHE TRAFFIC
#------------End Apache Traffic------------------
#exim stats
Target[smtp]: `/etc/mrtg/system mailstats`
Title[smtp]: Total Connections
PageTop[smtp]: Total Connections
ShortLegend[smtp]:
YLegend[smtp]: Total connections
LegendI[smtp]: Incoming
LegendO[smtp]: Outgoing
Legend1[smtp]: Messages
Legend2[smtp]:
#exim stats
Target[spam]: `/etc/mrtg/system mailspam`
Title[spam]: Total Spam Blocks
PageTop[spam]: Total Spam Blocks
ShortLegend[spam]:
YLegend[spam]: Total Blocked
LegendI[spam]: Spam Blocked
LegendO[spam]: Spamcop Blocked
Legend1[spam]: Messaages
Legend2[spam]:
#exim stats
Target[rejected]: `/etc/mrtg/system mail1`
Title[rejected]: Rejected Mail
PageTop[rejected]: Total Relays Rejected
ShortLegend[rejected]:
YLegend[rejected]: Rejected Mail
LegendI[rejected]: Relays Rejected
LegendO[rejected]: Auth Fail
Legend1[rejected]: Messaages
Legend2[rejected]:
#exim stats
Target[rejected2]: `/etc/mrtg/system mailblocked`
Title[rejected2]: Rejected Mail
PageTop[rejected2]: Rejected Mail
ShortLegend[rejected2]:
YLegend[rejected2]: Rejected Mail
LegendI[rejected2]: Total Blocked
LegendO[rejected2]: Viruses Blocked
Legend1[rejected2]: Messaages
Legend2[rejected2]:
Confused yet? Well, you're about there. Now, configure this code to your liking, and add it at the bottom of mrtg.cfg
#---------/dev/hda1-----------------------
Target[hda1]: `/etc/mrtg/drivestats.sh hda1`
Options[hda1]: nopercent, growright, noinfo,gauge
Colours[hda1]: GREEN#008080,RED#FF0000,GREEN#008080,RED#FF0000
Title[hda1]: disk usage for /
PageTop[hda1]: disk usage for /
ShortLegend[hda1]: Gig
YLegend[hda1]: Gig
LegendI[hda1]: Drive Space:
LegendO[hda1]: Used Space:
Legend1[hda1]: Drive Space:
Legend2[hda1]: Used Space:
#---------/dev/hda2-----------------------
For message length, I only put ONE of my drives up as an example, but you can do the homework from there.
Wanna see it in action? Check here (http://64.62.140.27/mrtg/index.cgi/index.html).
Enjoy
<edit>signature removed</edit>
