Can anyone please advise on what program will monitor bandwidth as below..
I have a rack in London.
I currently have 5 servers in the rack.
1 of these is a dedicated for a client of mine.
All servers have 2 NIC's. 1 connection goes to a unix firewall (colocation company) and then out to the Internet. The other connection is my local network connecting all 5 servers.
What I need..
I would like to have something running on one central server that monitors the other servers for bandwidth usage.
Dont really want a program running that the dedicated server client can switch off.
Need the program to do a running total of per day, week, month and idealy into a database.
Would like to know which domains are using the most bandwith.
Would like to be able to see with ports are heavily in use.
Anyone have any idea on what I could use and if possible?
There is no doubt an ethernet switch in the picture somewhere. If it is owned and operated by your co-location company, just ask them to setup MRTG-like polling and graphing on your ports, and explain that you want it for your records. It should be very routine for them, and I'm sure they will be happy to help you.
The above will cover your per-box measurements, but you've got questions about utilization per virtual-host or per domain as well. To solve that problem, you need a web log analyzier. You've probably heard of some commercial packages like WebTrends. There are free and useful programs available as well. We use webalizer for all our shared hosting. It gets the job done and is reasonable on CPU & memory consumption (when running, of course -- this is probably not something you need to consider), but there are plenty of other packages you can consider.
If you are already familar with WebTrends and friends, you already have the right tools in your toolbox for per virtual-host analysis. Just take a gander at the total transfers for each virtual-host / "domain."
As far as per-server, if you don't want to ask your co-location provider for that information, your best bet is probably to buy your own SNMP managable switch, connect your servers to that, and uplink it to their switch. This is also very routine, and will allow you to run an MRTG-like poller, grapher, and analyzer yourself. If you don't have the requisite technical skill in-house, there are no doubt plenty of folks on WHT who can help you set this up. AIM or PM me if you need detailed assistance.
I recommend an EBay Cisco 2924, 3548, or if you want layer 3 features, a 3550-24-SMI for your setup. You can buy a consumer grade switch with SNMP management capabilities as well, such as DLINK / Netgear / SMC, but it is called consumer grade for a reason.