Web Hosting Talk







View Full Version : System backup utility


rfxn
03-02-2003, 07:46 PM
I have just completed version 0.8 of my SysBK utility. It is a backup utility designed primarily for Ensim webppliance systems however the modular nature allows for the Ensim backup feature to be disabled. Use of the other backup operations such as HTTP, Bind DNS, mySQL are easily configurable via an informative config file. Advanced mySQL backup features including MYI/ISM database checks to validate db integrity.

Download:
http://www.r-fx.net/downloads/sysbk-0.8.tar.gz

Summary of features:
- All backup operations have a companion .md5 file with md5sum of the original files
- Backup size calculation - compared against availible disk space to avoid out-of-space issues on a given mount point.
- Configurable load-level threshold for performing backup operations
- Priority queing of backup operations to reduce run-time load level
- Configurable max-size threshold for backup path to keep all backups below the threshold amount of space
- HTTP Configuration backup
- 3-stage Bind DNS backup [2 stage for non-ensim]
- 3-stage MySQL backup with MYI/ISM check, mysqldump of all databases to individual .sql files, and master backup of mysql db path
- Ensim virtual host backup with custom pickle.py dictionary file
- And much more...

Changelog summary since 0.5:
- All operations now seperated by service name in backup path, e.g: /home/backups/$DATE/apache
- More error checking added and trap option set to intercept CTRL+C/perform cleanup operations before exiting
- Removed RAM check feature
- Mysql backup operations changed to do a full .tar.gz backup of the mysql install path, then MYI/ISM check of all databases , and a mysqldump to .sql file of all databases [including main mysql db]. There-in the .sql files are tared/gziped.
- Fixed bug in md5sum usage on some operations
- Changed primary archive utility to tar -chzf [and extention setting to tar.gz], leaves secondary archive utility free for use by such things as bzip2
- Fixed problem with cleanup operations and tmp files
- Rewrote ensim backup feature to use the vhbackup utility, [md5 sums of vhbackup created archives not yet implamented], modified pickle.py file for use without FTP'ing of backups
- Added further permission restrictions
- Added feature to check for SIM/Disable it during backup operations
- CTRL+C trap modified to check if mysql is offline, if so it starts mysql before exiting
- And much more...

Features yet to be completed are mainly the md5sum of vhbackup operations and remote ftp upload of backups.

alapo
03-02-2003, 09:09 PM
Great script :). Going to try it out in a few days. If you're familiar with the rackshack forums, I'm sure you know rfxn :D.

He also writes SIM, a great service monitor utility we use on our servers. It's great :).

UH-Matt
03-03-2003, 05:12 AM
Woo!

So if we have the backup this script creates.. then the server dies.

How easy is it to restore to a completely new server and get all the virtual sites back up etc... ?

rfxn
03-03-2003, 05:39 AM
The ensim virtual domain backups created by Sysbk are compatible with the Ensim Restore feature in the Appliance Admin section, so it is a snap to restore sites.

DigiCrime
03-03-2003, 05:45 AM
Originally posted by alapo
Great script :). Going to try it out in a few days. If you're familiar with the rackshack forums, I'm sure you know rfxn :D.

He also writes SIM, a great service monitor utility we use on our servers. It's great :).

SIM? System Integrity monitor? I use that over logsentry, I like it WAY better, if thats what your reffering to. :D

rfxn
03-03-2003, 05:56 AM
Yes that is what alapro was refering too. :penguin:

swervin
04-02-2004, 08:00 AM
Are you still around? I see the link to the site for your script isn't. Hope all is well.
Can you email the script to me or post where it can be gotten?
Does anyone know where to get this script? It looks awesome!

Swervin