Results 1 to 3 of 3
  1. #1
    Join Date
    Apr 2005
    Posts
    537

    Mysql Backup Edits

    hello,
    im currently running the shell script below on my server to backup the databases every 6 hours (couple of fairly mission critical sites so need recent backups) via a cron job, the script works fine but i keep havign to login and delete old backups every week or two as the script just constantly add new ones, what edit could i make to just have the script leave say 2 days worth of backups per database (so 4 files) ?

    Code:
    #!/bin/bash
    
    
    # Username to access the MySQL server e.g. dbuser
    USERNAME=****
    
    # Username to access the MySQL server e.g. password
    PASSWORD=****
    
    # Host name (or IP address) of MySQL server e.g localhost
    DBHOST=****
    
    # List of DBNAMES for Daily/Weekly Backup e.g. "DB1 DB2 DB3"
    DBNAMES="all"
    
    # Backup directory location e.g /backups
    BACKUPDIR="/sqlback"
    
    # Mail setup
    # What would you like to be mailed to you?
    # - log   : send only log file
    # - files : send log file and sql files as attachments (see docs)
    # - stdout : will simply output the log to the screen if run manually.
    # - quiet : Only send logs if an error occurs to the MAILADDR.
    MAILCONTENT="quiet"
    
    # Set the maximum allowed email size in k. (4000 = approx 5MB email [see docs])
    MAXATTSIZE="4000"
    
    # Email Address to send mail to? (user@domain.com)
    MAILADDR="***"
    
    
    # ============================================================
    # === ADVANCED OPTIONS ( Read the doc's below for details )===
    #=============================================================
    
    # List of DBBNAMES for Monthly Backups.
    MDBNAMES="mysql $DBNAMES"
    
    # List of DBNAMES to EXLUCDE if DBNAMES are set to all (must be in " quotes)
    DBEXCLUDE=""
    
    # Include CREATE DATABASE in backup?
    CREATE_DATABASE=yes
    
    # Separate backup directory and file for each DB? (yes or no)
    SEPDIR=yes
    
    # Which day do you want weekly backups? (1 to 7 where 1 is Monday)
    DOWEEKLY=6
    
    # Choose Compression type. (gzip or bzip2)
    COMP=gzip
    
    # Compress communications between backup server and MySQL server?
    COMMCOMP=no
    
    # Additionally keep a copy of the most recent backup in a seperate directory.
    LATEST=no
    
    #  The maximum size of the buffer for client/server communication. e.g. 16MB (maximum is 1GB)
    MAX_ALLOWED_PACKET=
    
    #  For connections to localhost. Sometimes the Unix socket file must be specified.
    SOCKET=
    
    # Command to run before backups (uncomment to use)
    #PREBACKUP="/etc/mysql-backup-pre"
    
    # Command run after backups (uncomment to use)
    #POSTBACKUP="/etc/mysql-backup-post"
    
    #=====================================================================
    PATH=/usr/local/bin:/usr/bin:/bin:/usr/local/mysql/bin 
    DATE=`date +%Y-%m-%d_%Hh%Mm`				# Datestamp e.g 2002-09-21
    DOW=`date +%A`							# Day of the week e.g. Monday
    DNOW=`date +%u`						# Day number of the week 1 to 7 where 1 represents Monday
    DOM=`date +%d`							# Date of the Month e.g. 27
    M=`date +%B`							# Month e.g January
    W=`date +%V`							# Week Number e.g 37
    VER=2.5									# Version Number
    LOGFILE=$BACKUPDIR/$DBHOST-`date +%N`.log		# Logfile Name
    LOGERR=$BACKUPDIR/ERRORS_$DBHOST-`date +%N`.log		# Logfile Name
    BACKUPFILES=""
    OPT="--quote-names --opt"			# OPT string for use with mysqldump ( see man mysqldump )
    
    # Add --compress mysqldump option to $OPT
    if [ "$COMMCOMP" = "yes" ];
    	then
    		OPT="$OPT --compress"
    	fi
    
    # Add --compress mysqldump option to $OPT
    if [ "$MAX_ALLOWED_PACKET" ];
    	then
    		OPT="$OPT --max_allowed_packet=$MAX_ALLOWED_PACKET"
    	fi
    
    # Create required directories
    if [ ! -e "$BACKUPDIR" ]		# Check Backup Directory exists.
    	then
    	mkdir -p "$BACKUPDIR"
    fi
    
    if [ ! -e "$BACKUPDIR/daily" ]		# Check Daily Directory exists.
    	then
    	mkdir -p "$BACKUPDIR/daily"
    fi
    
    if [ ! -e "$BACKUPDIR/weekly" ]		# Check Weekly Directory exists.
    	then
    	mkdir -p "$BACKUPDIR/weekly"
    fi
    
    if [ ! -e "$BACKUPDIR/monthly" ]	# Check Monthly Directory exists.
    	then
    	mkdir -p "$BACKUPDIR/monthly"
    fi
    
    if [ "$LATEST" = "yes" ]
    then
    	if [ ! -e "$BACKUPDIR/latest" ]	# Check Latest Directory exists.
    	then
    		mkdir -p "$BACKUPDIR/latest"
    	fi
    eval rm -fv "$BACKUPDIR/latest/*"
    fi
    
    # IO redirection for logging.
    touch $LOGFILE
    exec 6>&1           # Link file descriptor #6 with stdout.
                        # Saves stdout.
    exec > $LOGFILE     # stdout replaced with file $LOGFILE.
    touch $LOGERR
    exec 7>&2           # Link file descriptor #7 with stderr.
                        # Saves stderr.
    exec 2> $LOGERR     # stderr replaced with file $LOGERR.
    
    
    # Functions
    
    # Database dump function
    dbdump () {
    mysqldump --user=$USERNAME --password=$PASSWORD --host=$DBHOST $OPT $1 > $2
    return 0
    }
    
    # Compression function plus latest copy
    SUFFIX=""
    compression () {
    if [ "$COMP" = "gzip" ]; then
    	gzip -f "$1"
    	echo
    	echo Backup Information for "$1"
    	gzip -l "$1.gz"
    	SUFFIX=".gz"
    elif [ "$COMP" = "bzip2" ]; then
    	echo Compression information for "$1.bz2"
    	bzip2 -f -v $1 2>&1
    	SUFFIX=".bz2"
    else
    	echo "No compression option set, check advanced settings"
    fi
    if [ "$LATEST" = "yes" ]; then
    	cp $1$SUFFIX "$BACKUPDIR/latest/"
    fi	
    return 0
    }
    
    
    # Run command before we begin
    if [ "$PREBACKUP" ]
    	then
    	echo ======================================================================
    	echo "Prebackup command output."
    	echo
    	eval $PREBACKUP
    	echo
    	echo ======================================================================
    	echo
    fi
    
    
    if [ "$SEPDIR" = "yes" ]; then # Check if CREATE DATABSE should be included in Dump
    	if [ "$CREATE_DATABASE" = "no" ]; then
    		OPT="$OPT --no-create-db"
    	else
    		OPT="$OPT --databases"
    	fi
    else
    	OPT="$OPT --databases"
    fi
    
    # Hostname for LOG information
    if [ "$DBHOST" = "localhost" ]; then
    	HOST=`hostname`
    	if [ "$SOCKET" ]; then
    		OPT="$OPT --socket=$SOCKET"
    	fi
    else
    	HOST=$DBHOST
    fi
    
    # If backing up all DBs on the server
    if [ "$DBNAMES" = "all" ]; then
            DBNAMES="`mysql --user=$USERNAME --password=$PASSWORD --host=$DBHOST --batch --skip-column-names -e "show databases"| sed 's/ /%/g'`"
    
    	# If DBs are excluded
    	for exclude in $DBEXCLUDE
    	do
    		DBNAMES=`echo $DBNAMES | sed "s/\b$exclude\b//g"`
    	done
    
            MDBNAMES=$DBNAMES
    fi
    	
    echo ======================================================================
    echo AutoMySQLBackup VER $VER
    echo http://sourceforge.net/projects/automysqlbackup/
    echo 
    echo Backup of Database Server - $HOST
    echo ======================================================================
    
    # Test is seperate DB backups are required
    if [ "$SEPDIR" = "yes" ]; then
    echo Backup Start Time `date`
    echo ======================================================================
    	# Monthly Full Backup of all Databases
    	if [ $DOM = "01" ]; then
    		for MDB in $MDBNAMES
    		do
     
    			 # Prepare $DB for using
    		        MDB="`echo $MDB | sed 's/%/ /g'`"
    
    			if [ ! -e "$BACKUPDIR/monthly/$MDB" ]		# Check Monthly DB Directory exists.
    			then
    				mkdir -p "$BACKUPDIR/monthly/$MDB"
    			fi
    			echo Monthly Backup of $MDB...
    				dbdump "$MDB" "$BACKUPDIR/monthly/$MDB/${MDB}_$DATE.$M.$MDB.sql"
    				compression "$BACKUPDIR/monthly/$MDB/${MDB}_$DATE.$M.$MDB.sql"
    				BACKUPFILES="$BACKUPFILES $BACKUPDIR/monthly/$MDB/${MDB}_$DATE.$M.$MDB.sql$SUFFIX"
    			echo ----------------------------------------------------------------------
    		done
    	fi
    
    	for DB in $DBNAMES
    	do
    	# Prepare $DB for using
    	DB="`echo $DB | sed 's/%/ /g'`"
    	
    	# Create Seperate directory for each DB
    	if [ ! -e "$BACKUPDIR/daily/$DB" ]		# Check Daily DB Directory exists.
    		then
    		mkdir -p "$BACKUPDIR/daily/$DB"
    	fi
    	
    	if [ ! -e "$BACKUPDIR/weekly/$DB" ]		# Check Weekly DB Directory exists.
    		then
    		mkdir -p "$BACKUPDIR/weekly/$DB"
    	fi
    	
    	# Weekly Backup
    	if [ $DNOW = $DOWEEKLY ]; then
    		echo Weekly Backup of Database \( $DB \)
    		echo Rotating 5 weeks Backups...
    			if [ "$W" -le 05 ];then
    				REMW=`expr 48 + $W`
    			elif [ "$W" -lt 15 ];then
    				REMW=0`expr $W - 5`
    			else
    				REMW=`expr $W - 5`
    			fi
    
    		echo
    			dbdump "$DB" "$BACKUPDIR/weekly/$DB/${DB}_week.$W.$DATE.sql"
    			compression "$BACKUPDIR/weekly/$DB/${DB}_week.$W.$DATE.sql"
    			BACKUPFILES="$BACKUPFILES $BACKUPDIR/weekly/$DB/${DB}_week.$W.$DATE.sql$SUFFIX"
    		echo ----------------------------------------------------------------------
    	
    	# Daily Backup
    	else
    		echo Daily Backup of Database \( $DB \)
    		echo Rotating last weeks Backup...
    
    		echo
    			dbdump "$DB" "$BACKUPDIR/daily/$DB/${DB}_$DATE.$DOW.sql"
    			compression "$BACKUPDIR/daily/$DB/${DB}_$DATE.$DOW.sql"
    			BACKUPFILES="$BACKUPFILES $BACKUPDIR/daily/$DB/${DB}_$DATE.$DOW.sql$SUFFIX"
    		echo ----------------------------------------------------------------------
    	fi
    	done
    echo Backup End `date`
    echo ======================================================================
    
    
    else # One backup file for all DBs
    echo Backup Start `date`
    echo ======================================================================
    	# Monthly Full Backup of all Databases
    	if [ $DOM = "01" ]; then
    		echo Monthly full Backup of \( $MDBNAMES \)...
    			dbdump "$MDBNAMES" "$BACKUPDIR/monthly/$DATE.$M.all-databases.sql"
    			compression "$BACKUPDIR/monthly/$DATE.$M.all-databases.sql"
    			BACKUPFILES="$BACKUPFILES $BACKUPDIR/monthly/$DATE.$M.all-databases.sql$SUFFIX"
    		echo ----------------------------------------------------------------------
    	fi
    
    	# Weekly Backup
    	if [ $DNOW = $DOWEEKLY ]; then
    		echo Weekly Backup of Databases \( $DBNAMES \)
    		echo
    		echo Rotating 5 weeks Backups...
    			if [ "$W" -le 05 ];then
    				REMW=`expr 48 + $W`
    			elif [ "$W" -lt 15 ];then
    				REMW=0`expr $W - 5`
    			else
    				REMW=`expr $W - 5`
    			fi
    		
    		echo
    			dbdump "$DBNAMES" "$BACKUPDIR/weekly/week.$W.$DATE.sql"
    			compression "$BACKUPDIR/weekly/week.$W.$DATE.sql"
    			BACKUPFILES="$BACKUPFILES $BACKUPDIR/weekly/week.$W.$DATE.sql$SUFFIX"
    		echo ----------------------------------------------------------------------
    		
    	# Daily Backup
    	else
    		echo Daily Backup of Databases \( $DBNAMES \)
    		echo
    		echo Rotating last weeks Backup...
    		 
    		echo
    			dbdump "$DBNAMES" "$BACKUPDIR/daily/$DATE.$DOW.sql"
    			compression "$BACKUPDIR/daily/$DATE.$DOW.sql"
    			BACKUPFILES="$BACKUPFILES $BACKUPDIR/daily/$DATE.$DOW.sql$SUFFIX"
    		echo ----------------------------------------------------------------------
    	fi
    echo Backup End Time `date`
    echo ======================================================================
    fi
    echo Total disk space used for backup storage..
    echo Size - Location
    echo `du -hs "$BACKUPDIR"`
    echo
    echo ======================================================================
    echo If you find AutoMySQLBackup valuable please make a donation at
    echo http://sourceforge.net/project/project_donations.php?group_id=101066
    echo ======================================================================
    
    # Run command when we're done
    if [ "$POSTBACKUP" ]
    	then
    	echo ======================================================================
    	echo "Postbackup command output."
    	echo
    	eval $POSTBACKUP
    	echo
    	echo ======================================================================
    fi
    
    #Clean up IO redirection
    exec 1>&6 6>&-      # Restore stdout and close file descriptor #6.
    exec 1>&7 7>&-      # Restore stdout and close file descriptor #7.
    
    if [ "$MAILCONTENT" = "files" ]
    then
    	if [ -s "$LOGERR" ]
    	then
    		# Include error log if is larger than zero.
    		BACKUPFILES="$BACKUPFILES $LOGERR"
    		ERRORNOTE="WARNING: Error Reported - "
    	fi
    	#Get backup size
    	ATTSIZE=`du -c $BACKUPFILES | grep "[[:digit:][:space:]]total$" |sed s/\s*total//`
    	if [ $MAXATTSIZE -ge $ATTSIZE ]
    	then
    		BACKUPFILES=`echo "$BACKUPFILES" | sed -e "s# # -a #g"`	#enable multiple attachments
    		mutt -s "$ERRORNOTE MySQL Backup Log and SQL Files for $HOST - $DATE" $BACKUPFILES $MAILADDR < $LOGFILE		#send via mutt
    	else
    		cat "$LOGFILE" | mail -s "WARNING! - MySQL Backup exceeds set maximum attachment size on $HOST - $DATE" $MAILADDR
    	fi
    elif [ "$MAILCONTENT" = "log" ]
    then
    	cat "$LOGFILE" | mail -s "MySQL Backup Log for $HOST - $DATE" $MAILADDR
    	if [ -s "$LOGERR" ]
    		then
    			cat "$LOGERR" | mail -s "ERRORS REPORTED: MySQL Backup error Log for $HOST - $DATE" $MAILADDR
    	fi	
    elif [ "$MAILCONTENT" = "quiet" ]
    then
    	if [ -s "$LOGERR" ]
    		then
    			cat "$LOGERR" | mail -s "ERRORS REPORTED: MySQL Backup error Log for $HOST - $DATE" $MAILADDR
    			cat "$LOGFILE" | mail -s "MySQL Backup Log for $HOST - $DATE" $MAILADDR
    	fi
    else
    	if [ -s "$LOGERR" ]
    		then
    			cat "$LOGFILE"
    			echo
    			echo "###### WARNING ######"
    			echo "Errors reported during AutoMySQLBackup execution.. Backup failed"
    			echo "Error log below.."
    			cat "$LOGERR"
    	else
    		cat "$LOGFILE"
    	fi	
    fi
    
    if [ -s "$LOGERR" ]
    	then
    		STATUS=1
    	else
    		STATUS=0
    fi
    
    # Clean up Logfile
    eval rm -f "$LOGFILE"
    eval rm -f "$LOGERR"
    
    exit $STATUS
    the script is modified from the automysqlbackup sourceforge project.

    any help appreciated

    thanks

  2. #2
    Join Date
    Oct 2002
    Location
    /roof/ledge
    Posts
    28,089
    Here's a cut from the one I use (shell script, via cron), maybe that will help.
    Code:
    # Get the Day of the Week (0-6)
    # This allows to save one backup for each day of the week
    # Just alter the date command if you want to use a timestamp
    DOW=`date +%w`
    
    # Dump all of our databases
    echo "Dumping MySQL Databases"
    for database in $databases
    do
       $mysqldumpcmd $userpassword $dumpoptions $database > ${backupdir}/${DOW}-${database}.sql
    done
    
    # Compress all of our backup files
    echo "Compressing Dump Files"
    for database in $databases
    do
       rm -f ${backupdir}/${DOW}-${database}.sql.gz
       $gzip ${backupdir}/${DOW}-${database}.sql
    done
    Your one stop shop for decentralization

  3. #3
    Join Date
    Apr 2005
    Location
    India
    Posts
    505
    Maybe you can add a few lines in the script which will run the find command on the backup directory, and delete the files which are modified earlier than 2 days. (+mtime).

    Alternately, you can write down a separate cronjob which can take care of this task once the backup script finish execution.

Similar Threads

  1. Need Help, I moved Mysql from /var to /backup/mysql, mysql is no longer working
    By pcnet21 in forum Hosting Security and Technology
    Replies: 4
    Last Post: 05-09-2009, 01:58 AM
  2. Backup cpanel have problem with backup mysql
    By robocap in forum Hosting Security and Technology
    Replies: 4
    Last Post: 09-01-2008, 11:30 PM
  3. mysql issue - making backup and resoting backup from shell
    By kimrari in forum Hosting Security and Technology
    Replies: 7
    Last Post: 06-24-2003, 01:08 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •