Results 1 to 10 of 10
  1. #1

    cPanel daily backup: Load issues

    Hello,

    I have my WHM/cPanel installation configured with daily and weekly backups. I checked at what time of the day the server load was at the minimum and configured the cPanel backup cron to run then.

    The problem now is: Backing up a few hundred accounts results in a high server load. My server configuration:

    Dual Processor Quad Core Xeon 5335 2.0GHz with 4GB RAM and 2 x 250GB SATA HDD hosted at SoftLayer.

    The accounts are located on the first HDD and the backup archives are placed on the second HDD.

    What can I do about this? I'd like to take daily backups of all accounts but not if my server load increases up to 10... That kind of renders the cPanel backup feature useless if it doesn't even work on a powerful server like this one...

    Would it help if I use an application such as Auto Nice Daemon to give the backup process a lower priority? But then again that won't work on the MySQL dumps? And I think it's not a CPU problem but an I/O wait problem? Other processes have to wait for disk access because the disk-intensive backup process is running?

    Any other suggestions?

    Thanks!

  2. #2
    Join Date
    Oct 2004
    Location
    Kerala, India
    Posts
    4,771
    You can set least priority to the process by altering the backup cron command as follows

    nice -n 19 /scripts/cpbackup
    David | www.cliffsupport.com
    Affordable Server Management Solutions sales AT cliffsupport DOT com
    CliffWebManager | Access WHM from iPhone and Android

  3. #3
    Quote Originally Posted by david510 View Post
    You can set least priority to the process by altering the backup cron command as follows

    nice -n 19 /scripts/cpbackup
    Some questions:
    - Will lowering the priority of this script actually resolve the issue?
    - Will other processes spawn by the cpbackup script also run with lower priority? For example the gzip command that is executed to package the archive in a .gz file.
    - This won't have any effect on the MySQL dump process, right? That one will still run with regular MySQL priority?

  4. #4
    Join Date
    Oct 2004
    Location
    Kerala, India
    Posts
    4,771
    Yes, all process spawned by the process will run with least priority. No other process will be affected.
    David | www.cliffsupport.com
    Affordable Server Management Solutions sales AT cliffsupport DOT com
    CliffWebManager | Access WHM from iPhone and Android

  5. #5
    Join Date
    Sep 2002
    Location
    Top Secret
    Posts
    14,135
    While nice might help the issue, there are other things that will help more.

    Firstly, have your users remove mail from the system. I've seen cases where users literally have thousands of (unread or read) mails on the system. This adds a great deal of time. Mail should never be stored 'on the server', always on the local PC.

    Secondly, do NOT use compression for backups. Compression is THE #1 reason your backup is slowing down, because it is going to just kill your server with load.

    Thirdly, move the larger accounts to their own server. Charge them more to make up for it, but move them off. This will reduce the load, and actual copy time.
    Tom Whiting, WHMCS Guru extraordinaire
    Linux problems? WHMCS Problems? Give me a shout
    Check out my WHMCS Addons

  6. #6
    Quote Originally Posted by linux-tech View Post
    While nice might help the issue, there are other things that will help more.

    Firstly, have your users remove mail from the system. I've seen cases where users literally have thousands of (unread or read) mails on the system. This adds a great deal of time. Mail should never be stored 'on the server', always on the local PC.

    Secondly, do NOT use compression for backups. Compression is THE #1 reason your backup is slowing down, because it is going to just kill your server with load.

    Thirdly, move the larger accounts to their own server. Charge them more to make up for it, but move them off. This will reduce the load, and actual copy time.
    Thanks for the advice. Though how do you force users to remove mail from the server? I keep all my emails hosted on the server myself since I'm using IMAP on multiple locations. This is a great advantage.

    About compression: Unless you use the incremental cPanel backup method, it's always compressed with GZIP as far as I can tell... Correct me if I'm wrong.

  7. #7
    Join Date
    Sep 2002
    Location
    Top Secret
    Posts
    14,135
    About compression: Unless you use the incremental cPanel backup method, it's always compressed with GZIP as far as I can tell... Correct me if I'm wrong.
    then use incremental
    Tom Whiting, WHMCS Guru extraordinaire
    Linux problems? WHMCS Problems? Give me a shout
    Check out my WHMCS Addons

  8. #8
    very detailed and helpful, thanks a lot.
    my lovely free directory, also my beautiful city in turkey malatya and kibris

  9. #9
    Quote Originally Posted by linux-tech View Post
    then use incremental
    Yes I've switched to that earlier this day. I'll keep this thread updated about my experiences with the incremental method.

  10. #10
    Join Date
    Dec 2002
    Location
    Sibiu, Romania
    Posts
    241
    I'm using also Incremental method for backup but latly I find out I have weird problem, one database (as I know) is NOT created on the backup HDD, the mysql dump is just 300bytes .. ~10 lines of code.
    This happents on a medium size database ~200Mb

    I have wrote about my problem here : http://www.webhostingtalk.com/showthread.php?t=690283 .. and still no solution yet

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •