Results 1 to 8 of 8
  1. #1
    Join Date
    Mar 2009
    Posts
    3,700

    how to improve the rsync speed ?

    Hi,

    i have backup files around 2TB on old server,

    i want to move them to another server with the command

    rsync -avzh -e 'ssh -p 2200' root@1.1.1.1:/home/acc/mydomainx.com /home/acc

    but i had take days to rsync them and had not finish,

    should i take any improvement for the command to get better transfer speed?

  2. #2
    Join Date
    Mar 2003
    Location
    /root
    Posts
    23,991
    Do you have the same network speed for both servers? 1 Gbps and up ?

    Specially 4 U
    Reseller Hosting: Boost Your Websites | Fully Managed KVM VPS: 3.20 - 5.00 Ghz, Pure Dedicated Power
    JoneSolutions.Com is on the net 24/7 providing stable and reliable web hosting solutions, server management and services since 2001
    Debian|Ubuntu|cPanel|DirectAdmin|Enhance|Webuzo|Acronis|Estela|BitNinja|Nginx

  3. #3
    Join Date
    Mar 2009
    Posts
    3,700
    Hi

    Yea,at 1G port,so,the cmaand and parameters are fine ?

  4. #4
    Join Date
    Apr 2016
    Location
    Belarus
    Posts
    9
    Hello. Try to go FTP or any other non encrypted protocol. You can even try to mount remote folder via FTP and rsync it.

  5. #5
    Join Date
    Mar 2009
    Posts
    3,700
    Hi,

    Do you mean scp or ?

    Will it still keep the file and folder permission the same with original one ?

  6. #6
    Join Date
    Apr 2016
    Location
    Belarus
    Posts
    9
    ttgt, I mean not to use SCP (SSH) at all. Encryption slows you down.

    Example how to do rsync without SCP:

    1. mount remote server folder via FTP
    curlftpfs ftp-user:ftp-pass@my-ftp-location.local /mnt/my_ftp/

    2. rsync locally
    rsync -avzh /mnt/my_ftp/ /backups/

  7. #7
    Join Date
    Apr 2016
    Location
    Belarus
    Posts
    9
    Will it still keep the file and folder permission the same with original one

    I am not sure about permissions. Look at man page of curlftpfs.

    Also you can try to do this via NFS mounts, instead of curlftpfs. NFS will export current file permissions on remote server.

  8. #8
    Join Date
    Mar 2012
    Posts
    57
    your using z as an option there, z causes compression to be used, im my experience this slows down the transfer significantly and should only be used if you have low amounts of bandwidth. If encryption is not an issue then also try arcfour (rc4) encryption, its the 'fastest' so something like

    rsync -avh -e 'ssh -p 2200 -c arcfour' root@1.1.1.1:/home/acc/mydomainx.com /home/acc

    should be fastest

Similar Threads

  1. How to improve the IO speed of soft raid 1
    By pedro2010 in forum Hosting Security and Technology
    Replies: 0
    Last Post: 10-25-2009, 02:21 AM
  2. How to calculate the total speed of the CPU
    By min07 in forum Dedicated Server
    Replies: 4
    Last Post: 08-12-2007, 01:08 PM
  3. Replies: 2
    Last Post: 08-06-2006, 12:30 AM
  4. Replies: 3
    Last Post: 08-05-2006, 02:13 AM
  5. How to tell the true speed of a host
    By Trip in forum Web Hosting
    Replies: 1
    Last Post: 01-10-2003, 04:43 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •