Results 1 to 8 of 8
Thread: how to improve the rsync speed ?
-
05-14-2016, 10:47 PM #1Web Hosting Master
- Join Date
- Mar 2009
- Posts
- 3,700
how to improve the rsync speed ?
Hi,
i have backup files around 2TB on old server,
i want to move them to another server with the command
rsync -avzh -e 'ssh -p 2200' root@1.1.1.1:/home/acc/mydomainx.com /home/acc
but i had take days to rsync them and had not finish,
should i take any improvement for the command to get better transfer speed?
-
05-14-2016, 10:49 PM #2The Linux Specialist
- Join Date
- Mar 2003
- Location
- /root
- Posts
- 23,991
Do you have the same network speed for both servers? 1 Gbps and up ?
Specially 4 U
Reseller Hosting: Boost Your Websites | Fully Managed KVM VPS: 3.20 - 5.00 Ghz, Pure Dedicated Power
JoneSolutions.Com is on the net 24/7 providing stable and reliable web hosting solutions, server management and services since 2001
Debian|Ubuntu|cPanel|DirectAdmin|Enhance|Webuzo|Acronis|Estela|BitNinja|Nginx
-
05-14-2016, 11:17 PM #3Web Hosting Master
- Join Date
- Mar 2009
- Posts
- 3,700
Hi
Yea,at 1G port,so,the cmaand and parameters are fine ?
-
05-14-2016, 11:39 PM #4Newbie
- Join Date
- Apr 2016
- Location
- Belarus
- Posts
- 9
Hello. Try to go FTP or any other non encrypted protocol. You can even try to mount remote folder via FTP and rsync it.
-
05-14-2016, 11:44 PM #5Web Hosting Master
- Join Date
- Mar 2009
- Posts
- 3,700
Hi,
Do you mean scp or ?
Will it still keep the file and folder permission the same with original one ?
-
05-15-2016, 12:17 AM #6Newbie
- Join Date
- Apr 2016
- Location
- Belarus
- Posts
- 9
ttgt, I mean not to use SCP (SSH) at all. Encryption slows you down.
Example how to do rsync without SCP:
1. mount remote server folder via FTP
curlftpfs ftp-user:ftp-pass@my-ftp-location.local /mnt/my_ftp/
2. rsync locally
rsync -avzh /mnt/my_ftp/ /backups/
-
05-15-2016, 12:20 AM #7Newbie
- Join Date
- Apr 2016
- Location
- Belarus
- Posts
- 9
Will it still keep the file and folder permission the same with original one
I am not sure about permissions. Look at man page of curlftpfs.
Also you can try to do this via NFS mounts, instead of curlftpfs. NFS will export current file permissions on remote server.
-
05-15-2016, 06:01 AM #8Junior Guru Wannabe
- Join Date
- Mar 2012
- Posts
- 57
your using z as an option there, z causes compression to be used, im my experience this slows down the transfer significantly and should only be used if you have low amounts of bandwidth. If encryption is not an issue then also try arcfour (rc4) encryption, its the 'fastest' so something like
rsync -avh -e 'ssh -p 2200 -c arcfour' root@1.1.1.1:/home/acc/mydomainx.com /home/acc
should be fastest
Similar Threads
-
How to improve the IO speed of soft raid 1
By pedro2010 in forum Hosting Security and TechnologyReplies: 0Last Post: 10-25-2009, 02:21 AM -
How to calculate the total speed of the CPU
By min07 in forum Dedicated ServerReplies: 4Last Post: 08-12-2007, 01:08 PM -
how to test the download speed form U.S. server to any specified location? pls help!
By kittyyau in forum Hosting Security and TechnologyReplies: 2Last Post: 08-06-2006, 12:30 AM -
how to test the download speed form a U.S. server to any specified location?
By kittyyau in forum Web HostingReplies: 3Last Post: 08-05-2006, 02:13 AM -
How to tell the true speed of a host
By Trip in forum Web HostingReplies: 1Last Post: 01-10-2003, 04:43 AM