var sidebar_align = 'right';
var content_container_margin = parseInt('350px');
var sidebar_width = parseInt('330px');
Transfer Large Many Files From Server To Server - How? Please Help!
In reference to my previous post, i want to tranfer accross 7GB of data, approximatly 80,000 files i believe it is (due to a gallery script).
It's currently on another host (on a webhosting account) which uses their own control panel which has no options but to manage databases, the only way i can see to do this is via FTP but it'll take me days. I've tried using compressing and backup scripts, but the damn execution time on the hosts server is too low to allow the files to be zipped. Are there any ways? Can i login to my VPS via SSH and anyhow pull off the files from the other hosts server?
Yes, you can use scp, rsync or even FTP from server to server through shell. Rsync would be the simplest, I believe. From the gaining server:
rsync -aqz "ssh -p PORT"
[email protected]:/home/USER/public_html/ /home/USER/public_html
PORT = the SSH port on the old server.
HOST = the IP address (or hostname) of the old server.
USER = the account username, which is the same on both the old and new servers.
Having problems, or maybe questions about WHT? Head over to the help desk!
Originally Posted by
Thanks. But one thing. Do i enter this into my VPS shell? Also, my webhosting account (where i need the data from) doesn't support SSH or anything. Pretty silly. The only thing i've seen work is FTP.
Could you please show me the FTP method? And elaborate a little more, on the steps i can do it at.
Thanks so much!
CentOS? Check out lftp, it can be made to run in the background (on your VPS).
1. Put this into a new file, e.g. download.bsh (and replace those "variables" in <>)
2. chmod u+x download.bsh
lftp -c "open -u <USR>,<PWD> <FTP_HOST>
set ftp:ssl-allow no
mirror <REMOTE_PATH> <LOCAL_PATH_IF_NOT_CURRENT_DIR> &
You can grab lftp for CentOS from here: http://dag.wieers.com/rpm/packages/lftp/
Last edited by ConceptLane; 10-23-2009 at
Reason: Realised poster's intention is to download, not upload
You can also run any process in the background by simply putting "&" after the command. Use the command "fg" to bring the once backgrounded process back to the foreground.
Also you can install the program "screen" to allow you to run multiple background processes and "reattach" to them later.
Admo.net Managed Hosting
Managed Hosting • Dedicated Servers • Colocation
Dark Fiber Access to
, Multiple Public Providers
Years of Service
You could also use wget in mirror mode if there is an index file it can get at.
You could also use scp
scp [FILENAME] [email protected]:/directory/on/remoter/server/
By normaldotcom in forum Web Hosting
Last Post: 09-04-2009, 01:40 PM
By Joel Theodore in forum Dedicated Server
Last Post: 06-15-2008, 10:24 AM
By manuel_accu in forum Hosting Security and Technology Tutorials
Last Post: 06-12-2006, 11:16 AM
By jailbird2 in forum Running a Web Hosting Business
Last Post: 09-11-2004, 08:11 PM
By airpal1234 in forum Other Offers & Requests
Last Post: 04-09-2004, 10:54 PM