Web Hosting Talk : Web Hosting Main Forums : VPS Hosting : Transfer Large Many Files From Server To Server - How? Please Help!

[isi123]

Hi,

In reference to my previous post, i want to tranfer accross 7GB of data, approximatly 80,000 files i believe it is (due to a gallery script).

It's currently on another host (on a webhosting account) which uses their own control panel which has no options but to manage databases, the only way i can see to do this is via FTP but it'll take me days. I've tried using compressing and backup scripts, but the damn execution time on the hosts server is too low to allow the files to be zipped. Are there any ways? Can i login to my VPS via SSH and anyhow pull off the files from the other hosts server?



Thanks alot!

[bear]

Yes, you can use scp, rsync or even FTP from server to server through shell. Rsync would be the simplest, I believe. From the gaining server:

rsync -aqz "ssh -p PORT" root@HOST:/home/USER/public_html/ /home/USER/public_html

Where:
PORT = the SSH port on the old server.
HOST = the IP address (or hostname) of the old server.
USER = the account username, which is the same on both the old and new servers.

[isi123]

Originally Posted by bear

Yes, you can use scp, rsync or even FTP from server to server through shell. Rsync would be the simplest, I believe. From the gaining server:

rsync -aqz "ssh -p PORT" root@HOST:/home/USER/public_html/ /home/USER/public_html

Where:
PORT = the SSH port on the old server.
HOST = the IP address (or hostname) of the old server.
USER = the account username, which is the same on both the old and new servers.

Hi,

Thanks. But one thing. Do i enter this into my VPS shell? Also, my webhosting account (where i need the data from) doesn't support SSH or anything. Pretty silly. The only thing i've seen work is FTP.

Could you please show me the FTP method? And elaborate a little more, on the steps i can do it at.

Thanks so much!

[ConceptLane]

CentOS? Check out lftp, it can be made to run in the background (on your VPS).

1. Put this into a new file, e.g. download.bsh (and replace those "variables" in <>)

#!/bin/bash
lftp -c "open -u <USR>,<PWD> <FTP_HOST>
set ftp:ssl-allow no
mirror <REMOTE_PATH> <LOCAL_PATH_IF_NOT_CURRENT_DIR> &
quit"

2. chmod u+x download.bsh
3. ./download.bsh

You can grab lftp for CentOS from here: http://dag.wieers.com/rpm/packages/lftp/

Good luck.

[AdmoNet]

All,

You can also run any process in the background by simply putting "&" after the command. Use the command "fg" to bring the once backgrounded process back to the foreground.

Also you can install the program "screen" to allow you to run multiple background processes and "reattach" to them later.

Cheers!

[plumsauce]

You could also use wget in mirror mode if there is an index file it can get at.

[Matt - Kerplunc]

You could also use scp

scp [FILENAME] root@IPADDRESS:/directory/on/remoter/server/