hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : Hosting Security and Technology : Rsync problems recently started
Reply

Forum Jump

Rsync problems recently started

Reply Post New Thread In Hosting Security and Technology Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #1  
Old
Newbie
 
Join Date: Sep 2009
Location: UK Midlands
Posts: 16

Rsync problems recently started


Hi... Recently upgraded my vps (this is the only think I can think of), but that means it now has more RAM, more CPU capacity, and more disk space, so I doubt that has anything to do with the new problem.

I am trying to rsync my WHM user account backup directory to a machine in the office.. It's alway run fine in the past (it's something I do every couple of months as an extra extra backup!)

On my mac, I usually run

rsync -avze 'ssh -p 999' root@myhost.co.uk:/drive2/localbackups/ /Mystuff

My Mac runs 2.6.9 so I installed the latest release just to be sure 3.0.6 and put it in usr/local/bin

/usr/local/bin/rsync -avze 'ssh -p 999' root@myhost.co.uk:/drive2/localbackups/ /Mystuff

Each time i try this it gets a few dozen files into the transfer and just dies, and eventually times out with the following...


I watch the server with "top" while I open the connection, and I see rsync fire up and consume reasonable resources, but once it hangs, it just drops to idle.

My WHM server is pretty stock, and is running version 2.6.8

Is it safe to upgrade rsync on the WHM server, or will this cause probs with other scripts that WHM runs?



Sponsored Links
  #2  
Old
Junior Guru Wannabe
 
Join Date: Jul 2009
Location: India
Posts: 42
Try to use rsync with option --timeout=0 which means rsync should never timeout.

__________________
ServerManagementAdmins -- Expert in Server Management, Server Hardening & Server Optimization.
https://www.servermanagementadmins.com
Server Management Company
IM (msn & gmail): supporttech24x7@gmail.com


  #3  
Old
Newbie
 
Join Date: Sep 2009
Location: UK Midlands
Posts: 16
The error I am getting is

cpbackup/daily/pathtosomefile/file.jpg
Read from remote host vps.myhost.co.uk: Operation timed out
rsync: connection unexpectedly closed (10858655 bytes received so far) [receiver]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [receiver=3.0.6]
rsync: connection unexpectedly closed (2487542 bytes received so far) [generator]
rsync error: unexplained error (code 255) at io.c(600) [generator=3.0.6]


I'll try the timout thingie, but I don't see why it should timeout in the first place... no load, small files, etc

Sponsored Links
  #4  
Old
Newbie
 
Join Date: Sep 2009
Location: UK Midlands
Posts: 16
Nope... still getting

Read from remote host vps.myhost.co.uk: Operation timed out
rsync: connection unexpectedly closed (3885965 bytes received so far) [receiver]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [receiver=3.0.6]
rsync: connection unexpectedly closed (2487542 bytes received so far) [generator]
rsync error: unexplained error (code 255) at io.c(600) [generator=3.0.6]

  #5  
Old
Web Hosting Master
 
Join Date: Jul 2009
Posts: 1,561
"Operation timed out" suggests more of a firewall issue than anything else. It looks like the remote server is blocking the source for some reason and the connection just times out after a specific time. Try to disable the firewall on both the servers first and if rsync works, then check which rules are causing problems.

  #6  
Old
Problem Solver
 
Join Date: Mar 2003
Location: California USA
Posts: 13,180
It's not a firewall issue.

Are both servers using the same version of rsync?

__________________
Steven Ciaburri | Proactive Linux Server Management - Rack911.com
System Administration Extraordinaire | Follow us on twitter:@Rack911Labs
Managed Servers (AS62710), Server Management, and Security Auditing.
www.HostingSecList.com - Security notices for the hosting community.

  #7  
Old
Newbie
 
Join Date: Sep 2009
Location: UK Midlands
Posts: 16
No it's not a firewall issue...

Well, the client (one of the macs in my office) is running 2.6.something and also 3.0.6 has been installed to try and fix this, but still no luck.

The servers are all running the stock centos 5.x rsync 2.6.8

I am considering upgrading rsync on one of the servers, but am not sure if this is going to upset WHM...

I'm embarrassed to admit that although I use rsync regularly, I'm not entirely sure how the transfers take place... i.e. When I initiate rsync from my mac and connect to a remote server, does rsync have to be running on the remote server in daemon mode in order to receive a connection??? I'm not at all clear on this point.

  #8  
Old
Junior Guru Wannabe
 
Join Date: Aug 2009
Posts: 50
upgrade rsync and retry as for running rsync as service on server side this is not the case since you're using ssh transfer as I see from your command .

  #9  
Old
******* Unleaded
 
Join Date: Feb 2004
Posts: 3,829
Quote:
Originally Posted by santrix View Post
Nope... still getting

Read from remote host vps.myhost.co.uk: Operation timed out
rsync: connection unexpectedly closed (3885965 bytes received so far) [receiver]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [receiver=3.0.6]
rsync: connection unexpectedly closed (2487542 bytes received so far) [generator]
rsync error: unexplained error (code 255) at io.c(600) [generator=3.0.6]
Without asking who your isp is, try the following search on a search engine of your choice:

isp sandvine

It could be that your isp is using sandvine, and sandvine is chopping the connections.

__________________
edgedirector.com
managed dns global failover and load balance (gslb)
exactstate.com
uptime report for webhostingtalk.com

  #10  
Old
Problem Solver
 
Join Date: Mar 2003
Location: California USA
Posts: 13,180
Quote:
Originally Posted by santrix View Post
No it's not a firewall issue...

Well, the client (one of the macs in my office) is running 2.6.something and also 3.0.6 has been installed to try and fix this, but still no luck.

The servers are all running the stock centos 5.x rsync 2.6.8

I am considering upgrading rsync on one of the servers, but am not sure if this is going to upset WHM...

I'm embarrassed to admit that although I use rsync regularly, I'm not entirely sure how the transfers take place... i.e. When I initiate rsync from my mac and connect to a remote server, does rsync have to be running on the remote server in daemon mode in order to receive a connection??? I'm not at all clear on this point.
Rsync often goes over ssh

__________________
Steven Ciaburri | Proactive Linux Server Management - Rack911.com
System Administration Extraordinaire | Follow us on twitter:@Rack911Labs
Managed Servers (AS62710), Server Management, and Security Auditing.
www.HostingSecList.com - Security notices for the hosting community.

  #11  
Old
Newbie
 
Join Date: Sep 2009
Location: UK Midlands
Posts: 16
Thanks for the Sandvine heads up - I only recently added a talktalk connection to the office as a backup (which I am currently using), and I forgot to check if there was any traffic management issues. I bet that's what it is... I'll chase up TalkTalk.

On another note, and I know this is a little OT, but I have had a read, and think I get now how rsync communicates....

Without any host in the remote part of the call, the transfer is purely local.

With a host and a colon in the remote part, then we try to open a remote instance of rsync either directly or via ssh, to facilitate the transfer.

With a double colon in the remote call we are explicitly expecting to connect directly to an existing daemon process on the remote side.

Does that sound about right?


Last edited by santrix; 09-24-2009 at 03:35 AM.
Reply

Similar Threads
Thread Thread Starter Forum Replies Last Post
MinkHosting - Great Company, Recently Started! FazeWire Shared Hosting Offers 0 04-14-2007 12:43 PM
Rsync problems...help pls runes911 Hosting Security and Technology 4 09-07-2005 08:32 PM
Is it just me or does WHT have a lot of problems recently ?? thomas.smith WHT Announcements, Feedback and Questions 24 10-30-2004 04:57 PM
Paypal with lots of problems recently thomas.smith Web Hosting 98 10-13-2004 12:56 AM
Recently Started Hosts Vote Please! Chaps Running a Web Hosting Business 0 06-03-2002 05:35 AM

Related posts from TheWhir.com
Title Type Date Posted
The Story of PHP and Joomla!: WHD.global 2014 Web Hosting News 2014-04-01 10:33:59
FireHost Founder Finds Complementary Skills in New CEO Web Hosting News 2014-05-01 08:25:27
Lengthy Outages for Hacker News, FastHosts Web Hosting News 2014-01-06 09:56:36
Windows Azure, Xbox Live Experience Problems as Xbox One Launches Web Hosting News 2013-11-22 13:05:40
Anturis Offers Perceptive Server Monitoring with cPanel/WHM Plugin Web Hosting News 2014-05-09 12:40:23


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
WHT Host Brief Email:

We respect your privacy. We will never sell, rent, or give away your address to any outside party, ever.

Advertisement:
Web Hosting News:
WHT Membership
WHT Membership



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?