Results 1 to 11 of 11
  1. #1
    Join Date
    Sep 2009
    Location
    UK Midlands
    Posts
    16

    Rsync problems recently started

    Hi... Recently upgraded my vps (this is the only think I can think of), but that means it now has more RAM, more CPU capacity, and more disk space, so I doubt that has anything to do with the new problem.

    I am trying to rsync my WHM user account backup directory to a machine in the office.. It's alway run fine in the past (it's something I do every couple of months as an extra extra backup!)

    On my mac, I usually run

    rsync -avze 'ssh -p 999' root@myhost.co.uk:/drive2/localbackups/ /Mystuff

    My Mac runs 2.6.9 so I installed the latest release just to be sure 3.0.6 and put it in usr/local/bin

    /usr/local/bin/rsync -avze 'ssh -p 999' root@myhost.co.uk:/drive2/localbackups/ /Mystuff

    Each time i try this it gets a few dozen files into the transfer and just dies, and eventually times out with the following...


    I watch the server with "top" while I open the connection, and I see rsync fire up and consume reasonable resources, but once it hangs, it just drops to idle.

    My WHM server is pretty stock, and is running version 2.6.8

    Is it safe to upgrade rsync on the WHM server, or will this cause probs with other scripts that WHM runs?

  2. #2
    Join Date
    Jul 2009
    Location
    India
    Posts
    54
    Try to use rsync with option --timeout=0 which means rsync should never timeout.
    Expert in Server Management, Server Hardening & Server Optimization.
    https://www.servermanagementadmins.com
    24x7 Whitelabel Outsourced Support - Helpdesk, Livechat, Messenger.
    IM (skype): servermanagementadmins Email: sales[@]servermanagementadmins[.]com

  3. #3
    Join Date
    Sep 2009
    Location
    UK Midlands
    Posts
    16
    The error I am getting is

    cpbackup/daily/pathtosomefile/file.jpg
    Read from remote host vps.myhost.co.uk: Operation timed out
    rsync: connection unexpectedly closed (10858655 bytes received so far) [receiver]
    rsync error: error in rsync protocol data stream (code 12) at io.c(600) [receiver=3.0.6]
    rsync: connection unexpectedly closed (2487542 bytes received so far) [generator]
    rsync error: unexplained error (code 255) at io.c(600) [generator=3.0.6]


    I'll try the timout thingie, but I don't see why it should timeout in the first place... no load, small files, etc

  4. #4
    Join Date
    Sep 2009
    Location
    UK Midlands
    Posts
    16
    Nope... still getting

    Read from remote host vps.myhost.co.uk: Operation timed out
    rsync: connection unexpectedly closed (3885965 bytes received so far) [receiver]
    rsync error: error in rsync protocol data stream (code 12) at io.c(600) [receiver=3.0.6]
    rsync: connection unexpectedly closed (2487542 bytes received so far) [generator]
    rsync error: unexplained error (code 255) at io.c(600) [generator=3.0.6]

  5. #5
    "Operation timed out" suggests more of a firewall issue than anything else. It looks like the remote server is blocking the source for some reason and the connection just times out after a specific time. Try to disable the firewall on both the servers first and if rsync works, then check which rules are causing problems.

  6. #6
    Join Date
    Mar 2003
    Location
    California USA
    Posts
    13,681
    It's not a firewall issue.

    Are both servers using the same version of rsync?
    Steven Ciaburri | Industry's Best Server Management - Rack911.com
    Software Auditing - 400+ Vulnerabilities Found - Quote @ https://www.RACK911Labs.com
    Fully Managed Dedicated Servers (Las Vegas, New York City, & Amsterdam) (AS62710)
    FreeBSD & Linux Server Management, Security Auditing, Server Optimization, PCI Compliance

  7. #7
    Join Date
    Sep 2009
    Location
    UK Midlands
    Posts
    16
    No it's not a firewall issue...

    Well, the client (one of the macs in my office) is running 2.6.something and also 3.0.6 has been installed to try and fix this, but still no luck.

    The servers are all running the stock centos 5.x rsync 2.6.8

    I am considering upgrading rsync on one of the servers, but am not sure if this is going to upset WHM...

    I'm embarrassed to admit that although I use rsync regularly, I'm not entirely sure how the transfers take place... i.e. When I initiate rsync from my mac and connect to a remote server, does rsync have to be running on the remote server in daemon mode in order to receive a connection??? I'm not at all clear on this point.

  8. #8
    Join Date
    Aug 2009
    Posts
    50
    upgrade rsync and retry as for running rsync as service on server side this is not the case since you're using ssh transfer as I see from your command .

  9. #9
    Quote Originally Posted by santrix View Post
    Nope... still getting

    Read from remote host vps.myhost.co.uk: Operation timed out
    rsync: connection unexpectedly closed (3885965 bytes received so far) [receiver]
    rsync error: error in rsync protocol data stream (code 12) at io.c(600) [receiver=3.0.6]
    rsync: connection unexpectedly closed (2487542 bytes received so far) [generator]
    rsync error: unexplained error (code 255) at io.c(600) [generator=3.0.6]
    Without asking who your isp is, try the following search on a search engine of your choice:

    isp sandvine

    It could be that your isp is using sandvine, and sandvine is chopping the connections.
    edgedirector.com
    managed dns global failover and load balance (gslb)
    exactstate.com
    uptime report for webhostingtalk.com

  10. #10
    Join Date
    Mar 2003
    Location
    California USA
    Posts
    13,681
    Quote Originally Posted by santrix View Post
    No it's not a firewall issue...

    Well, the client (one of the macs in my office) is running 2.6.something and also 3.0.6 has been installed to try and fix this, but still no luck.

    The servers are all running the stock centos 5.x rsync 2.6.8

    I am considering upgrading rsync on one of the servers, but am not sure if this is going to upset WHM...

    I'm embarrassed to admit that although I use rsync regularly, I'm not entirely sure how the transfers take place... i.e. When I initiate rsync from my mac and connect to a remote server, does rsync have to be running on the remote server in daemon mode in order to receive a connection??? I'm not at all clear on this point.
    Rsync often goes over ssh
    Steven Ciaburri | Industry's Best Server Management - Rack911.com
    Software Auditing - 400+ Vulnerabilities Found - Quote @ https://www.RACK911Labs.com
    Fully Managed Dedicated Servers (Las Vegas, New York City, & Amsterdam) (AS62710)
    FreeBSD & Linux Server Management, Security Auditing, Server Optimization, PCI Compliance

  11. #11
    Join Date
    Sep 2009
    Location
    UK Midlands
    Posts
    16
    Thanks for the Sandvine heads up - I only recently added a talktalk connection to the office as a backup (which I am currently using), and I forgot to check if there was any traffic management issues. I bet that's what it is... I'll chase up TalkTalk.

    On another note, and I know this is a little OT, but I have had a read, and think I get now how rsync communicates....

    Without any host in the remote part of the call, the transfer is purely local.

    With a host and a colon in the remote part, then we try to open a remote instance of rsync either directly or via ssh, to facilitate the transfer.

    With a double colon in the remote call we are explicitly expecting to connect directly to an existing daemon process on the remote side.

    Does that sound about right?
    Last edited by santrix; 09-24-2009 at 03:35 AM.

Similar Threads

  1. MinkHosting - Great Company, Recently Started!
    By FazeWire in forum Shared Hosting Offers
    Replies: 0
    Last Post: 04-14-2007, 12:43 PM
  2. Rsync problems...help pls
    By runes911 in forum Hosting Security and Technology
    Replies: 4
    Last Post: 09-07-2005, 08:32 PM
  3. Is it just me or does WHT have a lot of problems recently ??
    By thomas.smith in forum WHT Announcements, Feedback and Questions
    Replies: 24
    Last Post: 10-30-2004, 04:57 PM
  4. Paypal with lots of problems recently
    By thomas.smith in forum Web Hosting
    Replies: 98
    Last Post: 10-13-2004, 12:56 AM
  5. Recently Started Hosts Vote Please!
    By Chaps in forum Running a Web Hosting Business
    Replies: 0
    Last Post: 06-03-2002, 05:35 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •