Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have that huge file on a remote server to which I have access through ssh. I downloaded it on my computer, but for some reason some part of it was corrupted during the transfer. Downloading it again would be very time-consuming.

As I have access to both files, I could, for instance, md5sum the first half of it and compare it to the local md5 then download only the first part. I was wondering whether anyone had a better solution.

share|improve this question
    
What about using torrent? (Create a .torrent from source, load up the torrent on your machine, and let it download the missing parts.) – Shiki Aug 18 '12 at 21:55
    
@Shiki interesting idea. Will the torrent blocks be compared using checksums ? I am afraid the torrent way of checking is size-based (I really have no idea to be honest) – qdii Aug 18 '12 at 22:00
    
Read this: en.wikipedia.org/wiki/… ||| So basically, you will just transfer the missing and corrupt files. BUT: You will need to run a torrent client on the server to "seed". If you can't do that, the torrent way is a no-go. – Shiki Aug 18 '12 at 22:43
    
You need to identify how it's broken before we can suggest a fix. – Ignacio Vazquez-Abrams Aug 18 '12 at 22:47
    
Doesn't rsync handle this? – Alan Curry Aug 18 '12 at 22:52
up vote 2 down vote accepted

rsync should work about as well as a bittorrent in this case and with less setup required.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .