Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I have that huge file on a remote server to which I have access through ssh. I downloaded it on my computer, but for some reason some part of it was corrupted during the transfer. Downloading it again would be very time-consuming.

As I have access to both files, I could, for instance, md5sum the first half of it and compare it to the local md5 then download only the first part. I was wondering whether anyone had a better solution.

share|improve this question
    
What about using torrent? (Create a .torrent from source, load up the torrent on your machine, and let it download the missing parts.) –  Shiki Aug 18 '12 at 21:55
    
@Shiki interesting idea. Will the torrent blocks be compared using checksums ? I am afraid the torrent way of checking is size-based (I really have no idea to be honest) –  qdii Aug 18 '12 at 22:00
    
Read this: en.wikipedia.org/wiki/… ||| So basically, you will just transfer the missing and corrupt files. BUT: You will need to run a torrent client on the server to "seed". If you can't do that, the torrent way is a no-go. –  Shiki Aug 18 '12 at 22:43
    
You need to identify how it's broken before we can suggest a fix. –  Ignacio Vazquez-Abrams Aug 18 '12 at 22:47
    
Doesn't rsync handle this? –  Alan Curry Aug 18 '12 at 22:52

1 Answer 1

up vote 2 down vote accepted

rsync should work about as well as a bittorrent in this case and with less setup required.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.