I am trying to send huge (huge as in approx 5 gb) files between servers .. Which is better, sftp or rsync ?

Could someone point me to a comparison of sftp vs rsync if any available?

Is one better than the other? Why?

link|improve this question
serverfault (serverfault.com) might be a more appropriate forum for your question – Rune Dec 16 '10 at 12:56
feedback

migrated from stackoverflow.com Dec 16 '10 at 20:53

This question came from our site for professional and enthusiast programmers.

2 Answers

I would say use sftp cause rsyncs current hashing algorithm that the sender uses to find matches for moved data might cause problems with very large files. The current hash table has a fixed size of 65536 slots, and can get overloaded for really large files. See a discussion thread here.

link|improve this answer
1  
that was good info :) – Shrinath Dec 16 '10 at 14:15
feedback

If the files are text, rsync. While @Thariama's point is valid, if they are similar you will get some bandwidth savings. Just be careful with the switches the discussion mentions.

If the files are binary but have only segments changed, rsync. I use this for VM images.

link|improve this answer
feedback

Your Answer

 
or
required, but never shown