Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I have been trying to move huge files from one server to another one via ssh using wget and scp commands but the tar.gz file get corrupted and wont extract. The files is over 30 to 50GBs. Is there any other better way to move .tar.gz files?

share|improve this question

migrated from stackoverflow.com Oct 22 '12 at 7:14

This question came from our site for professional and enthusiast programmers.

    
how far apart are the servers? –  mcalex Oct 19 '12 at 12:48
    
one is in Texas and another one in California –  FlourishDNA Oct 19 '12 at 13:06

3 Answers 3

up vote 7 down vote accepted

I'd use rsync which will automatically resume if you need to restart it and will calculate checksums on your file as part of its transfer process.

http://en.wikipedia.org/wiki/Rsync

share|improve this answer

If you have ssh you may use a console FTP client to send it to the server.

The FTP protocol is made for this, so the transfert should be ok

share|improve this answer

You can use an SFTP client able to handle broken connections and reconnect, for instance lftp.

In order to recover a corrupted transfer, use rsync. It will efficiently compare the remote and local files and transfer only the parts that differ.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.