I have been trying to move huge files from one server to another one via ssh using wget and scp commands but the tar.gz file get corrupted and wont extract. The files is over 30 to 50GBs. Is there any other better way to move .tar.gz files?
3 Answers
I'd use rsync
which will automatically resume if you need to restart it and will calculate checksums on your file as part of its transfer process.
If you have ssh you may use a console FTP client to send it to the server.
The FTP protocol is made for this, so the transfert should be ok
You can use an SFTP client able to handle broken connections and reconnect, for instance lftp.
In order to recover a corrupted transfer, use rsync
. It will efficiently compare the remote and local files and transfer only the parts that differ.