I have been using a plain 'ole rsync command to move large amounts of data off of some hard drives on a LAN to another computer for analysis. Usually just a one-time transfer. The format of rsync that I have been using is:
rsync -ave ssh foo@bar:/source dest
I need to improve the speed of my transfers as much as possible. Someone recently mentioned setting up rsh-server and copying the files through RSH. Not having an encryption overhead can be very helpful. I suppose I have these options:
- cp, scp, etc.
- rsync via rsh
- rsync via ssh, arcfour encryption for reducing speed
- rsyncd, no encryption, some benefits by not having to build the file list
I'm curious as to which I can expect the best performance from. I know, every case is different. Are there any better alternatives?
Some notes:
Ease of install is great. Setting up an RSH server is a bit of a pain. Rsyncd setup is reasonable. Security is not a big concern.
All are 7200 rpm drives, gigabit network with speedy CPU (at least dual core i7 2.0ghz).