I have two NASes.
I work off of one, and the other is used as a backup. As I have it set up now, it's slow. Running a backup takes a week.
Even for 7 TB, with 1,979,407 files, this seems a bit outlandish, particularly as both systems are RAID-5 and the network is all gigabit.
I've been digging about in the rsync man pages, and I really don't understand what differentiates the various topologies.
Right now, all the processing is being done on the backup NAS, which has the main volume from the main NAS mounted locally over SMB. I suspect that the SMB overhead is killing me, particularly when dealing with lots of files.
I think what I need is to set up rsync on the main nas as a daemon, and then run a local rsync client to connect to it, which would hopefully allow me to completely avoid the whole SMB-in-the-middle affair, but aside from mentioning that it's there, I can find very little information on why one would want to use the daemon mode for rsync.
Here's my current rsync command line:
rsync -r -progress --delete /cifs/Thecus/ /mnt/Storage/
Any input? Is there a better way/tool to do this?
Ok, to address the additional questions:
The "Main" NAS is a Thecus N7700. I have additional modules installed that give me SSH, and it has rsync, but it's not in the $PATH, and I havn't figured out how to edit the local $PATH in a way that persists between reboots.
The "Backup" NAS is a DIY affair, built around a 1.6Ghz Via Mobo with a Adaptec Hardware RAID card. It's running CentOS 5 with a full desktop environment. It's the hardware I'm running rsync from. (Gigabit is through a additional PCI card).
Ok, got rsync over SSH working (thanks, lajuette!).
I had to do a bit of tweaking on my command line, I'm running rsync with the args:
rsync -rum --inplace --progress --delete --rsync-path=/opt/bin/rsync firstname.lastname@example.org:/raid/data/Storage /mnt/Storage
(Note: I'm specifically not using -a, because I want to change the ownership to the local account, to not freak-out SELinux)
It seems to be working. I'll see how long it takes.