Resume recursive scp transfer (with rsync?)

Question

I was transferring several thousand files each ~1MB via scp and my connection was broken after the first 2k files or so. I wanted to know if there was a way to resume the recursive transfer w/o starting over. Something like

$ scp -r me@host.com:/datafiles/ ./
... Happy Transfer ...
...     BREAK!     ...
$ rsync -P me@host.com:/datafiles/ ./
... Continue transf...

The problem is I can't seem to get the syntax correct if it is possible. Can anyone shed some light on if/how it can be done?

PS. If you specify the slash after "datafiles" in the rsync line, does that transfer the directory or its contents? I saw conflicting comments when I googled.

Answer 1

if you are rsyncing from a local machine to a remote host, this would work:

rsync -avzl -e ssh /directory/with/files/ you@host.com:/new/directory/

Answer 2

The following line should do the trick for that:

rsync --partial --progress --rsh=ssh -r me@host.com:/datafiles/ ./

I've never used this for recursive directories before, but when I texted it just now it seemed to work as expected.

Answer 3

The rsync command you listed would work, if you only added "-r". but you would also most likely want "-a" and "-v".

And about the trailing slash, me@site.com:/data/ is equivalent to /data/*, in other words, if you add a slash, it copies all the contents. but me@site.com:/data would be the directory itself [and naturally, its subfolders]