I am already familiar and use rsync, scp transfers, tar, 7z etc however none of which solve a backup I intend to do rather regularly.
I have a remote server with 80% used space on 100GB SSD that I would like to backup from. Server has 10,000+ small files so a basic tarball or some sort of intermediate compression (like rsync -z) will help.
I have a server at home that I would like to backup to but it uses Dynamic IP.
The trouble is to use rsync -z or scp and tar (via pipe), it has to be done on remote server but that server can't see my home server since its on Dynamic IP.
I can therefore only execute commands on my home server like scp user@remoteserver:/files/to/backup /home/user/backups but this can't use compression so the huge number of files takes very long time to transfer.
Is there a faster way?
P.S. I don't need to store file permissions etc that tarball does
Edit: Because of limited space on remote server, I can't make a tarball there and pull on home server. Therefore, it has to be realtime.