I've stared mirroring the files and directories on an FTP server to my external HDD using my Raspberry Pi so I can leave the downloads running 24/7.
What I did to start the download was:
lftp [email protected]
mirror --use-pget-n=8 /
The files are downloading, however it seems to be running quite slow. After about 10 hours of running, it's only downloaded 139GB. Whenever I ran the download using Filezilla on my desktop (Mint) I got ~200GB in 4 hours.
I was unaware of how many segments each file should be downloaded in, so I choose 8. To be honest, I'm not entirely sure of the benefit splitting the file into segments.
My download speed according to Speedtest.net peaks at around 40Mb/sec and is usually around 30Mb/sec.
Are there any better parameters I could use, or is it possibly down the Raspberry Pi's hardware?
I would tar all the files and download them in one go, only I don't have any other access to the server (not the owner).