Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have a quite large file hosted on five different servers.

I would like to be able to download different parts of the file from each server and subsequently concatenate the parts, in order to produce the original file.

Is there any way to do this with curl/wget or any other OS X command-line tools?

share|improve this question
3  
Why was this question downvoted? It seems (potentially) relevant to others and is very specific. – trolle3000 Mar 3 '10 at 15:15

aria2 is the solution for multiple downloads of same file from different locations

http://aria2.sourceforge.net/

in your case : aria2c -s5 host1/bigfile host2/bigfile ... host5/bigfile

better late than never...

share|improve this answer
1  
This should be the accepted answer! – Caleb Gray Mar 12 '14 at 1:29

I've wanted this at least once a year for the past decade. I've taken the time to write the script; you can find the latest version here.

Sources: https://github.com/calebgray/scripts/blob/master/usr/local/bin/download-multiple

Just save it somewhere, make it executable, and give it a shot:

cd /usr/bin
curl -o download-multiple https://raw.github.com/calebgray/scripts/master/usr/local/bin/download-multiple
chmod +x download-multiple
./download-multiple http://mirror.pnl.gov/releases/oneiric/ubuntu-11.10-desktop-amd64.iso http://linuxfreedom.com/ubuntu-releases/.pool/ubuntu-11.10-desktop-amd64.iso ftp://mirror.us.leaseweb.net/ubuntu-releases/oneiric/ubuntu-11.10-desktop-amd64.iso ftp://mirror.lstn.net/ubuntu-releases/oneiric/ubuntu-11.10-desktop-amd64.iso

Sources

http://curl.haxx.se/docs/manpage.html

http://linuxandfriends.com/2008/11/01/curl-split-a-file-and-download-simultaneously-from-multiple-locations/

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .