Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I need to download from an FTP site.

It has limits such as 1000 files per hour.

Is there FTP software where you can create rules that will download to these type of specifications? So the FTP software will stop downloading and wait an hour, then keep downloading?

share|improve this question
How many files are you downloading if you're hitting a 1000 files per hour limit? – ChrisF Mar 16 '10 at 11:55
up vote 1 down vote accepted

If you use wget recursive download ability, or give it a list of files to get or both, you can use its --wait option to give the same effect.

--wait=4 will add a pause of four seconds between each file meaning that you could get at most 900 files per hour (you would only get the 900/hour if each file transfer was instant though). If you know that each file will take more than 0.6 seconds to download you could use --wait=3 which would be faster, obviously, but could break the 1000 files/hour limit (if each file transfer were instantaneous you could get 1200/hour).

wget is in the standard repositories for just about all Linux variants (and is often installed by default) and is available for Windows and other OSs too. It is a command line tool but there are many GUI front-end wrappers for it if you prefer (I can't recommend one personally as I always use wget from the command line).

share|improve this answer
Trying this out, seems to work perfectly for what I need, thanks :) – soupagain Mar 17 '10 at 9:45

The ncftp Client can be used in combination with a shell script to count files per hour.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .