Possible Duplicate:
How can I download an entire website

I'm looking a mass-downloader to help me download the entire database from a site I have an account on. The requirements are simple:

  1. Login using my user and password (form-based login)
  2. Download all URLs of the form "http://site.com/ID", where ID is less than 1000.

What should I use?

marked as duplicate by joe, BinaryMisfit Nov 15 '09 at 16:22

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

  • Wow, so many answers, so little upvotes on any of them (0 upvoted answers so far). – ripper234 Oct 25 '09 at 9:51
  • How is this the same as downloading an entire site? I don't want to follow links, I want to download a set of links of a specific form. – ripper234 Nov 16 '09 at 12:46
  • Comparing these answers to the listed duplicate, they are all listing exactly the same answers provided to this question. Therefore it is a duplicate. Most of the software listed on the duplicate allows this functionality. – BinaryMisfit Nov 16 '09 at 14:08

GetGo Download Manager seems to do that:

You can easily set up a Batch Download that not only downloads a large list of files using an URL pattern template, but also automatically renames downloaded files using a filename pattern template.


I strictly recommend NeoDownloader. I've been using it for years.

It downloads from password protected sites and supports downloading URL ranges.


Try Orbit Downloader. MANY options available with that.


I have had good luck with Offline Explorer. Allows you to access password protected pages and has lots of advanced options.


You can do this with wget, and possibly a very simple script (depending on how the site is set up).


HTTRACK works like a champ for copying the contents of an entire site. This tool can even grab the pieces needed to make a website with active code content work offline.

alt text

Not the answer you're looking for? Browse other questions tagged or ask your own question.