Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Possible Duplicate:
How can I download an entire website

I'm looking a mass-downloader to help me download the entire database from a site I have an account on. The requirements are simple:

  1. Login using my user and password (form-based login)
  2. Download all URLs of the form "http://site.com/ID", where ID is less than 1000.

What should I use?

share|improve this question

marked as duplicate by joe, Diago Nov 15 '09 at 16:22

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

    
Wow, so many answers, so little upvotes on any of them (0 upvoted answers so far). –  ripper234 Oct 25 '09 at 9:51
    
How is this the same as downloading an entire site? I don't want to follow links, I want to download a set of links of a specific form. –  ripper234 Nov 16 '09 at 12:46
    
Comparing these answers to the listed duplicate, they are all listing exactly the same answers provided to this question. Therefore it is a duplicate. Most of the software listed on the duplicate allows this functionality. –  Diago Nov 16 '09 at 14:08

6 Answers 6

Try Orbit Downloader. MANY options available with that.

share|improve this answer

GetGo Download Manager seems to do that:

You can easily set up a Batch Download that not only downloads a large list of files using an URL pattern template, but also automatically renames downloaded files using a filename pattern template.

share|improve this answer

I have had good luck with Offline Explorer. Allows you to access password protected pages and has lots of advanced options.

share|improve this answer

You can do this with wget, and possibly a very simple script (depending on how the site is set up).

share|improve this answer

I strictly recommend NeoDownloader. I've been using it for years.

It downloads from password protected sites and supports downloading URL ranges.

share|improve this answer

HTTRACK works like a champ for copying the contents of an entire site. This tool can even grab the pieces needed to make a website with active code content work offline.

alt text

share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.