Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have a website, and I want to download all of the pages/links within that website. I want to do a wget -r on this URL. None of the links go "outside" of this specific directory, so I'm not worried about downloading the entire internet.

As it turns out, the pages I want are behind the password-protected section of the website. While I could use wget to manually do that cookie negotiation, it would be a lot easier for me to just "log in" from the browser and use some firefox plugin to recursively download everything.

Is there an extension or something that will let me do this? Many extensions focus on getting media/pictures from the page (heh. heh.) but I'm interested in all of the content - HTML and everything.




DownThemAll seems like a cool suggestion. Can it do a recursive download? As in, download all of the links on the page, and then download all of the links contained within each of those pages, etc? So that I basically mirror the entire directory tree by following links? Kinda like the -r option of wget?

share|improve this question

SpiderZilla is meant to do that -- but, its a bit old (2006).
It is based on HTTrack website copier.
Which has updated versions for all platforms.

There is also another older addon that can let you plug-in 'wget' itself (among other things).

However, I too feel that DownThemAll is probably a good choice.
If you know what you want to mirror, selecting the right links should not be a problem.
And, you can always tick the 'All' checkbox.

So, +1, for DownThemAll if you want to stick to the browser.
And, use HTTrack if you want a standalone tool (and wget is not handy).

Update: you may also want to look at HTTrack's votes at this bounty question,
How can I download an entire website.

share|improve this answer
DTA does not support recursion – Hayden Thring Oct 17 '15 at 22:06

DownThemAll doesn't do recursive. It only grabs links from the current page. Only the HTML page of the linked URLS are downloaded. The linked pages's images etc.. are not downloaded.

share|improve this answer
this is correct – Hayden Thring Oct 17 '15 at 22:06

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.