Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Possible Duplicate:
How can I download an entire website

I frequently encounter webpages that offer manual pages or other info accessible only via a table of contents consisting of links to individual chapters or paragraphs. Often the individual leaf pages then consist of a few lines only, so traversing the entire tree is extremely cumbersome.

What I am seeking is a tool that would allow me to pull and combine all pages referenced by the links of a starting page into a single concatenated html document, such that one could e.g., save that page and/or linearly scroll through all child pages without having to click and go back 1000 times. This would also allow to print the entire collection to have a manual or search through it in one go, etc.

Does anyone know a good tool to achieve that? Ideally such a tool would offer some exclusion criteria (like ignore all "back" links or the link to help or home pages that is found on each page, etc.).

share|improve this question

marked as duplicate by random Mar 18 '11 at 13:47

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

The tool that can download the complete tree of the web-site is – Menelaos Vergis Mar 5 '14 at 13:13

You could use wget in mirror mode:

C:\MySites\> wget -m

Would mirror the whole site.

The other thing I have used with quite good success is HTTrack which again mirrors a website for you, but with a nice GUI front-end.

share|improve this answer
I was about to suggest HTTrack, but you beat me to it. – Journeyman Geek Mar 18 '11 at 11:46

wget to get all the pages. You could use xhtml2pdf and pdftk to create a single document.

share|improve this answer
I don't think is is a duplicate! I am NOT trying to duplicate an entire website. What I would rather like to see is some tool, that lists a website's structure and pages e.g. as a tree and one can then conveniently select (e.g. by checking or circling) those which one wants to be copied (i.e. concatenated and "flattened") into a single document. IMHO that's a different job from just duplicating a website to local. – Michael Moser Mar 18 '11 at 16:58

Not the answer you're looking for? Browse other questions tagged .