Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I would like to mirror a website using wget. The problem is that the website has several language mutations which are switched using a query-string param and when wget starts to download another language version, it clobbers the previous one. For example it starts with index.html, grabs a part of the site, then encounters a link to index.html?lang=foo, starts downloading a new language variant and overwrites the previous index.html with the new one. What can I do when I want all of them?

share|improve this question
up vote 1 down vote accepted

As the pages are actually the same, I am not too sure...

You can try HTTrack which is a very flexible website copier and you can configure rules such as exclude paths / pages with a certain query string... Or it may actually be able to download all languages, I am not 100% sure as I have not run in to this problem.

share|improve this answer
This helped, thank you. Looks like I would be able to download the site one language variant at a time and exclude the links that lead to the other. – zoul Dec 15 '09 at 14:53

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.