Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I would like to mirror a website using wget. The problem is that the website has several language mutations which are switched using a query-string param and when wget starts to download another language version, it clobbers the previous one. For example it starts with index.html, grabs a part of the site, then encounters a link to index.html?lang=foo, starts downloading a new language variant and overwrites the previous index.html with the new one. What can I do when I want all of them?

share|improve this question
up vote 1 down vote accepted

As the pages are actually the same, I am not too sure...

You can try HTTrack which is a very flexible website copier and you can configure rules such as exclude paths / pages with a certain query string... Or it may actually be able to download all languages, I am not 100% sure as I have not run in to this problem.

share|improve this answer
    
This helped, thank you. Looks like I would be able to download the site one language variant at a time and exclude the links that lead to the other. – zoul Dec 15 '09 at 14:53

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .