up vote 1 down vote favorite
share [g+] share [fb]

I would like to mirror a website using wget. The problem is that the website has several language mutations which are switched using a query-string param and when wget starts to download another language version, it clobbers the previous one. For example it starts with index.html, grabs a part of the site, then encounters a link to index.html?lang=foo, starts downloading a new language variant and overwrites the previous index.html with the new one. What can I do when I want all of them?

link|improve this question
feedback

1 Answer

up vote 1 down vote accepted

As the pages are actually the same, I am not too sure...

You can try HTTrack which is a very flexible website copier and you can configure rules such as exclude paths / pages with a certain query string... Or it may actually be able to download all languages, I am not 100% sure as I have not run in to this problem.

link|improve this answer
This helped, thank you. Looks like I would be able to download the site one language variant at a time and exclude the links that lead to the other. – zoul Dec 15 '09 at 14:53
feedback

Your Answer

 
or
required, but never shown
discard

Not the answer you're looking for? Browse other questions tagged or ask your own question.