wget normally stops when it gets a HTTP error, e.g. 404 or so. Is there an option to make
wget to download the page content regardless of the HTTP code?
--content-on-error, available from wget 1.14:
If this is set to on, wget will not skip the content when the server responds with a http status code that indicates error.