Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Not just the site and content, I want to locally reproduce script calls, etc. I tried HTTracker and wget but it doesn't work.

As an example take

share|improve this question
You can't retrieve the server-side code files if that's what you mean. – Oliver Salzburg Mar 23 '12 at 20:39

There is no way of using HTTP to download a whole website if some portion of it is non-static such as that produced by server-side scripts or programs.

Normally you would need an administrative user account and would typically use a different protocol such as FTP to transfer the site. In addition you would need some means of extracting the contents of any databases used.

share|improve this answer

You will have issues if you're trying to download web servers that are not 100% client side scripting. If the site uses any sort of server side scripting (ruby, python, php, asp, etc.) then you would only be able to download what was rendered and not the actual source files that generated the client side content.

The search terms that you may want to research is web crawling. For example, Google uses a crawler to cache data from websites. A lot of times if a website disappears or is shutdown, you're able to look at the Google Cache of the last time it had data. Useful for some older content sites that are no longer in existence.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .