Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Not just the site and content, I want to locally reproduce script calls, etc. I tried HTTracker and wget but it doesn't work.

As an example take donjon.bin.sh

share|improve this question
1  
You can't retrieve the server-side code files if that's what you mean. –  Oliver Salzburg Mar 23 '12 at 20:39

2 Answers 2

There is no way of using HTTP to download a whole website if some portion of it is non-static such as that produced by server-side scripts or programs.

Normally you would need an administrative user account and would typically use a different protocol such as FTP to transfer the site. In addition you would need some means of extracting the contents of any databases used.

share|improve this answer

You will have issues if you're trying to download web servers that are not 100% client side scripting. If the site uses any sort of server side scripting (ruby, python, php, asp, etc.) then you would only be able to download what was rendered and not the actual source files that generated the client side content.

The search terms that you may want to research is web crawling. For example, Google uses a crawler to cache data from websites. A lot of times if a website disappears or is shutdown, you're able to look at the Google Cache of the last time it had data. Useful for some older content sites that are no longer in existence.

http://en.wikipedia.org/wiki/Web_crawler

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.