Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Possible Duplicate:
How can I download an entire website?
Suggestions for a site ripper?
Website downloader (cache?) to view sites offline

Is there any free website downloading software using which we can actually download complete websites and browse through them offline (clicking on an internal link leads to opening of that page saved offline, and not seeking internet connection to open the page)?

share|improve this question

marked as duplicate by Mokubai, Journeyman Geek, RedGrittyBrick, slhck, EBGreen Apr 11 '12 at 13:37

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

2 Answers 2

up vote 0 down vote accepted

One free semi-solution is wget, which comes on any *nix system. You can crawl a site with this command:

wget -r http://example.com

This will actually create a folder (the host name) and save all the crawled pages in that folder (you can have it not save the pages and crawl it for other purposes if you want). However, if there's a page at /foo/ and one at /foo/bar, then it'll save a file named foo and be unable to create a folder called foo in the same directory, and thus won't be able to save /foo/bar.

I recently had to spider 2 sites, and I ended up having to write a bash script to search the folders for pages without file extensions, rename them to */index.html, and then re-crawl the site. But there's probably a better way to do it.

I also downloaded JSpider, which is another open source webcrawler. However, I haven't had a chance to try it out, so I don't know how it handles the folder/filename conflict.

share|improve this answer

I cannot speak to how good it is but there is Blue Squirrel WebWacker.

share|improve this answer
    
The free download appears to be a trial. –  Lèse majesté Apr 11 '12 at 12:57
    
Not only that, I am getting the error, "file/link does not exists" when I try to download the free trial. –  user221287 Apr 11 '12 at 13:25

Not the answer you're looking for? Browse other questions tagged or ask your own question.