Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Is there a portable way to download or cache all pages of a website for viewing offline? I have a cross country flight tomorrow, and I'd like to be able cache a few webpages (particularly the python doc page (http://docs.python.org/), and the pyqt reference (http://www.riverbankcomputing.co.uk/static/Docs/PyQt4/pyqt4ref.html).

Ideally I'd like a Firefox add-on or something like that, but anything will work fine as long as I can run it on Linux.

share|improve this question
    
You can try this offline website downloader. –  Menelaos Vergis Mar 14 at 9:20
add comment

5 Answers

up vote 12 down vote accepted

I use HTTrack.

It allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer

share|improve this answer
    
I've used this one in the past, nice free solution. –  MaQleod Nov 24 '10 at 5:48
1  
HTTrack is the best for both Linux and Windows and there is a huge list of options to configure the downloading process.. I love it –  eslambasha Nov 24 '10 at 10:24
    
I used it too; they now offer an Android version too. –  damryfbfnetsi Jan 7 at 19:19
add comment

I use wget with these options to mirror a site for offline use

wget -cmkE -np http://example.com/a/section/i/like

where

-m turns on mirroring options for mirroring a site locally

-c continues a previous download in case I have already downloaded some pages

-k converts absolute href to point to local ones for offline viewing

-E ensures files have .html extension after download.

-np only downloads objects under /a/section/i/ and does not cache the whole site.

For example I wanted to download south documentation but not south tickets, etc...

wget -cmkE -np http://south.aeracode.org/docs/index.html

I use Windows and run wget on cygwin but there is also a native windows wget port.

Although, in your case, you can download python offline docs from python docs section

share|improve this answer
add comment

Try http://www.downthemall.net/ a Firefox plugin. I've used it to download 250 pages of PDFs in 20+ separate files. It is extremely powerful. It has a wildcard/query syntax that lets you surgically get only the files that you want and none of the irrelevant ones you don'.

share|improve this answer
add comment

Some Firefox extensions that I know of:

share|improve this answer
add comment

You can download a whole website or part of a website with wget.

wget -r http://docs.python.org/

Check the wget manual for other options you may want to pass, e.g. to limit your bandwidth usage, to control recursion depth, to set up exclusion lists, etc.

Another approach to offline browsing is to use a caching proxy. Wwwoffle is one which has a lot of features to facilitate retention for offline browsing, such as overrides to server-specified expiration dates and a recursive pre-fetching capability. (I've been using wwwoffle since my dial-up days.)

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.