I would like to save this webpage and all the pages it links to. and hope to have the same linking between the saved webpages.
Are there some ways instead of opening and saving each linked pages?
I would like to save this webpage and all the pages it links to. and hope to have the same linking between the saved webpages.
Are there some ways instead of opening and saving each linked pages?
You can do what you'd like with the wget command line utility. If you provide it with the -r
option, it will recursively download web pages. For example:
wget -r http://mat.gsia.cmu.edu/orclass/integer/integer.html
This will download that webpage and anything it links to. You can also make it only recurse a certain number of levels, to do this, you simply provide -r
with a number. Like such:
wget -r 5 http://mat.gsia.cmu.edu/orclass/integer/integer.html
This thread is old now, but others might look at it.
A modern version of wget has a number of useful options for recursing links and patching them to be local relative links so that you can navigate a local copy of a web site. Use the -r option to recurse, the -k option to patch local links, the -H option to traverse into domains other than the original one, the -D option to limit which domains you traverse into, the -l option to limit the depth of recursion, and the -p option to make sure that the leaves of your traversal have everything they need to display correctly.
For example, the following will download a page and everything it immediately links to, making it locally browsable, the -p option ensures that if the linked-to-pages contain images, that they are downloaded, too:
wget -r -l 1 -p -k -H -D example1.com,example2.com http://example.com/page/in/domain
-r recursive (follow links)
-l depth of recursion (0 is infinity)
-p get all images and etc. all needed to display HTML pages
-k convert links of js,css stuff to local links
-H go to foreign hosts when recursive
-D comma-separated list of accepted domains
Using a command similar to the one above, I was able to download a chunk of a wiki page, with external links, onto my local disk without downloading megabytes of extraneous data. Now, when I open the root page in my browser, I can navigate the tree without an Internet connection. The only irritant was that the root page was buried in subdirectories and I had to create a top-level redirect page in order to make it convenient to display. It may take some trial-and-error to get it right. Read the wget man page and experiment.
You can use a website crawler like httrack, which is free.
From the website;
[httrack] allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link, as if you were viewing it online.