Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I need to save a static version of my site by using the sitemap which has about 400 URLs. What is the best way to do that?

share|improve this question

migrated from stackoverflow.com Jul 13 '12 at 18:22

This question came from our site for professional and enthusiast programmers.

    
There are lots of free web spider/crawler tools available out there. Any one of them can take the sitemap page and follow all the links to make a static copy of all the contents of your site. –  mellamokb Jul 13 '12 at 16:38
    
could you tell me some tools ? –  xRobot Jul 13 '12 at 16:39
    
I need to download ONLY URLs from the sitemaps. –  xRobot Jul 13 '12 at 16:48
    
from your responses it looks more like you want to create a sitemap? Or are you trying to grab urls as text from an existing sitemap file? its not clear... btw xml sitemaps free version will index up to 500 urls and create your sitemaps automatically xml-sitemaps.com –  WebChemist Jul 18 '12 at 9:10

3 Answers 3

If you only want the URLs on your sitemap, then use the -l depth option in wget:

wget -r -l 1 http://your.domain.com/sitemap/
share|improve this answer

Use wget -r http://your_website_here.com/ to recursively download your website content.

share|improve this answer
1  
I need to download only sitemap's URLs and not the entire site :) –  xRobot Jul 13 '12 at 16:40
    
but your question says: "How to get a static version of my site". wget can pull only given urls: wget -i sitemap, it'll work if the sitemap file is an html page, or a plain list of urls. But wouldn't that be downloading your entire site? –  lornix Jul 14 '12 at 19:56

Are you sure you don't want e.g. images etc. downloaded as well?

Either way, you could import the list of URLs (I believe importing a standard XML sitemap file will work as well) into e.g. A1 Website Download and do a little configuration like explained here:

http://www.microsystools.com/products/website-download/help/website-download-pages-list/

(Whatever download tool you end up deciding to use, you can always try email the vendor of the tool as well and ask for help specificly for the tool you use.)

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.