0
votes
0answers
36 views

Extract files from WARC and correct URLs

wget has an option of correcting the URLs when recursively downloading a website, so the website is browsable offline. It makes a folder structure that looks like this: Is there a program that can ...
0
votes
1answer
51 views

Best approach to archive a website periodically

I am working on an approach to archive our website (dynamically generated) periodically (say every month) and keep it versionned so that I can go back and pull a page at a certain period. My initial ...
0
votes
2answers
903 views

Extract files from a web archive (.warc)

I have a number of web sites I am archiving in order to retain many of the linked files there, specifically a number of PDFs. I haven't had a problem using the Heritrix crawler to collect the sites. ...
2
votes
1answer
29 views

seeking a tool creates space-efficient web archives

I am seeking a tool to space-efficiently archive a blog that is changing every day or even two or three times a day. I don't mean that individual blog posts change - not regularly anyway - I just ...
1
vote
2answers
160 views

How can I archive web pages linked to in my Delicious bookmarks?

I'm looking for ways to quickly backup the web pages I have collected in my Delicious Bookmarks, to guard against linkrot, etc. The most efficient method I've come up with so far would be to export my ...