Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I want to create a local backup of my Blogger blog including local copies of all images and videos. Whenever I post a new blog, I'd like it mirrored locally within 24 hours. Wget --mirror in a cron job is a good start but quite slow.

Has anyone done this, or is everyone trusting Google with backups?

share|improve this question
add comment

2 Answers

I just use wget on a nightly basis. FWIW, here are the parameters I use:

-N - turn on timestamping

-r - recursive

-k - convert links

-nv - Turn off verbose logging

-o - output log

-i - input file of sites to crawl

-m - mirror

-w1 - wait 1 second between requests

--random-wait - use random wait times between requests

-np - no parent, never ascend to parent directory

-p - download all page prerequisites (stylesheets, scripts, etc.)

-X - directories to exclude

-R - file names to reject

-H - span hosts (limited by -D)

-D - domains to crawl (limited to these domains)

The biggest problem is most pages Blogger returns do not have a Last-modified HTTP header in the response, so it re-downloads unchanged files and logs the following message:

"Last-modified header missing -- time-stamps turned off."

If I could figure out how to squelch that behavior I'd be happy, because that's what makes it slow and also my local backup has to deal with those files every night because it thinks they've changed (when they haven't).

share|improve this answer
add comment

If you merely want to get the content backed-up (ie, you don't care about formatting and stylesheets), you could use a rss subscriber (like Apple's Mail.app) so that it grabs all new posts for you.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.