Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I want to create a local backup of my Blogger blog including local copies of all images and videos. Whenever I post a new blog, I'd like it mirrored locally within 24 hours. Wget --mirror in a cron job is a good start but quite slow.

Has anyone done this, or is everyone trusting Google with backups?

share|improve this question

I just use wget on a nightly basis. FWIW, here are the parameters I use:

-N - turn on timestamping

-r - recursive

-k - convert links

-nv - Turn off verbose logging

-o - output log

-i - input file of sites to crawl

-m - mirror

-w1 - wait 1 second between requests

--random-wait - use random wait times between requests

-np - no parent, never ascend to parent directory

-p - download all page prerequisites (stylesheets, scripts, etc.)

-X - directories to exclude

-R - file names to reject

-H - span hosts (limited by -D)

-D - domains to crawl (limited to these domains)

The biggest problem is most pages Blogger returns do not have a Last-modified HTTP header in the response, so it re-downloads unchanged files and logs the following message:

"Last-modified header missing -- time-stamps turned off."

If I could figure out how to squelch that behavior I'd be happy, because that's what makes it slow and also my local backup has to deal with those files every night because it thinks they've changed (when they haven't).

share|improve this answer

If you merely want to get the content backed-up (ie, you don't care about formatting and stylesheets), you could use a rss subscriber (like Apple's so that it grabs all new posts for you.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .