Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I'm about to run wget to mirror a large website for offline viewing. I'm worried the site might be too large for my hard drive and my download getting screwed up. Is there any way for me to figure out or estimate the size of the site beforehand? What happens if I run out of space halfway through? Can I free up space and resume?

Thanks for any help.

share|improve this question
add comment

1 Answer 1

up vote 3 down vote accepted

Is there any way for me to figure out or estimate the size of the site beforehand?

Ask the owner of the site, which you need to contact anyway if you're talking about sites that "might be too large for my hard drive", think about their bandwidth for a minute...

What happens if I run out of space halfway through? Can I free up space and resume?

wget has a --continue parameter, but whether that works for multiple files is something you could easily check for yourself by faking out of space (aka, do it in a very small tmpfs).

share|improve this answer
    
Check out this article and also learn more about Wget. –  avirk Sep 14 '12 at 15:48
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.