Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I just came across this problem and my little knowledge in programming is killing me right now ;) So, i have a certain gallery on a image sharing website this is ImageBam, i have never downloaded images from this website.

right now I am using this code:

wget -P pics -H -nd -r -A '.jpg,.jpeg,.png,.gif,' -erobots=off

This code is downloading the whole website, when i only need to download content from a certain DIV, that includes thumbnails and original image.

Do you know if its possible to create a script in bash or any other language to download content from one div and not the whole webiste and all the possible hyperlinks ?

thanks for help

share|improve this question

Scrapy would be a good option.

share|improve this answer

wget is not meant to parse files, only download them.

What you want is cURL which is like wget, but with the added ability to parse files for the desired target.

share|improve this answer
cool, thanks for that, but how can I make it download images and thumbnails ? – user29200 Dec 23 '12 at 23:43
Hmm, I think I am thinking of cURL in the context of PHP. In that case, you would use XPath to denote the target DIV. I’m guessing that you are not looking to do any programming, so I’ll check for a simpler option… – Synetech Dec 24 '12 at 0:16

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .