I need a program that I can give a lit of URLs to (either paste or in a file) like below and then it must be able to crawl those links and save files of a certain type, like images for example. I have tried a few spiders but not had luck.

Currently, the only way to download everything, is to open each link, then I use the "DownThemAll!" Firefox plugin which selects all the images (or any file type) on the page and downloads them. This works page by page, but I need something similar that works a whole list of URLs.

Does anyone have any suggestions?? Thanks a lot.

PS. Could I also add that it be something fairly easy to use that has a half decent user interface and doesn't run from the command line. Thanks

   http://www.someUrl.com/fhg/xbox/1/index.php?ccbill=123456    
   http://www.someUrl.com/fhg/allison_gf/1/index.php?ccbill=123456    
   http://www.someUrl.com/fhg/cookin/1/index.php?ccbill=123456    
   http://www.someUrl.com/fhg/blackjacket/1/index.php?ccbill=123456  
link|improve this question
feedback

2 Answers

perfect job for small script.

but, if you prefer GUI, maybe wGetGUI can be helpful.

You didn't specified OS, so one for Linux can be find here.

link|improve this answer
Thanks - just to clarify one thing. Will I be able to dump a list of URLS as listed in my original post into that app and it will process each one?? – Cheeky Apr 22 '11 at 19:21
Default wget pick the filename from the last word after last forward slash. Sorry, I didn't realised this before. – dudko Apr 22 '11 at 19:46
Thanks for the help Dudko, but that install and interface was just too complicated. – Cheeky Apr 23 '11 at 7:43
feedback

Ok, I have found an application that does it beautifully. It's called Picture Ripper

Thanks for the help anyway Dudko!

link|improve this answer
feedback

Your Answer

 
or
required, but never shown

Not the answer you're looking for? Browse other questions tagged or ask your own question.