Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I need a program that I can give a lit of URLs to (either paste or in a file) like below and then it must be able to crawl those links and save files of a certain type, like images for example. I have tried a few spiders but not had luck.

Currently, the only way to download everything, is to open each link, then I use the "DownThemAll!" Firefox plugin which selects all the images (or any file type) on the page and downloads them. This works page by page, but I need something similar that works a whole list of URLs.

Does anyone have any suggestions?? Thanks a lot.

PS. Could I also add that it be something fairly easy to use that has a half decent user interface and doesn't run from the command line. Thanks

   http://www.someUrl.com/fhg/xbox/1/index.php?ccbill=123456    
   http://www.someUrl.com/fhg/allison_gf/1/index.php?ccbill=123456    
   http://www.someUrl.com/fhg/cookin/1/index.php?ccbill=123456    
   http://www.someUrl.com/fhg/blackjacket/1/index.php?ccbill=123456  
share|improve this question
    
i see you replaced allison19 with someUrl . kinky! =P –  DiegoDD Dec 21 '13 at 3:41
add comment

4 Answers

perfect job for small script.

but, if you prefer GUI, maybe wGetGUI can be helpful.

You didn't specified OS, so one for Linux can be find here.

share|improve this answer
    
Thanks - just to clarify one thing. Will I be able to dump a list of URLS as listed in my original post into that app and it will process each one?? –  Cheeky Apr 22 '11 at 19:21
    
Default wget pick the filename from the last word after last forward slash. Sorry, I didn't realised this before. –  dudko Apr 22 '11 at 19:46
    
Thanks for the help Dudko, but that install and interface was just too complicated. –  Cheeky Apr 23 '11 at 7:43
add comment

Ok, I have found an application that does it beautifully. It's called Picture Ripper

Thanks for the help anyway Dudko!

share|improve this answer
add comment

There's not been any way of doing this from a browser or without downloading dodgy one-hit wonder freeware so I've written a Chrome browser extension that fits the bill.

It's called TabSave, available in the webstore here.

You can paste in a list of URLs and it'll download them, no fuss :-)

It also has the ability to download every tab open in the active window, hence the name. This is the default, just click the edit button to insert a list yourself.

It's all open source, see the link in the webstore description.

share|improve this answer
add comment

I know I'm gravedigging here, but I was searching for a similar program and found BitComet which works really well, you can import url's from textfiles etc.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.