Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I need a program that I can give a lit of URLs to (either paste or in a file) like below and then it must be able to crawl those links and save files of a certain type, like images for example. I have tried a few spiders but not had luck.

Currently, the only way to download everything, is to open each link, then I use the "DownThemAll!" Firefox plugin which selects all the images (or any file type) on the page and downloads them. This works page by page, but I need something similar that works a whole list of URLs.

Does anyone have any suggestions?? Thanks a lot.

PS. Could I also add that it be something fairly easy to use that has a half decent user interface and doesn't run from the command line. Thanks  
share|improve this question

closed as off-topic by DavidPostill, mdpc, nc4pk, Steven, Dave Jul 7 '15 at 13:48

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • "Questions seeking product, service, or learning material recommendations are off-topic because they become outdated quickly and attract opinion-based answers. Instead, describe your situation and the specific problem you're trying to solve. Share your research. Here are a few suggestions on how to properly ask this type of question." – DavidPostill, mdpc, nc4pk, Steven, Dave
If this question can be reworded to fit the rules in the help center, please edit the question.

i see you replaced allison19 with someUrl . kinky! =P – DiegoDD Dec 21 '13 at 3:41
@DiegoDD Somehow this question received attention today and that is hilarious. You can also see the remaining parts of the links... – MC10 Aug 18 '15 at 18:41
if you are on linux/unix systems its a one liner, see here – mohamnag Feb 10 at 14:58
Annoying that this is closed as off topic, but this works amazing to save bulk html to pdf if you can write a simple c# program:… Install-Package Select.HtmlToPdf – SuperR May 19 at 16:36

There's not been any way of doing this from a browser or without downloading dodgy one-hit wonder freeware so I've written a Chrome browser extension that fits the bill.

It's called TabSave, available in the webstore here.

You can paste in a list of URLs and it'll download them, no fuss :-)

It also has the ability to download every tab open in the active window, hence the name. This is the default, just click the edit button to insert a list yourself.

It's all open source, the GitHub repo is linked in the webstore description if you want to send a pull request (or suggest a feature).

share|improve this answer
Awesome, this worked great! Thank you so much. – womp Jul 17 '15 at 18:58

For your needs, Chrono Download Manager or TabSave can download a list of links quickly. Both are Chrome extensions, so no need to download desktop software.

And maybe this could be useful for you:

In my own experience, I prefer Chrono Download Manager because I needed to change automatically the name of the downloaded file in a BATCH-way (a list of VIDEOS from a hmm hmm... online courses) and crawling in the html code all the different videos have the same filename. So downloading it with TabSave just gives you the same name videos and you have to guess wich is the content (somewhat like "543543.mp4", "543543(1).mp4", "543543(2).mp4" and so and so).Imagine how much extra work you need to do to achieve this kind of task.

If you need quick list download of files as-is, go TabSave. If you need start to need change the name files on the run, go Chrono.

share|improve this answer
Please exercise caution when recommending software. As written, your answer may be seen as spam. More information: How do I recommend software in my answers? – bwDraco Jul 1 '15 at 1:14
You were right @DragonLord , I fixed my answer so didn't look so biased. – Knomo Seikei Jul 2 '15 at 14:22

perfect job for small script.

but, if you prefer GUI, maybe wGetGUI can be helpful.

You didn't specified OS, so one for Linux can be find here.

share|improve this answer
Thanks - just to clarify one thing. Will I be able to dump a list of URLS as listed in my original post into that app and it will process each one?? – Cheeky Apr 22 '11 at 19:21
Default wget pick the filename from the last word after last forward slash. Sorry, I didn't realised this before. – dudko Apr 22 '11 at 19:46
Thanks for the help Dudko, but that install and interface was just too complicated. – Cheeky Apr 23 '11 at 7:43

Ok, I have found an application that does it beautifully. It's called Picture Ripper

Thanks for the help anyway Dudko!

share|improve this answer

I know I'm gravedigging here, but I was searching for a similar program and found BitComet which works really well, you can import url's from textfiles etc.

share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.