How do I make a list of all links on a web page (DownThemAll!)?

Question

How can I download the links (not the content in the pages that the links point to, just the links themselves. I'm trying to give a list of about 300 videos to my network admin to unblock, he just wants the URLs.

Answer 1

In PHP:

<?php

$webpagehtml=file_get_contents("http://www.example.com");

$dom=new DOMDocument();
$dom->loadHTML($webpagehtml);

$xpath=new DOMXPath($dom);
$items = $xpath->query("//a");

$links=array();

for ($i = 0;  $i < $items->length; $i++ ) {
$item = $items->item($i);
$title=$item->textContent;
$href=$item->getAttribute('href');

if($href && $title){
echo "$href = $title<br/>";
}
}
?>

In Python, use http://arshaw.com/scrapemark/docs/examples/.

Or you can use downthemall in firefox to do the dirty work.