up vote 0 down vote favorite
share [g+] share [fb]

A friend of mine put up a bunch of mkv files on a public server, how can i download them all with one wget command?

I have tried 

wget -r [path]

which simply grabs the index file, robots.txt and skips the mkvs. I also tried

wget -r -A.mkv

If i try getting a individual file directly it works fine, what am i doing wrong here? The man page is very long so possibly i just skipped the relevant option in which case I apologise.

link|improve this question
possibly... I'm not really interested in creating a whole different account on a site I will barely use when there should be enough overlapping knowledge to answer this fairly simple question right here. You can't compartmentalise everything! – Ollie Edwards Apr 11 '11 at 20:59
1  
@Ollie, that's not how it works. It takes almost no effort to link your current OpenID to the other site (and you get 100 rep on the new site as a reward). The rules are there to keep BOTH sites useful and less cluttered with "uninteresting" questions for the audience. – Ex Umbris Apr 11 '11 at 21:01
Does [path] list all the .mkv files as links? – Mikel Apr 11 '11 at 22:37
feedback

migrated from stackoverflow.com Apr 11 '11 at 22:29

This question came from our site for professional and enthusiast programmers.

1 Answer

up vote 1 down vote accepted

My guess: Your answer is here: http://www.robotstxt.org/

The man page for wget has a workaround, but it is not a nice thing to ignore robots.txt, so I'm not recommending it (you can look it up yourself). You could verify whether this is the actual problem by viewing the text

curl http://somedomain.com/robots.txt
link|improve this answer
Yep had "Dissalow /" I asked him nicely if he minded me ignoring his robots and got the goods. Thanks. – Ollie Edwards Apr 13 '11 at 10:23
Great! Thanks for the mark! – sehe Apr 14 '11 at 19:08
feedback

Your Answer

 
or
required, but never shown
discard

Not the answer you're looking for? Browse other questions tagged or ask your own question.