Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

A friend of mine put up a bunch of mkv files on a public server, how can i download them all with one wget command?

I have tried

wget -r [path]

which simply grabs the index file, robots.txt and skips the mkvs. I also tried

wget -r -A.mkv

If i try getting a individual file directly it works fine, what am i doing wrong here? The man page is very long so possibly i just skipped the relevant option in which case I apologise.

share|improve this question

migrated from stackoverflow.com Apr 11 '11 at 22:29

This question came from our site for professional and enthusiast programmers.

    
possibly... I'm not really interested in creating a whole different account on a site I will barely use when there should be enough overlapping knowledge to answer this fairly simple question right here. You can't compartmentalise everything! –  Ollie Edwards Apr 11 '11 at 20:59
1  
@Ollie, that's not how it works. It takes almost no effort to link your current OpenID to the other site (and you get 100 rep on the new site as a reward). The rules are there to keep BOTH sites useful and less cluttered with "uninteresting" questions for the audience. –  Ex Umbris Apr 11 '11 at 21:01
    
Does [path] list all the .mkv files as links? –  Mikel Apr 11 '11 at 22:37
add comment

1 Answer

up vote 1 down vote accepted

My guess: Your answer is here: http://www.robotstxt.org/

The man page for wget has a workaround, but it is not a nice thing to ignore robots.txt, so I'm not recommending it (you can look it up yourself). You could verify whether this is the actual problem by viewing the text

curl http://somedomain.com/robots.txt
share|improve this answer
    
Yep had "Dissalow /" I asked him nicely if he minded me ignoring his robots and got the goods. Thanks. –  Ollie Edwards Apr 13 '11 at 10:23
    
Great! Thanks for the mark! –  sehe Apr 14 '11 at 19:08
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.