I am trying to download a bunch of (lets say .txt files) from a website, now they're not very big (about 4-10kbs each) but there are about 70000 of them.
All I am after is the .txt, I don't want to clone the site like HTTrack etc...
Are there any programs out there which would help me out with this problem? ( and save me a ton of time!)
Cheers
wget
for example. You should include further info into your question, how one can determine the names of the txt-files. And which OS you are using.wget
man page, gnu.org/software/wget/manual/wget.html, and look foracclist
.