0
votes
0answers
23 views

How to wget range that fills a PHP URL

I try to wget from 1 to 724.. When I try this line in the terminal : wget http://exemple.fr/resultats.php?ID={1..725}.html everything works fine except that the pages downloaded are no filled with ...
0
votes
1answer
154 views

How can I encode an url for wget?

I am looking for a way to convert a string to a clean url. For example : wget http://myurl.com/toto/foo bar.jpg This is going to download http://myurl.com/toto/foo and http://bar.jpg. I want to ...
1
vote
2answers
194 views

How can I import several URLs to wget?

I use the following code to download "example1.com" with Windows. However, this code is limited to only one URL. Is it possible to import a txt file which contains several URLs instead? wget ...
1
vote
3answers
2k views

wget - Many URL's in .txt file - download and save as

I have 2000 URLs in excel file. The URLs are in the first column and in the second column there are names for the files downloaded from URL in the first column. I can copy that and paste to .txt file ...
8
votes
3answers
909 views

wget with url that contains #

I am trying to download a url that is like http://www.somesite.com/restaurants.html#photo=22x00085 I put it in between single quotes but it only downloads http://www.somesite.com/restaurants.html ...
7
votes
2answers
347 views

Xargs and Wget stops working after an hour

Running script with Cygwin on Windows XP with Dual Core and 4GB Ram cat url_list.txt | xargs -P50 wget -i I am trying to trawl through 4GB of URL to download (approx 43 Million) Works okay for ...