GNU Wget is a free software package for retrieving files using HTTP, HTTPS and FTP, the most widely-used Internet protocols. It is a non-interactive commandline tool, so it may easily be called from scripts, cron jobs, terminals without X-Windows support, etc.

learn more… | top users | synonyms

1
vote
2answers
142 views

Why doesn't wget -m save the index.html documents

I'm making a copy of a website with wget -m -p -q http://example.com The process works fine, but the copy is missing all index.html files, even so I see them being sucessfully requested and all ...
1
vote
2answers
2k views

wget stops downloading: Cannot write to `-' (success)

Please have in mind that I don't know anything about servers, nor any of its vocabulary, I am a simple web coder, trying to figure my way on the universe! I'm trying to link dropbox on my server, I am ...
0
votes
1answer
156 views

Are there any programs that supports NRPC? (Lotus Notes RPC) [closed]

Are there any implementations of the Lotus Notes RPC (port 1352)? Example: wget NRPC://<Server-hint-or-host>/bar/foo.xls -O foo.xls So that we can download a file that is only reachable via ...
0
votes
1answer
58 views

can't connect to local web server

when i try to connect to a web server installed on a pc in lan i can't get the index page, the computer is well configured because i can ping and ssh it: ping $ ping 172.16.69.196 PING 172.16.69.196 ...
0
votes
0answers
27 views

use wget for the most updated file on http server

I need to download the most updated files with the name suite. I am using windows server to run the command lines. I wrote the following command but not sure of how to get the most updated one wget ...
0
votes
1answer
218 views

Where is the default directory of saved files using wget in crontab?

I want to download some files using wget command in crontab. I use a text file to make a list of my desired urls. wget's -O parameter works well for setting a destination folder for single files, but ...
1
vote
1answer
116 views

Download all files with some strings in their names

On http://www.inf.usi.ch/carzaniga/edu/algo08f/schedule.html, I would like to download all pdf files of the name *-2up.pdf, for example, http://www.inf.usi.ch/carzaniga/edu/algo08f/intro-2up.pdf Can ...
2
votes
1answer
283 views

How to force wget to output a summary?

I have a bash script that launches a series of wget commands and log the output. I use the following options: wget --no-verbose --page-requisites --adjust-extension --convert-links --backup-converted ...
0
votes
2answers
22 views

Wget does -m need to be used with -r --no-parent argument

Title pretty much says it all. If i want to mirror a website directories and sub directories. should i use wget -m -r --no-parent bla.com or should i use wget -r --no-parent bla.com. Is -m needed?
2
votes
0answers
370 views

wget: unable to resolve host address

I've RedHat Enterprise version 5.2. I run this wget --http-user=celee --http-password=1010$ -k -nd -np -r http://sp.kch.de/RandD/DesSup/Mask%20Tooling%20Runsets/ -o wget.log The wget.log file ...
0
votes
0answers
132 views

Does wget download files more than once?

Suppose there is a website where Page A links to Page B and pages A and B both link to page C. Somthing like A -> B -> C | v C If I run recursive wget on A to begin downloading the pages ...
4
votes
0answers
77 views

Mirror a blog with wget

I am trying to mirror a blog, eg www.example.com, with wget. I use wget with the following options (shell variables are substituted correctly): wget -m -p -H -k -E -np \ -w 1 \ --random-wait ...
0
votes
0answers
325 views

Download file vis cURL, but not with Wget

I have a link I'm trying to download. Before, we could download with either Wget or cURL because the website (which runs under Tomcat) didn't require a user name or password in order to download. ...
1
vote
1answer
449 views

How to restart a router with curl or wget to pass URL as well as POST parameters?

I have an Edimax router and from wireshark I see that the router restarts with the POST http://192.168.2.1/goform/formReboot and the form elements reset_flag=0&submit-url=%2Fadmin_restart.asp ...
1
vote
0answers
221 views

Is there an alternative to httpfs2 to mount web urls in Linux?

Currently I use httpfs2 to mount direct web urls in the filesystem. For example a rar archive which has to be decompressed, but I don't have enough space on my VPS to download AND then decompress the ...
0
votes
0answers
22 views

How to Download HTML Pages of a WebSite, Based on a Time Stamp?

I know this might be a repeated question, and I'm sorry for that, but I failed to find any answer for my problem . I Just want to download the Pages html files, without any other contents, and (If ...
1
vote
1answer
165 views

Wget downloaded more data than the actual file

I have downloaded lubuntu image using wget with mentioned file size 694MB , but the downloaded file is of size 789MB. when i do wget -c it gives that the file is already downloaded. But the file size ...
0
votes
1answer
133 views

Mirror an ftp site, but create empty files instead of full files to save bandwidth

I want a listing of all files and directories at ftp://ftp.ncbi.nlm.nih.gov/snp/. But I don't want to download the contents of all the files. To save bandwidth, I hoped that wget would have an option ...
1
vote
1answer
64 views

amazon ec2 intance rhel7 ftp not downloading

this is driving me insane. i am trying to download files using FTP. i tried with PHP's FTP, the FTP binary, WGET, none of them work. They all have the same problem. When get command is initiated, the ...
2
votes
1answer
253 views

wget how to download zip files with query parameters attached to filename

I am sending a request to a clients server using wget. I want to download all the .zip files but the problem is the .zip files have key/values appended to the files. Like so: ...
0
votes
1answer
62 views

can't open .gzip archives retrieved with wget

I'm trying to download the content of a directory hosted on a server using wget in a cygwin terminal. I have no problem getting the files but they are all .gz archive and once downloaded they are ...
1
vote
2answers
104 views

Modifying names of files BEFORE wget downloads them (not renaming local versions)

I have a website filesystem wherein each file has two copies, a summary copy and a large copy, with different names. For example, a large copy file might be pages/info/GK2grkG23r_lg.html while in the ...
0
votes
1answer
287 views

How do I mirror sub directory of a website with wget

I need to mirror the following URL: https://web.archive.org/web/20100515230709/http://markowitzbocadentist.com/ But I need to mirror only files from this date '20100515230709' i have tried many wget ...
0
votes
1answer
134 views

Try to download mp3 with wget but it redirects to another site?

I am trying to download mp3 files from this adress hanialrefai using wget like this: wget -r -l0 -k -p -A.mp3 http://hanialrefai.com but it redirects me to http://quantsa.ru/?pw and then it say: ...
1
vote
1answer
264 views

Wget - Problems recursively downloading with authentication

So I'm trying to download the entire domain of a private wiki page. I've saved the cookies in a cookies.txt file and using it with wget for authentication like so: wget --load-cookies=cookies.txt ...
0
votes
2answers
705 views

What is the simplest way to download with wget in remote putty terminal using my local windows internet connection

I'd like to initate a download using wget in a remote putty terminal (i.e. an ubuntu server), but using my local windows internet connection. I guess there is two way to achieve this: run an HTTP ...
1
vote
1answer
143 views

Downloading an authenticated large file with command line tools

I need to download a file sized around 1.6GB. I's like to get it download via a command line tool like axel, wget or curl However, how can I download a file which needs to be logged in to the site ...
0
votes
1answer
166 views

download file from a url that returns a save dialog box

I have a url which on clicking returns a save dialog box for a pdf file. I would like to save this file using wget. Any ideas how to do this? Basically the url is not the url of a file but a server ...
0
votes
0answers
38 views

Do functions/aliases defined in a bash script that's downloaded from a server and executed not work?

I had a .bashrc which I moved to server so that I can download and execute it through wget. wget -O - http://xxx.github.io/dotfiles/bashrc | bash It does get executed but any functions and aliases ...
0
votes
1answer
81 views

Downloading Images through Wget With Proxy

I've written a ruby tool to download multiple images. However, this time I'm having to configure wget with a proxy. Prefix is the specified directory of where I want the images to go and md5_sum is a ...
0
votes
1answer
979 views

wget index.php redirection - The name is too long

I am trying to get a copy of the catalog. I would love to get the "List View" and "Show Object" details. The URL I am tring to wget is: ...
0
votes
2answers
118 views

wget doesnt create index file of directory

I try to download site with command: wget -r -l 0 -p -k -m -e robots=off --restrict-file-names=nocontrol,unix http://site.com When it finds link, for example, http://site.com/direction, it creates ...
2
votes
4answers
630 views

Download forum with wget with username and password?

I want to download a forum where I only have access via my username and my password. I tried the following: C:\wget.exe wget -k -m -E -p -np -R ...
1
vote
1answer
6k views

wget mirroring the site fails - 403 Forbidden, even with user-agent

I need to download suricata's latest rules from this url: http://rules.emergingthreats.net/blockrules/ I'm trying to compose my own rules based on different emerging rules and snort's rules too. ...
2
votes
2answers
2k views

How to download an image with wget and save it with the md5 hash as name?

How can I make a download an image, md5 hash the image, and save that image with the md5 hash as name to a directory using wget? # An example of the image link... ...
1
vote
1answer
3k views

WGET downloading extremely slow

I am using the following command wget -r -np -k -p http://www.site.com/dir/ To download a small archive of files(there is a couple hundred files so I don't want to click download on each one and ...
0
votes
2answers
475 views

Can wget decode uri file names when downloading in batch?

Normally when downloading files using wget, the filenames are encoded. In example: wget -c --content-disposition "https://class.coursera.org/ml-005/lecture/download.mp4?lecture_id=1" and the saved ...
0
votes
1answer
233 views

How to navigate PHP-based pagination with WGET?

I'm trying to come up with a list of possible names for our next baby boy and have been looking through the site IndiaParenting. Each name on the site has a detail page at a URL like this one ...
0
votes
1answer
149 views

How to automatically save a list of files with different names?

I have a text file of URLs, each in the form of: http://domain.com/a/b/c/d.jpg I want to download all of these, but save each file under the name: c_d.jpg In other words, for each file, I want to ...
-2
votes
1answer
190 views

wget doesn't match patterns with wildcards

I'm trying to download certain url's which I would like to match with the next pattern using wildcards: http://example.org/subtitles?q=NUMBER_en&format=srt where NUMBER = [0-9]* the output of ...
0
votes
2answers
2k views

Using wget to get files from local to server to remote server

We have a local server where we carry out much of our web development and then we push this to a live environment so that clients can access. We often end up with huge tarballs (this one in ...
1
vote
1answer
101 views

How do I make wget match exact domain names?

I'm using the following command to mirror a site: wget -r -p -E -N -l 10 -k -nH -H -Dfoo.com,www.foo.com foo.com The problem I am having is that somewhere on foo.com there are links to domains ...
0
votes
0answers
125 views

How to download all images from a gallery

I'm searching for a way to download all images (not the thumbnails) of this gallery http://kinki.de/#/?gallery=list&gid=4804 . As I can see, the images are all located at ...
0
votes
0answers
554 views

How can I use Wget / Curl / Plowshare to download from 1fichier.com as a premium member?

How can I download files from 1fichier.com (I am a premium member) with the help of Wget / Curl / Plowshare (Plowdown) or other CLI / command line tool / script?
0
votes
1answer
88 views

Trace web redirection in bash script

I want to make a script to download the image at best resolution (not the preview image) from a deviantART link, as if I clicked the "Download" button. However, it seems that deviantART redirect the ...
0
votes
1answer
78 views

wget only saving first line of cookies

I want to download and save all the cookies from a particular web-page when using wget. However, wget is only saving the first line. I want the saved cookies from wget to be the same as the cookies I ...
-1
votes
1answer
83 views

Is there a way to read a simple one line asp page using a batch file?

I have a simple asp page in which i write an ip address, and nothing more. Now i need a batch file to read the contents of this page and pass it to a variable. I'm not good with batch files but ...
0
votes
1answer
537 views

WGET/cron downloading webcamera file

our new town doctor put a web camera to his waiting room for people to see how much crowded it is. As my mom and grandparents go to this doctor, I wanted to download the files periodically and if they ...
1
vote
1answer
174 views

What is the curl equivalent to wget -x?

I want to use curl to save multiple files with the same local paths as would be produced by wget -x (ie, cleaned up versions of the full urls). But I can't find the right option in the curl docs. Is ...
1
vote
1answer
2k views

Why I can't use wget command in SSH shell?

I have the following problem. I am using my RaspBerry (with RaspBian installed) by SSH. My problem is that I can't use wget command because it fails. For example if I try to execute the following ...