curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

learn more… | top users | synonyms

1
vote
1answer
338 views

help with Outlook Exchange server and curl

I work on a mac in a building full of PCs, and the IT department here doesn't have IMAP access turned on on the exchange servers. So I miss a lot of meetings because I don't get reminders because I ...
0
votes
2answers
866 views

Make environment variables available when running command as sudo

I am using Curl, and am having a problem trying to get it to recognize the $http_proxy environment variable when using sudo curl. I tried putting export http_proxy=.... in my /etc/profile and ...
7
votes
2answers
1k views

How to download parts of the same file from different sources with curl/wget?

I have a quite large file hosted on five different servers. I would like to be able to download different parts of the file from each server and subsequently concatenate the parts, in order to ...
5
votes
1answer
2k views

cURL hangs trying to upload file from stdin

I'm trying to PUT a file with cURL. This hangs: curl -vvv --digest -u user -T - https://example.com/file.txt < file This does not: curl -vvv --digest -u user -T file https://example.com/file.txt ...
1
vote
3answers
613 views

How to retrieve all *.html files from website using Unix command line tools and regular expression

I would like to retrieve all .html files from a website that has a certain text on its name: eg. this_is_good_site.html So, I would like to download .html files with a word "good" on its name. I ...
1
vote
2answers
930 views

Download Speed cURL

I am having a bit of problem using cURL to download using FTP, that is to say I think it's being rather slow if working at all. I usually use wget an this one file which I downloaded earlier with wget ...
0
votes
1answer
986 views

piping curl's response headers

I'm getting weird results when trying to capture curl's response headers in a variable: pattern="< Content-Length: " val=$(curl --verbose \ --request POST --data "desc=hello world" \ ...
4
votes
3answers
13k views

URL to reboot a WebSTAR DPC2100R2 cable modem with curl?

Does anyone know what the magic URL is for rebooting a WebSTAR DPC2100R2 with curl? I used to have a SurfBoard, and the curl command: curl ...
3
votes
1answer
876 views

Force curl to download an empty file

In a bash script, I am using curl command on linux to download files from a FTP server. The command I am using is the following (the information about the FTP server connexion is stored in a .netrc ...
735
votes
6answers
630k views

What is the cURL command-line syntax to do a POST request?

How do I make a POST request with cURL command-line tool?