curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

learn more… | top users | synonyms

0
votes
1answer
168 views

How to download the latest version of youtube-dl programmatically?

The latest version of youtube-dl is at: https://yt-dl.org/downloads/latest/ which redirects to (as of today): https://yt-dl.org/downloads/2015.07.04/ I'd like to set up a cron job to download the ...
0
votes
2answers
213 views

Curl post form and get result

I found this website http://www.fonefinder.net/findome.php , that locates phone provider by number (ex: http://www.fonefinder.net/findome.php?npa=562&nxx=866&thoublock=1666) shows VERIZON ...
2
votes
2answers
278 views

How can I instruct curl to reuse credentials after it followed a redirect?

I know that curl can follow redirects (the -L argument), and I know that I can provide credentials to a request (-u username:password), but I want to use both all the way down the redirect chain. How ...
5
votes
2answers
285 views

Firebug and cURL

I have been using Firebug and cURL for quite a while. Firebug is amazing to capture HTTPS POST request as opposed to a network analyser as it is aware of SSL/TLS negotiation. And cURL is amazing to ...
0
votes
1answer
496 views

Using a curl scheduled task in windows

I am using the following command in a scheduled task in windows to update my IP to the free Dynamic DNS service called EntryDNS: curl.exe -k -X PUT -d "" "Their url API string here" The problem I am ...
1
vote
0answers
61 views

Run bash command from link in browser

Is there a way to run an arbitrary command on OSX by clicking a link in the browser? As you know, there are certain types of hyperlinks that launch certain applications with a specified action, for ...
2
votes
1answer
687 views

Site displays with Curl but not within the browser

I've set up a dev-enviroment on Debian 7 and installed the following services: Apache Bind9 I have one site that is reachable through "asix.debian.local". I've set up the zone and added NS and A ...
0
votes
1answer
122 views

curl ignore --data starting with @ sign: don't read from file

In slack you can script slackbot to post messages to a channel like this: curl --data "$msg" $'https://<yourteam>.slack.com/services/hooks/slackbot?token=<yourtoken>&channel=#random' ...
3
votes
1answer
865 views

Why does “curl” command work normally while “ping” not?

I find a strange phenomenon in my corporate network: I can execute curl google.com command successfully: [root@localhost ~]# curl google.com <HTML><HEAD><meta http-equiv="content-...
0
votes
0answers
230 views

Why do wget and curl fail to download page source?

Via a shell script, I would like to download the source for a web page with air quality data on aqicn.org. Here is the URL for the page with Beijing air quality data: http://aqicn.org/city/beijing/m/ ...
22
votes
3answers
14k views

Is “curl -u username:password http://example.com” secure?

Is curl -u username:password http://example.com secure? If not, can you give a brief explanation of how someone could obtain your password?
0
votes
3answers
110 views

Why can't the guest of VirtualBox connect to network?

I have installed CentOS 7 on virtualbox, and network setting is NAT. The guest can't connect to network: systemctl -l status network output likes this: ip addr output likes this: Could anyone ...
1
vote
1answer
293 views

curl capturing http status and timing the request

I have a loop in wich I check urls from file one-by-one and want to get the status header and the execution time of every request as result. I have two curl commands: This one outputs the header ...
0
votes
2answers
746 views

use curl to download and yum to install (NTLM proxy issues)

I need to use a wi-fi under a corporate environment with my Fedora 21. It uses NTLM. With curl i've been able to reach sites (yahoo) setting the proxy, the type of proxy, the user and the password, ...
0
votes
1answer
428 views

Using curl to simulate Internet Explorer's auto logon

I have a webpage on my intranet in which Internet Explorer can automatically login using whatever user is logged in the network. How can I use curl (or: what are the HTTP headers I need) in order to ...
2
votes
0answers
278 views

Posting XML wrapped in SOAP posted using Curl results in invalid XML character was found exceptions

Sending an XML file using curl results in: Invalid XML character (Unicode : 0x<integer>) Attempt to solve the issue According to this SO answer the issue will be solved if the XML version is ...
1
vote
1answer
342 views

debugging a curl request / what would be the curl request to test whether a given username / password is working against a speciific smtp server

I have a customer using a specific app that uses secure smtp to connect for outgoing email. I have a suspicion that it somehow got changed (whether by them or by the hosting provider is irrelevant). I ...
1
vote
0answers
45 views

Access Websites & Modify Web Contents [closed]

so I'm given a website, and it requires me to use a token to get in. Is there any way I can do this on a normal web browser? I've been using curl -X GET in the Linux terminal. Also, how can I modify ...
-1
votes
2answers
1k views

How to use,run cURL tool with Android Studio on windows environment? [duplicate]

What is better way to use cURL tool with Android Studio 1.1.x on Windows? because there is no proper information in official site for client tools on windows environment. I tried to download from ...
2
votes
0answers
308 views

Why doesn’t curl install and run on my 64-bit Windows 8 system but the 32-bit version works fine?

I almost gave up installing cURL on my 64-bit Windows 8 system. I tried almost every single .zip, .exe, etc… on this site, but none of them worked. I got this message every single time: The ...
0
votes
1answer
570 views

understanding sending post request (with curl)

alright, I know related questions have been answered : What is the cURL command-line syntax to do a POST request? http://stackoverflow.com/questions/14978411/http-post-and-get-using-curl-in-linux ...
0
votes
1answer
70 views

Send HTTP request with parameters file

My question is very simple : is it possible to send a HTTP request from the *nix command line specifying a file, containing all the parameters, as an argument? In REST APIs documentation, we often ...
0
votes
2answers
348 views

Log date and external ip address with curl and batch (Windows)

I am having weird issues where my external IP is changed VERY often as in every 2, 3 minutes. I have a dynamic dns service in place that I update via task scheduler with curl called in a batch file. ...
1
vote
0answers
161 views

FTP: wildcard downloading

I am trying to download a file with name ending with *.csv The problem is complicated by the fact that this *.csv contains in directory of unknown name: eg. Sometimes it would be 2015->Date 29:10:...
10
votes
2answers
9k views

How can I use curl with ::1 for ipv6 based loopback?

I tried a few ways but they seem to be confusing curl. root@testt:~# curl localhost:8080 <h1>Hello world!</h1> <p>Boom Bam Splat</p> root@testt:~# curl ::1:8080 curl: (3) ...
1
vote
1answer
679 views

How to use .pfx in certificate store in CURL for Windows 7

I want to use cURL to access a remote server, and I need to identify myself using a private key or the remote server gives a 401 "Unauthorized". I'm on Windows 7 (work machine, not my choice) and my ...
2
votes
1answer
185 views

Bulk SFTP download of files specified by URL preserving directories

I have a list of several hundred files I need to pull via SFTP. They are located in various directories and I need them to be in the same directory setup on my local machine. It is important the files ...
0
votes
1answer
180 views

How accurate is CURL's 'current rate' in the progress meter?

Is the second-by-second output in curl accurate "enough"? What is the period that the "current rate" is calculated over? I am currently using the second-by-second status output in Curl as a general ...
0
votes
1answer
119 views

How can you lock computer while using curl to download files?

I’m using a Python script in the Terminal in Mac OS X 10.10.2 to download many files from a webpage using curl. However sometimes I might want to lock my computer and walk away but this terminates my ...
0
votes
1answer
518 views

Escape semicolon curl with -u option

I can't wrap my head around how to escape semicolon in username while making a GET request. curl -u testclient:sdtest1:pass -XGET -H "Content-type:application/json" \ http://localhost:8081/hello ...
1
vote
0answers
291 views

I destroyed my Mac's PHP setup: SSL certification fails

Long story short, I deleted the PHP symlink on my Mac, and replaced it with a symlink from XAMPP. Now it seems that there's a problem with my SSL configuration or what seems to me, a lack thereof. ...
0
votes
0answers
21 views

How to check what kind of files web page consists

Is there a way to check what files web page consists. For example I want to download .txt files from the web page, but I dont want all .txt files, some of them, and before I want to check are there ...
0
votes
1answer
242 views

Is there a way to download all .txt files from the page via curl or wget command

My question is in a title: Is there a way to download all .txt files from the page via curl or wget command? Thanks
2
votes
1answer
1k views

Exit bash script when curl gets a non 200 HTTP status

I have a bash script setup to perform a few curl requests for currency in EUR INR JPY do curl -i --data '{"currency": "'$currency'"}' -H "Accept: application/json" -H "Content-Type: application/...
3
votes
1answer
822 views

dyld: Library not loaded: /usr/lib/libcurl.4.dylib curl SSL error

I'm not sure what happened to my system but I am having an issue with dyld/curl, affecting my overall computer performance. I am on Yosemite. I have a feeling it's the Conda openssl. How do I just ...
0
votes
0answers
849 views

Why is cURL slower than wget

Test page: https://www.beobank.be/nl/Home.aspx This is the result using wget (or a real browser): # time wget https://www.beobank.be/nl/Home.aspx -O /dev/null --2015-01-26 12:05:46-- https://www....
0
votes
0answers
79 views

Prevent WAMP from loading external requests

I need to prevent wamp from loading external links in order to have a better performance I'm using PrestaShop and sometimes it looks for updates and currency rates etc which slows down loading the ...
0
votes
1answer
190 views

cURL: HTTP file download

I have tried to download a file using curl "https://www.dropbox.com/s/tf7e7vndqd9hv05/Ace_The_IELTS.pdf?dl=0" -o "file.pdf" but it downloads a file which is of few bytes. When I open the link in the ...
0
votes
1answer
69 views

how to download pictures with wget

i would like to download pictures from http://myhomepage.com/plots/20150111-03/4711/4712.png every 3 hours. "20150111-03" is variable, rest is stable. That means every 3 hours the download looks like: ...
2
votes
1answer
2k views

Error executing sftp with curl

I'm using IBM's Data Explorer to import certain data, but am getting this error: Protocol sftp not supported or disabled in libcurl. So from Red Hat I manually ran the command: curl -user sftp:/...
1
vote
2answers
697 views

What's the exit code for “curl -I” when not HTTP 200?

I want to check what HTTP status code is returned for an HTTP(S) URL. I don't care about content, so I just request head with curl -I $url or curl --head $url But what's the exit code I should ...
0
votes
0answers
351 views

Cannot curl webserver from outside network

I have a webserver running on one of my home computers. I am able to access it within my network, on another computer, with curl localWebserverIP:8888. However, I am having issues accessing it from ...
0
votes
1answer
267 views

RPM created using checkinstall giving dependency error

Compiled openssl-1.0.1.i using commands: export CFLAGS="-fPIC" ./config shared --openssldir=/usr/share/ssl make depend make all make install here it is not asking for any dependencies I am able to ...
1
vote
3answers
203 views

Bash: executing concatenated variables

I have a Linux bash script, to the effect of: COMMAND_TO_EXECUTE="foo "$1" --option1 --option2 "$2 exec $COMMAND_TO_EXECUTE Problem: the script fails Debugging clue, If I echo $...
2
votes
1answer
2k views

Mac OS X Yosemite and Client SSL Certificates

Ever since I upgraded from Mavericks to Yosemite, my SSL Client Certificates have stopped working in certain places. They still work in web browsers and in wget, but they have stopped working in curl ...
0
votes
1answer
61 views

Download file on unix from target url which autodownloads file on page visit

I'm trying to download a file to a unix machine on the command line. Accessing a GUI on this particular machine would be quite difficult. The file is autodownloaded when visiting the url in a web ...
0
votes
1answer
259 views

Posting XML through cURL using --data-binary

I have this really typical problem. I have an XML file that I have to post to a server. I was told by the network engineer of that site to use the cURL function. The function that he provided to me ...
21
votes
2answers
11k views

Can cURL send requests to sockets?

I can find nothing about this on Google or the cURL man pages. I have a HTTP server running at /var/run/my-server.sock, and I want to test it by sending a simple request using cURL. Can this be done ...
0
votes
1answer
567 views

Where does a file downloaded with CURL go on the file system?

Ive downloaded a file from this site with the following curl command: https://www.modern.ie/en-us/virtualization-tools#downloads # Copy/paste the command below into your terminal to begin ...
27
votes
3answers
15k views

Curl local host names on Mac OS X Yosemite

I just upgraded from Mavericks to Yosemite, and now curl can't see loopback host names. Set up a simple http server to test: $ python -m SimpleHTTPServer Serving HTTP on 0.0.0.0 port 8000 ... Now ...