curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

learn more… | top users | synonyms

0
votes
1answer
87 views

Escape semicolon curl with -u option

I can't wrap my head around how to escape semicolon in username while making a GET request. curl -u testclient:sdtest1:pass -XGET -H "Content-type:application/json" \ http://localhost:8081/hello ...
4
votes
1answer
3k views

Specifying minor TLS version when using curl

Is there a way to specify curl to use a specific TLS version? Like 1.1 or 1.2? I can see only sslv3 and tlsv1 options in command help. I took latest src and compiled it with openssl 1.0.1e. Still dont ...
5
votes
2answers
16k views

how to get and use certificates with curl

1) Entering the following command curl -k email@mail.com:password https://www.site.com Returns the following error <HTML><HEAD><meta http-equiv="content-type" ...
0
votes
1answer
30 views

How to upload all the files from local to host using Curl?

i have written a shell script to upload all files with different names in the specific path from local to host, but i have facing some issue and the files are not getting uploaded #!/bin/sh for file ...
-1
votes
2answers
277 views

Curl with ipv6 not working by default

I am trying to curl ipv6 adresses, but without success. If i try lets say: curl https://google.com I wait for a timeout and get network unreachable If i force ipv4, everything is fine. ...
124
votes
7answers
131k views

Getting curl to output HTTP status code?

I'm using curl at the command line on Linux to issue HTTP requests. The response bodies are printed to standard out, which is fine, but I can't see from the man page how to get curl to print the ...
3
votes
1answer
3k views

How can I download private repo from github?

What I want to do is to download private repository archive from GitHub, extract it, remove archive file and copy some directories that are inside downloaded project. I tried to use wget but I cannot ...
0
votes
0answers
41 views

Curl: How to send custom headers while using proxy

I want to send custom headers to the host while using proxies. Take a look at the examples below. Explaining the situation with examples was easier. This works fine as expected: curl ...
1
vote
2answers
3k views

CURL Error version OPENSSL_1.0.1 'not found …'

I have the last few days, a concern with CURL. I get this error: curl: / lib/i386-linux-gnu/libssl.so.1.0.0: version `OPENSSL_1.0.1 'not found (required by / usr/lib/i386-linux-gnu / libcurl.so.4) ...
2
votes
1answer
619 views

Mac OS X Yosemite and Client SSL Certificates

Ever since I upgraded from Mavericks to Yosemite, my SSL Client Certificates have stopped working in certain places. They still work in web browsers and in wget, but they have stopped working in curl ...
2
votes
2answers
94 views

Fast way to download many small webpages?

I need to download lots of small pages as fast as possible. Average size for one page is 3kb. There are millions of pages. First, I tried curl but it was way too slow, probably because it was waiting ...
0
votes
1answer
3k views

curl failed setting cipher list

I'm trying to make curl use GOST2001-GOST89-GOST89 cipher which is available and usable by OpenSSL but keep getting failed setting cipher list error despite the fact that curl sees gost engine and can ...
0
votes
1answer
5k views

Curl Returns “Connection Refused” when trying to access localhost

I am running Xampp (Apache, Mysql and PHP) on my Windows Vista computer. I have curl installed on my machine. When I try to curl my localhost in the command prompt, I get the following: curl -v -i ...
1
vote
1answer
36 views

What is the correct way to submit content-type header in curl?

I’m using Mac 10.9.5 with bash shell. I’m trying to submit a request via curl, but I keep getting errors when I try and set the content-type header. Below I try davea$ curl -v -o -H "Content-Type: ...
0
votes
1answer
35 views

How to download the latest version of youtube-dl programmatically?

The latest version of youtube-dl is at: https://yt-dl.org/downloads/latest/ which redirects to (as of today): https://yt-dl.org/downloads/2015.07.04/ I'd like to set up a cron job to download the ...
0
votes
2answers
56 views

Curl post form and get result

I found this website http://www.fonefinder.net/findome.php , that locates phone provider by number (ex: http://www.fonefinder.net/findome.php?npa=562&nxx=866&thoublock=1666) shows VERIZON ...
1
vote
1answer
18 views

How can I instruct curl to reuse credentials after it followed a redirect?

I know that curl can follow redirects (the -L argument), and I know that I can provide credentials to a request (-u username:password), but I want to use both all the way down the redirect chain. How ...
6
votes
4answers
23k views

Downloading file from FTP using cURL

I'm trying to use a cURL command to download a file from an FTP server to a local drive on my computer. I've tried curl "ftp://myftpsite" --user name:password -Q "CWD /users/myfolder/" -O ...
5
votes
1answer
90 views

Firebug and cURL

I have been using Firebug and cURL for quite a while. Firebug is amazing to capture HTTPS POST request as opposed to a network analyser as it is aware of SSL/TLS negotiation. And cURL is amazing to ...
2
votes
1answer
36 views

Archiving websites like Internet Archive

Most of the data for my research needs are met by our Government websites. Problem is they take down websites or certain pages or break the links. But my research demands the access to information ...
0
votes
0answers
61 views

curl could not open remote file permission denied using sftp

I'm trying to download a file from a new enduser sftp using existing code that works for other end user sftps, using curl. This is my basic command: curl -o [internalFileLocation] -u [user:pw] ...
0
votes
2answers
109 views

use curl to download and yum to install (NTLM proxy issues)

I need to use a wi-fi under a corporate environment with my Fedora 21. It uses NTLM. With curl i've been able to reach sites (yahoo) setting the proxy, the type of proxy, the user and the password, ...
0
votes
1answer
41 views

Using a curl scheduled task in windows

I am using the following command in a scheduled task in windows to update my IP to the free Dynamic DNS service called EntryDNS: curl.exe -k -X PUT -d "" "Their url API string here" The problem I am ...
1
vote
0answers
32 views

Run bash command from link in browser

Is there a way to run an arbitrary command on OSX by clicking a link in the browser? As you know, there are certain types of hyperlinks that launch certain applications with a specified action, for ...
2
votes
2answers
2k views

Can cURL send requests to sockets?

I can find nothing about this on Google or the cURL man pages. I have a HTTP server running at /var/run/my-server.sock, and I want to test it by sending a simple request using cURL. Can this be done ...
2
votes
1answer
43 views

Site displays with Curl but not within the browser

I've set up a dev-enviroment on Debian 7 and installed the following services: Apache Bind9 I have one site that is reachable through "asix.debian.local". I've set up the zone and added NS and A ...
0
votes
1answer
12 views

curl ignore --data starting with @ sign: don't read from file

In slack you can script slackbot to post messages to a channel like this: curl --data "$msg" $'https://<yourteam>.slack.com/services/hooks/slackbot?token=<yourtoken>&channel=#random' ...
3
votes
1answer
149 views

Why does “curl” command work normally while “ping” not?

I find a strange phenomenon in my corporate network: I can execute curl google.com command successfully: [root@localhost ~]# curl google.com <HTML><HEAD><meta ...
0
votes
3answers
45 views

Why can't the guest of VirtualBox connect to network?

I have installed CentOS 7 on virtualbox, and network setting is NAT. The guest can't connect to network: systemctl -l status network output likes this: ip addr output likes this: Could anyone ...
0
votes
0answers
52 views

Why do wget and curl fail to download page source?

Via a shell script, I would like to download the source for a web page with air quality data on aqicn.org. Here is the URL for the page with Beijing air quality data: http://aqicn.org/city/beijing/m/ ...
21
votes
2answers
3k views

Is “curl -u username:password http://example.com” secure?

Is curl -u username:password http://example.com secure? If not, can you give a brief explanation of how someone could obtain your password?
1
vote
1answer
36 views

curl capturing http status and timing the request

I have a loop in wich I check urls from file one-by-one and want to get the status header and the execution time of every request as result. I have two curl commands: This one outputs the header ...
0
votes
0answers
54 views

Pipe remote jpg webcam image to ffmpeg as video

I have a cheap ip webcam. All it provides is a single http url to a static jpg file. Such as http:///image.jpg. Repeatedly requesting the same url will provide subsequent frames from the ip camera. ...
1
vote
2answers
268 views

What's the exit code for “curl -I” when not HTTP 200?

I want to check what HTTP status code is returned for an HTTP(S) URL. I don't care about content, so I just request head with curl -I $url or curl --head $url But what's the exit code I should ...
1202
votes
6answers
1.1m views
0
votes
1answer
64 views

Using curl to simulate Internet Explorer's auto logon

I have a webpage on my intranet in which Internet Explorer can automatically login using whatever user is logged in the network. How can I use curl (or: what are the HTTP headers I need) in order to ...
2
votes
0answers
94 views

Posting XML wrapped in SOAP posted using Curl results in invalid XML character was found exceptions

Sending an XML file using curl results in: Invalid XML character (Unicode : 0x<integer>) Attempt to solve the issue According to this SO answer the issue will be solved if the XML version is ...
0
votes
0answers
33 views

Return response body with curl always, but if non 2XX, don't exit with 0

How can I have curl print the response body, but if the http status code is not 2XX don't exit with a success 0 status? Using the flag --fail does not work, because it does NOT print the response ...
-1
votes
2answers
202 views

How to use,run cURL tool with Android Studio on windows environment? [duplicate]

What is better way to use cURL tool with Android Studio 1.1.x on Windows? because there is no proper information in official site for client tools on windows environment. I tried to download from ...
1
vote
1answer
52 views

debugging a curl request / what would be the curl request to test whether a given username / password is working against a speciific smtp server

I have a customer using a specific app that uses secure smtp to connect for outgoing email. I have a suspicion that it somehow got changed (whether by them or by the hosting provider is irrelevant). I ...
17
votes
8answers
38k views

wget/cURL alternative native to Windows?

Is there a wget or cURL type command line utility native to Windows Vista? How does it work?
1
vote
1answer
119 views

Downloading an authenticated large file with command line tools

I need to download a file sized around 1.6GB. I's like to get it download via a command line tool like axel, wget or curl However, how can I download a file which needs to be logged in to the site ...
0
votes
2answers
353 views

What tool does yum use to download rpm packages from remote server?

My system is centos, and now I am installing packages using yum command. Updating for dependencies: apr-util i386 1.3.9-1.el5 lxcenter-updates 203 k gcc-gfortran ...
1
vote
0answers
27 views

Access Websites & Modify Web Contents [closed]

so I'm given a website, and it requires me to use a token to get in. Is there any way I can do this on a normal web browser? I've been using curl -X GET in the Linux terminal. Also, how can I modify ...
54
votes
6answers
121k views

Run cURL commands from Windows console

Is there a way to install cURL in windows in order to run cURL commands from the command prompt?
0
votes
2answers
715 views

Downloading and extracting a .tar to a specific directory

I want to download a tar of a git repo and extract its contents to another folder. The following line (broken up for clarity) works: curl -L -0 nt-dotfiles.tar.gz ...
2
votes
0answers
101 views

Why doesn’t curl install and run on my 64-bit Windows 8 system but the 32-bit version works fine?

I almost gave up installing cURL on my 64-bit Windows 8 system. I tried almost every single .zip, .exe, etc… on this site, but none of them worked. I got this message every single time: The ...
0
votes
0answers
155 views

Download file vis cURL, but not with Wget

I have a link I'm trying to download. Before, we could download with either Wget or cURL because the website (which runs under Tomcat) didn't require a user name or password in order to download. ...
0
votes
1answer
192 views

understanding sending post request (with curl)

alright, I know related questions have been answered : What is the cURL command-line syntax to do a POST request? http://stackoverflow.com/questions/14978411/http-post-and-get-using-curl-in-linux ...
0
votes
1answer
37 views

Send HTTP request with parameters file

My question is very simple : is it possible to send a HTTP request from the *nix command line specifying a file, containing all the parameters, as an argument? In REST APIs documentation, we often ...