curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

learn more… | top users | synonyms

5
votes
1answer
36 views

Firebug and cURL

I have been using Firebug and cURL for quite a while. Firebug is amazing to capture HTTPS POST request as opposed to a network analyser as it is aware of SSL/TLS negotiation. And cURL is amazing to ...
2
votes
1answer
19 views

Archiving websites like Internet Archive

Most of the data for my research needs are met by our Government websites. Problem is they take down websites or certain pages or break the links. But my research demands the access to information ...
0
votes
0answers
21 views

curl could not open remote file permission denied using sftp

I'm trying to download a file from a new enduser sftp using existing code that works for other end user sftps, using curl. This is my basic command: curl -o [internalFileLocation] -u [user:pw] ...
0
votes
2answers
79 views

use curl to download and yum to install (NTLM proxy issues)

I need to use a wi-fi under a corporate environment with my Fedora 21. It uses NTLM. With curl i've been able to reach sites (yahoo) setting the proxy, the type of proxy, the user and the password, ...
4
votes
1answer
2k views

Specifying minor TLS version when using curl

Is there a way to specify curl to use a specific TLS version? Like 1.1 or 1.2? I can see only sslv3 and tlsv1 options in command help. I took latest src and compiled it with openssl 1.0.1e. Still dont ...
0
votes
1answer
15 views

Using a curl scheduled task in windows

I am using the following command in a scheduled task in windows to update my IP to the free Dynamic DNS service called EntryDNS: curl.exe -k -X PUT -d "" "Their url API string here" The problem I am ...
5
votes
2answers
15k views

how to get and use certificates with curl

1) Entering the following command curl -k email@mail.com:password https://www.site.com Returns the following error <HTML><HEAD><meta http-equiv="content-type" ...
1
vote
2answers
3k views

CURL Error version OPENSSL_1.0.1 'not found …'

I have the last few days, a concern with CURL. I get this error: curl: / lib/i386-linux-gnu/libssl.so.1.0.0: version `OPENSSL_1.0.1 'not found (required by / usr/lib/i386-linux-gnu / libcurl.so.4) ...
3
votes
1answer
3k views

How can I download private repo from github?

What I want to do is to download private repository archive from GitHub, extract it, remove archive file and copy some directories that are inside downloaded project. I tried to use wget but I cannot ...
1
vote
0answers
23 views

Run bash command from link in browser

Is there a way to run an arbitrary command on OSX by clicking a link in the browser? As you know, there are certain types of hyperlinks that launch certain applications with a specified action, for ...
2
votes
2answers
1k views

Can cURL send requests to sockets?

I can find nothing about this on Google or the cURL man pages. I have a HTTP server running at /var/run/my-server.sock, and I want to test it by sending a simple request using cURL. Can this be done ...
0
votes
1answer
3k views

curl failed setting cipher list

I'm trying to make curl use GOST2001-GOST89-GOST89 cipher which is available and usable by OpenSSL but keep getting failed setting cipher list error despite the fact that curl sees gost engine and can ...
2
votes
1answer
25 views

Site displays with Curl but not within the browser

I've set up a dev-enviroment on Debian 7 and installed the following services: Apache Bind9 I have one site that is reachable through "asix.debian.local". I've set up the zone and added NS and A ...
0
votes
1answer
5k views

Curl Returns “Connection Refused” when trying to access localhost

I am running Xampp (Apache, Mysql and PHP) on my Windows Vista computer. I have curl installed on my machine. When I try to curl my localhost in the command prompt, I get the following: curl -v -i ...
1
vote
0answers
9 views

PHP cURL Request for Web Service Returning Error [migrated]

I continue to receive the error: "Failed to de-serialize entity" when making the REST request below. I'm assuming it has to do with the formatting of my json, but can't for the life of me figure it ...
0
votes
1answer
8 views

curl ignore --data starting with @ sign: don't read from file

In slack you can script slackbot to post messages to a channel like this: curl --data "$msg" $'https://<yourteam>.slack.com/services/hooks/slackbot?token=<yourtoken>&channel=#random' ...
3
votes
1answer
102 views

Why does “curl” command work normally while “ping” not?

I find a strange phenomenon in my corporate network: I can execute curl google.com command successfully: [root@localhost ~]# curl google.com <HTML><HEAD><meta ...
0
votes
3answers
39 views

Why can't the guest of VirtualBox connect to network?

I have installed CentOS 7 on virtualbox, and network setting is NAT. The guest can't connect to network: systemctl -l status network output likes this: ip addr output likes this: Could anyone ...
0
votes
0answers
42 views

Why do wget and curl fail to download page source?

Via a shell script, I would like to download the source for a web page with air quality data on aqicn.org. Here is the URL for the page with Beijing air quality data: http://aqicn.org/city/beijing/m/ ...
21
votes
2answers
3k views

Is “curl -u username:password http://example.com” secure?

Is curl -u username:password http://example.com secure? If not, can you give a brief explanation of how someone could obtain your password?
1
vote
1answer
28 views

curl capturing http status and timing the request

I have a loop in wich I check urls from file one-by-one and want to get the status header and the execution time of every request as result. I have two curl commands: This one outputs the header ...
0
votes
0answers
30 views

Pipe remote jpg webcam image to ffmpeg as video

I have a cheap ip webcam. All it provides is a single http url to a static jpg file. Such as http:///image.jpg. Repeatedly requesting the same url will provide subsequent frames from the ip camera. ...
1
vote
2answers
219 views

What's the exit code for “curl -I” when not HTTP 200?

I want to check what HTTP status code is returned for an HTTP(S) URL. I don't care about content, so I just request head with curl -I $url or curl --head $url But what's the exit code I should ...
1162
votes
6answers
1.1m views
0
votes
1answer
45 views

Using curl to simulate Internet Explorer's auto logon

I have a webpage on my intranet in which Internet Explorer can automatically login using whatever user is logged in the network. How can I use curl (or: what are the HTTP headers I need) in order to ...
2
votes
0answers
71 views

Posting XML wrapped in SOAP posted using Curl results in invalid XML character was found exceptions

Sending an XML file using curl results in: Invalid XML character (Unicode : 0x<integer>) Attempt to solve the issue According to this SO answer the issue will be solved if the XML version is ...
0
votes
0answers
19 views

Return response body with curl always, but if non 2XX, don't exit with 0

How can I have curl print the response body, but if the http status code is not 2XX don't exit with a success 0 status? Using the flag --fail does not work, because it does NOT print the response ...
-1
votes
2answers
138 views

How to use,run cURL tool with Android Studio on windows environment? [duplicate]

What is better way to use cURL tool with Android Studio 1.1.x on Windows? because there is no proper information in official site for client tools on windows environment. I tried to download from ...
1
vote
1answer
34 views

debugging a curl request / what would be the curl request to test whether a given username / password is working against a speciific smtp server

I have a customer using a specific app that uses secure smtp to connect for outgoing email. I have a suspicion that it somehow got changed (whether by them or by the hosting provider is irrelevant). I ...
15
votes
8answers
36k views

wget/cURL alternative native to Windows?

Is there a wget or cURL type command line utility native to Windows Vista? How does it work?
1
vote
1answer
111 views

Downloading an authenticated large file with command line tools

I need to download a file sized around 1.6GB. I's like to get it download via a command line tool like axel, wget or curl However, how can I download a file which needs to be logged in to the site ...
0
votes
2answers
344 views

What tool does yum use to download rpm packages from remote server?

My system is centos, and now I am installing packages using yum command. Updating for dependencies: apr-util i386 1.3.9-1.el5 lxcenter-updates 203 k gcc-gfortran ...
1
vote
0answers
25 views

Access Websites & Modify Web Contents [closed]

so I'm given a website, and it requires me to use a token to get in. Is there any way I can do this on a normal web browser? I've been using curl -X GET in the Linux terminal. Also, how can I modify ...
53
votes
6answers
118k views

Run cURL commands from Windows console

Is there a way to install cURL in windows in order to run cURL commands from the command prompt?
0
votes
2answers
669 views

Downloading and extracting a .tar to a specific directory

I want to download a tar of a git repo and extract its contents to another folder. The following line (broken up for clarity) works: curl -L -0 nt-dotfiles.tar.gz ...
2
votes
0answers
70 views

Why doesn’t curl install and run on my 64-bit Windows 8 system but the 32-bit version works fine?

I almost gave up installing cURL on my 64-bit Windows 8 system. I tried almost every single .zip, .exe, etc… on this site, but none of them worked. I got this message every single time: The ...
0
votes
0answers
140 views

Download file vis cURL, but not with Wget

I have a link I'm trying to download. Before, we could download with either Wget or cURL because the website (which runs under Tomcat) didn't require a user name or password in order to download. ...
0
votes
1answer
129 views

understanding sending post request (with curl)

alright, I know related questions have been answered : What is the cURL command-line syntax to do a POST request? http://stackoverflow.com/questions/14978411/http-post-and-get-using-curl-in-linux ...
0
votes
1answer
34 views

Send HTTP request with parameters file

My question is very simple : is it possible to send a HTTP request from the *nix command line specifying a file, containing all the parameters, as an argument? In REST APIs documentation, we often ...
25
votes
2answers
74k views

How to send POST with body, headers, and HTTP params using cURL?

I found a lot of examples on how to use simple POST commands in cURL, but I didn't find examples on how to send full HTTP POST commands, which contain: Headers (Basic Authentication) HTTP Params ...
0
votes
2answers
4k views

How to download a file behind authentication via Wget or cURL [duplicate]

Possible Duplicate: Wget a page that requires logging in I wish to download file from http://mbr.nlm.nih.gov/Download/MetaMapped_Medline/2011/. However, in order to download the file, I ...
0
votes
2answers
86 views

Log date and external ip address with curl and batch (Windows)

I am having weird issues where my external IP is changed VERY often as in every 2, 3 minutes. I have a dynamic dns service in place that I update via task scheduler with curl called in a batch file. ...
1
vote
0answers
46 views

FTP: wildcard downloading

I am trying to download a file with name ending with *.csv The problem is complicated by the fact that this *.csv contains in directory of unknown name: eg. Sometimes it would be 2015->Date ...
1
vote
2answers
336 views

Upload image to postimage.org using curl

I found a script that can upload image to postimage.org using curl. It was posted not long ago, on 2013-09-06, at http://crunchbang.org/forums/viewtopic.php?id=28867. The simplified script looks like ...
0
votes
1answer
39 views

How accurate is CURL's 'current rate' in the progress meter?

Is the second-by-second output in curl accurate "enough"? What is the period that the "current rate" is calculated over? I am currently using the second-by-second status output in Curl as a general ...
6
votes
1answer
537 views

How can I use a command line tool like Wget to log into an OpenID site?

Specifically, I would like to be able to download certain pages from my user profile on the various Stack Exchange sites. I would, however, like to do this automatically (using a cron job), from ...
1
vote
2answers
364 views

How can I use curl with ::1 for ipv6 based loopback?

I tried a few ways but they seem to be confusing curl. root@testt:~# curl localhost:8080 <h1>Hello world!</h1> <p>Boom Bam Splat</p> root@testt:~# curl ::1:8080 curl: (3) ...
0
votes
0answers
13 views

Curl should be quit but it returns ever something

I tried to login to a website using curl in a bash-script. It is possible to login to the site quiently using this: curl -d "username=$username&passwd=$passwd" -c $cookiefile ...
1
vote
1answer
50 views

Bulk SFTP download of files specified by URL preserving directories

I have a list of several hundred files I need to pull via SFTP. They are located in various directories and I need them to be in the same directory setup on my local machine. It is important the files ...
0
votes
0answers
189 views

How to use .pfx in certificate store in CURL for Windows 7

I want to use cURL to access a remote server, and I need to identify myself using a private key or the remote server gives a 401 "Unauthorized". I'm on Windows 7 (work machine, not my choice) and my ...