curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

learn more… | top users | synonyms

2
votes
0answers
27 views

How to add a 'greek' character in the path using cURL?

I have a Makefile where one of many tasks is to upload a file using cURL, one of these files, has a greek character in the name and when I try to upload using cURL, I receive this error: curl: (43) A ...
0
votes
1answer
111 views

curl bails on download in cygwin but not os x

I'm trying to download a copy of a postgresql db from Amazon S3 in cygwin. But it yields zero's across the board yielding a useless file. This is my curl command: curl `heroku.bat pgbackups:url` -o ...
0
votes
1answer
785 views

cURL “response reading failed” in FTPS file transfer

I am trying to download a directory and it's files using cURL via FTPS. The following command gets me very close - I successfully logged in and set the clear command channel, but then it fails with ...
-1
votes
1answer
151 views

POST to web form using CURL & BASH

I'm trying, without success, to use cURL to post data to the form on this URL: https://nic.ar/buscarDominio.xhtml how can i correctly send the request to the server? I've analysed the post data ...
0
votes
3answers
291 views

Is it possible to get the download file name of an mp3 from server using bash?

I am trying to get the final download file name of an mp3 from a server, specifically audiotool.com e.g. http://api.audiotool.com/track/haunt_opaque/mixdown.mp3 When you navigate to this url in a ...
0
votes
1answer
749 views

How can I apply quotes to a URL in a .bat script?

The general form of a curl command in CMD that works is: curl -o latest.dump -L ...
0
votes
0answers
41 views

Curl to update dyndns record for *.domain.com

I use curl to update my dns whenever my ip changes and it works as expected. url = domain.com user = username pass = password ext = 123.123.123.123 curl -s --ssl --user "$user:$pass" ...
0
votes
0answers
18 views

upload Multiple xml on https form

I have a annoying problem, I must send daily +-100 xml files over a https,an upload form without a layout and can't see which files are on the server. Synch isnt allowed. I've tried everything, the ...
3
votes
1answer
861 views

curl: (7) Failed connect to www.google.com:80;

I have installed Git for Windows and got cURL automatically. C:\>curl --version curl 7.30.0 (i386-pc-win32) libcurl/7.30.0 OpenSSL/0.9.8y zlib/1.2.7 Protocols: dict file ftp ftps gopher http https ...
0
votes
1answer
868 views

Mac OSX 10.9 resume folder copy to NAS

I have a really big folder (174GB) that I wanted to move to a NAS using Ethernet. I started the transfer and when it was neary finished the computer stopped (I accidentally disabled caffeine) and the ...
3
votes
2answers
876 views

bash: source from URL

In addition to my own computer, I sometimes use an Ubuntu cluster at my school. Rather than manually keep my .bashrc's in sync, I would like to make the school cluster's .bashrc source my personal ...
5
votes
2answers
9k views

POSTing a file's contents with CURL

(The following is backstory, you can jump down to "Question:" if you'd like) There's a webpage for one of my courses that accepts input text (expected to be Python code) and then gives some tokenized ...
19
votes
4answers
22k views

cURL: how to suppress strange output when redirecting?

I'm trying to print just the verbose sections of a cURL request (which are sent to stderr) from the bash shell. But when I redirect stdout like this: curl -v http://somehost/somepage > /dev/null ...
0
votes
0answers
128 views

How to emulate a cookie-based browser with curl?

The title tells pretty much everything. I need curl to both GET and POST as a web browser while accepting cookies.
0
votes
1answer
272 views

Curl can't follow “This page should automatically redirect”

I'm attempting to automate a login for the a course webpage I have to check this semester. I know that the POST request I am making is being done correctly because I get to the intermediate redirect ...
0
votes
0answers
213 views

How to set curl -o to any desired location in AppleScript?

I have a basic question about curl -o. I just want to make a short AppleScript. does shell script "curl -f 'http://www.SOMEWEBSIT.COM/ANYIMAGE.jpg' -o ~/Desktop/ANYIMAGE.jpg" tell application ...
0
votes
1answer
321 views

How can I get more information from Curl regarding a FTP 425 “Cannot open data connection” error?

I am trying to upload a file with the following line: curl -3 --ftp-pasv --ftp-ssl-control -v -i -T ./mybigfile.gz ftp://lawrence@mecloud.xxxxxxx.co.uk:21/OnlineBackup/Lawrence/ --insecure -u ...
0
votes
1answer
165 views

Using cURL to retreive public IP for tmux config creates too many connections

I am currently using the command: curl icanhazip.com and the option set -g status-left ... in my tmux.conf to retrieve and display my public IP in status bar. This works great, although I am really ...
1
vote
0answers
13 views

Sporadic loss of access to local server

For some reason, I lose access to a local server called lux-app04 seemingly at random, but only in some applications. As you can see in the image below, Postman (top) can connect to it, but curl ...
8
votes
1answer
20k views

cURL Upload file and send POST data

I have a web server running some PHP that checks for an image (curl -F 'imageName=@myimage') and it also checks the POST data for username=&password=. When the PHP checks _REQUEST I cannot just ...
1
vote
2answers
2k views

curl and sni-enabled server

I am running curl against a sni-enabled server with the following command curl --cacert CustomCA.crt -H "Host: example.com" https://1.2.3.4/foo However, I am not getting the right certificate where ...
1
vote
3answers
7k views

Silence curl with >/dev/null 2>&1 when it's piped

So I have a curl that is piped to a grep and a sed. Where would I apply the >/dev/null 2>&1 ? curl www.site.com | grep stuff | sed "other stuff" At the very end or after the curl?
0
votes
0answers
92 views

curl won't shut up (--silent does nothing)

I'm writing a quick shell script, and I cannot for the life of me get curl to suppress the progress bar. The relevant line looks like this: curl http://website -o $temp >/dev/null 2>&1 ...
0
votes
2answers
174 views

How to download all file with name emp* using curl from a FTP site

How can I get all files downloaded from a FTP site directory with file name like emp*. Please suggest.
0
votes
1answer
93 views

How to automatically save a list of files with different names?

I have a text file of URLs, each in the form of: http://domain.com/a/b/c/d.jpg I want to download all of these, but save each file under the name: c_d.jpg In other words, for each file, I want to ...
2
votes
1answer
2k views

How to upload file with curl when --data-binary is present in tampered data?

I try to upload files to a popular website, I tampered the http POST requests with Chrome developer tools' "copy as curl" feature. When the upload begins I get this curl command: curl ...
0
votes
3answers
286 views

Is there a linux filter which converts html to simple and pretty formatted text?

I would like to filter html response coming from cURL output. Which filter should I apply? Viewing html content with Midnight Commander is no problem, it shows them as pretty formatted plain text, so ...
0
votes
0answers
327 views

How can I use Wget / Curl / Plowshare to download from 1fichier.com as a premium member?

How can I download files from 1fichier.com (I am a premium member) with the help of Wget / Curl / Plowshare (Plowdown) or other CLI / command line tool / script?
1
vote
1answer
239 views

downloading multiple files using curl, curl repeats address in download

I am running the command curl -O "http://www.*site*.com/[1-9].png" but the download is failing. - the output is as follows [1/10]: http://www.*site*.com/1http://w --> 1.png % Total % ...
0
votes
0answers
55 views

crawling google links produces 400 error

I had a google scraper some time ago that quit working when they made some security changes. I just had a task come up and realized something must of changed a lot. the best I can get with any tool to ...
1
vote
2answers
136 views

file downloaded via firefox and curl have different size

When I download a file from this link by Firefox its size is 74580 B, But when I download it by curl with exactly all of header was sent by Firefox its size is 79891 B (I copied all header from ...
1
vote
1answer
136 views

What is the curl equivalent to wget -x?

I want to use curl to save multiple files with the same local paths as would be produced by wget -x (ie, cleaned up versions of the full urls). But I can't find the right option in the curl docs. Is ...
1
vote
1answer
124 views

Curl won't work over FTP

I am trying to install Wine on my Macbook (OS X 10.9.3). First I tried using Homebrew which lists a set of dependencies and then goes to fetch the first. ==> Installing dependencies for wine: ...
0
votes
0answers
196 views

Curl to download large CSV

I am using curl through Cygwin on Windows 7 to download content from Apache Solr in CSV format. This is my command which is running in a for loop curl -o ret-key-data-$i.csv $URL As the content is ...
0
votes
1answer
196 views

cURL very long delay before starting download from ftp

I'm trying to write a script to download a file, convert it, then execute a program on the converted file. For some reason curl takes over 1 minute to start the file transfer. Command: curl ...
11
votes
2answers
9k views

how to use curl to verify if a site's certificate has been revoked?

To check if the certificate for google.com has been revoked, I tried the following command: curl https://www.google.com --cacert GeoTrust_Global_CA.pem --crlfile gtglobal.pem -v , but I got the ...
1
vote
0answers
31 views

Bug or syntax change on Debian's “curl” 7.36? Mess when trying to save sequential files with brackets/hash

(Perhaps specifically 7.36.0-1, which is shown as the most recent available on my package manager). I think there was such a bug some time ago, but perhaps it was back in curl 7.33, I can't ...
1
vote
2answers
1k views

How to stop shell script if curl failed

I have script that used curl when i pass wrong parameters to script curl failed but script continue executing. I have tried use curl -f/--fail parameter but problem does not solved. What is the best ...
0
votes
0answers
370 views

Why is SSL broken for one domain on one computer?

I've been having a strange issue, where I cannot connect to https://www.humblebundle.com. Plain HTTP works fine, as does https://humblebundle.com. These all redirect to the above address. I haven't ...
0
votes
0answers
40 views

Gzipped file arrives unzipped

I've recently set up an ArchLinux system at work and added the ArchHaskell repo. This is far from the first time I do this. I have a number of systems where it's worked just fine, but this last time ...
2
votes
0answers
457 views

loop curl could not resolve host

I've had working script, which suddenly doesn't works. It contains something like this: while read url; do curl $url done < links links file: http://duckduckgo.com http://google.com And I ...
1
vote
1answer
290 views

posting data to a web server using curl

I am trying to post data to a web sever using curl -d and curl -X POST. The command is getting succeeded but nothing is there in the file. Tried the following: [root@oooatis santoshi]# curl ...
1
vote
0answers
46 views

SOAP-request realization in DOS 6.22 16-bit

I have a task to develop some application providing SOAP-requests realization for DOS. I have already developed a similar application under Linux, using C++/STL and curl and openssl libraries. Is ...
1
vote
1answer
435 views

calling json-rpc via curl

I'am running Bitcoin-qt 0.8.6.1-beta on Qt 4.8.3 on windows 7 64. below is my .conf content in %appdata%/bitcoin folder rpcuser=bitcoinrpc rpcpassword=ahything rpcallowip=127.0.0.1 ...
1
vote
1answer
591 views

How do I comment out a line in my .curlrc?

I frequently have to switch between two different auth token request headers, that I keep in my .curlrc as such: -H "X-Auth-Token: 12345678-1234" It would make my life easier, though, if I could ...
47
votes
5answers
40k views

PowerShell equivalent of curl

Is there an equivalent of curl in PowerShell? Does it have some similar built-in capability or is there a 3rd party cmdlet?
0
votes
2answers
486 views

curl shell command always returns error status 0 - even when fails on input errors

Example: trying to upload a non existing file - curl -d @no-real-file http://google.com | echo $? - returns 0. How can I make curl fail on input errors?
3
votes
1answer
684 views

How can I get a list of all messages in my gmail account in linux command line?

How can I get a list of all messages in my gmail account in linux command line? Ideally I would want to see something similar to: from:sender1@domain.com to:me@gmail.com Date:11/22/33 subj:Foo1 ...
1
vote
2answers
402 views

cURL unable to interpret hostnames, proxy issue?

When using cURL from my ubuntu machine to merely GET from a remote machine, I seem unable to resolve the hostname and just get a Proxy Issue - The proxy has encountered an error (Error 21: Server ...
0
votes
0answers
431 views

Choose the filename when using POST with curl?

I'd like to POST a file upload with curl, and choose the filename at request time. Here's the curl line I have right now, which works to upload the file: curl --form "upload_file=@content.txt" ...