curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

learn more… | top users | synonyms

0
votes
1answer
3k views

Curl Returns “Connection Refused” when trying to access localhost

I am running Xampp (Apache, Mysql and PHP) on my Windows Vista computer. I have curl installed on my machine. When I try to curl my localhost in the command prompt, I get the following: curl -v -i ...
0
votes
0answers
10 views

Need to upload files to osx server via webdav & curl

I enabled 'Share over WebDAV' in OSX Server Mavericks and can upload a file after mounting the server in finder. However, when I try and upload a file using curl -T "file.xml" -u "user":"pass" ...
1
vote
3answers
3k views

Silence curl with >/dev/null 2>&1 when it's piped

So I have a curl that is piped to a grep and a sed. Where would I apply the >/dev/null 2>&1 ? curl www.site.com | grep stuff | sed "other stuff" At the very end or after the curl?
2
votes
2answers
7k views

how to get and use certificates with curl

1) Entering the following command curl -k email@mail.com:password https://www.site.com Returns the following error <HTML><HEAD><meta http-equiv="content-type" ...
0
votes
0answers
13 views

How can I get all urls of pattern x from a paged list of search results?

I'm using Windows 7 SP1, and I'm willing to use powershell or wget or whatever will work. I downloaded powershell today (ps 4) and I've got some scripts working, but I'm having trouble with this one. ...
0
votes
0answers
4 views

getting response data properly but server showing error code 400 [closed]

I am sending a request to server to curl as follows curl --data ...
0
votes
1answer
2k views

curl failed setting cipher list

I'm trying to make curl use GOST2001-GOST89-GOST89 cipher which is available and usable by OpenSSL but keep getting failed setting cipher list error despite the fact that curl sees gost engine and can ...
8
votes
1answer
17k views

cURL Upload file AND send POST data

I have a web server running some PHP that checks for an image (curl -F 'imageName=@myimage') and it also checks the POST data for username=&password=. When the PHP checks _REQUEST I can just do: ...
0
votes
0answers
13 views

Curl slow download from other server

I'm trying to download large files to my personal VPS server from public video sharing site . curl -o bigfile.mp4 -A "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20120101 Firefox/29.0" "URL" ...
1
vote
2answers
2k views

CURL Error version OPENSSL_1.0.1 'not found …'

I have the last few days, a concern with CURL. I get this error: curl: / lib/i386-linux-gnu/libssl.so.1.0.0: version `OPENSSL_1.0.1 'not found (required by / usr/lib/i386-linux-gnu / libcurl.so.4) ...
0
votes
0answers
19 views

curl won't shut up (--silent does nothing)

I'm writing a quick shell script, and I cannot for the life of me get curl to suppress the progress bar. The relevant line looks like this: curl http://website -o $temp >/dev/null 2>&1 ...
4
votes
1answer
341 views

How can I use a command line tool like wget to log into an OpenID site?

Specifically, I would like to be able to download certain pages from my user profile on the various SE sites. I would, however, like to do this automatically (using a cron job), from the command line ...
0
votes
0answers
10 views

Parallel download for a list of urls and renaming

I have a list of tab-separated urls, and target file names, urls_to_download.txt, for example: first_file.jpg\thttps://www.google.co.il/images/srpr/logo11w.png ...
0
votes
2answers
15 views

How to download all file with name emp* using curl from a FTP site

How can I get all files downloaded from a FTP site directory with file name like emp*. Please suggest.
0
votes
1answer
25 views

How to automatically save a list of files with different names?

I have a text file of URLs, each in the form of: http://domain.com/a/b/c/d.jpg I want to download all of these, but save each file under the name: c_d.jpg In other words, for each file, I want to ...
0
votes
0answers
17 views

Precompiled version of curlpas for Delphi

I am working on a project written in Delphi XE5 which requires the libCURL library and I have downloaded the curlpas binding for libCURL from http://curlpas.sourceforge.net/curlpas/index.html and have ...
1
vote
1answer
27 views

Upload image to postimage.org using curl

I found a script that can upload image to postimage.org using curl. It was posted not long ago, on 2013-09-06, at http://crunchbang.org/forums/viewtopic.php?id=28867. The simplified script looks like ...
1
vote
1answer
69 views

How to upload file with curl when --data-binary is present in tampered data?

I try to upload files to a popular website, I tampered the http POST requests with Chrome developer tools' "copy as curl" feature. When the upload begins I get this curl command: curl ...
0
votes
0answers
17 views

curl bails on download in cygwin but not os x

I'm trying to download a copy of a postgresql db from Amazon S3 in cygwin. But it yields zero's across the board yielding a useless file. This is my curl command: curl `heroku.bat pgbackups:url` -o ...
0
votes
0answers
16 views

import .cer file into ubuntu for curl

I am trying to use fiddler to act as a ssl proxy for debugging. I am trying to install fiddlers root certificate. I am mainly doing it so I can debug my python program. Using python I get a cert ...
821
votes
6answers
719k views

What is the cURL command-line syntax to do a POST request?

How do I make a POST request with cURL command-line tool?
0
votes
3answers
41 views

Is there a linux filter which converts html to simple and pretty formatted text?

I would like to filter html response coming from cURL output. Which filter should I apply? Viewing html content with Midnight Commander is no problem, it shows them as pretty formatted plain text, so ...
0
votes
0answers
30 views

How can I use Wget / Curl / Plowshare to download from 1fichier.com as a premium member?

How can I download files from 1fichier.com (I am a premium member) with the help of Wget / Curl / Plowshare (Plowdown) or other CLI / command line tool / script?
0
votes
0answers
17 views

Curl over interface for port forwarding

I'm trying to set up OpenVPN and Deluge to seed torrents via the VPN. I am running other services on the server, so I only want the torrent info to go over the VPN. The way I've accomplished this so ...
1
vote
1answer
25 views

downloading multiple files using curl, curl repeats address in download

I am running the command curl -O "http://www.*site*.com/[1-9].png" but the download is failing. - the output is as follows [1/10]: http://www.*site*.com/1http://w --> 1.png % Total % ...
10
votes
8answers
23k views

wget/cURL alternative native to Windows?

Is there a wget or cURL type command line utility native to Windows Vista? How does it work?
0
votes
0answers
31 views

crawling google links produces 400 error

I had a google scraper some time ago that quit working when they made some security changes. I just had a task come up and realized something must of changed a lot. the best I can get with any tool to ...
11
votes
6answers
38k views

CURL to download a directory

I am trying to download a full website directory using CURL. The following command does not work: curl -LO http://example.com/ It returns an error: curl: Remote file name has no length!. But when ...
1
vote
2answers
57 views

file downloaded via firefox and curl have different size

When I download a file from this link by Firefox its size is 74580 B, But when I download it by curl with exactly all of header was sent by Firefox its size is 79891 B (I copied all header from ...
1
vote
0answers
93 views

curl: (7) Failed connect to www.google.com:80;

I have installed Git for Windows and got cURL automatically. C:\>curl --version curl 7.30.0 (i386-pc-win32) libcurl/7.30.0 OpenSSL/0.9.8y zlib/1.2.7 Protocols: dict file ftp ftps gopher http https ...
1
vote
1answer
38 views

What is the curl equivalent to wget -x?

I want to use curl to save multiple files with the same local paths as would be produced by wget -x (ie, cleaned up versions of the full urls). But I can't find the right option in the curl docs. Is ...
1
vote
1answer
53 views

Curl won't work over FTP

I am trying to install Wine on my Macbook (OS X 10.9.3). First I tried using Homebrew which lists a set of dependencies and then goes to fetch the first. ==> Installing dependencies for wine: ...
0
votes
0answers
43 views

What is the curl command line syntax to do a post request in windows

I know this question was answered often, but mine is some more special. I have the following Code: <form action="/test.html" method="post" enctype="multipart/form-data"> <a ...
0
votes
0answers
215 views

libcurl or cURL not working OSX Mavericks

Before I start let me say I have uninstalled, reinstalled, compiled from source, used macports and generally tried for the last 6 hours to get curl working on my Mac OSX Mavericks but I still haven't ...
0
votes
0answers
33 views

Curl to download large CSV

I am using curl through Cygwin on Windows 7 to download content from Apache Solr in CSV format. This is my command which is running in a for loop curl -o ret-key-data-$i.csv $URL As the content is ...
0
votes
1answer
67 views

cURL very long delay before starting download from ftp

I'm trying to write a script to download a file, convert it, then execute a program on the converted file. For some reason curl takes over 1 minute to start the file transfer. Command: curl ...
0
votes
0answers
12 views

Curl works, curlfrpfs doesn't

Following commands work properly: $ curl ftp://user:*****@sma20/ 05-04-14 14:45 872 config.xml 04-11-14 07:26 <DIR> DATA $ curl ...
0
votes
0answers
79 views

Trouble installing Homebrew “curl: (2) Failed initialization”

When I run the command to install homebrew on Mac OSX 10.7, namely ruby -e "$(curl -fsSL https://raw.github.com/Homebrew/homebrew/go/install)", I get curl: (2) Failed initialization. Searching ...
9
votes
2answers
631 views

how to use curl to verify if a site's certificate has been revoked?

To check if the certificate for google.com has been revoked, I tried the following command: curl https://www.google.com --cacert GeoTrust_Global_CA.pem --crlfile gtglobal.pem -v , but I got the ...
1
vote
0answers
21 views

Bug or syntax change on Debian's “curl” 7.36? Mess when trying to save sequential files with brackets/hash

(Perhaps specifically 7.36.0-1, which is shown as the most recent available on my package manager). I think there was such a bug some time ago, but perhaps it was back in curl 7.33, I can't ...
1
vote
2answers
106 views

How to stop shell script if curl failed

I have script that used curl when i pass wrong parameters to script curl failed but script continue executing. I have tried use curl -f/--fail parameter but problem does not solved. What is the best ...
0
votes
0answers
168 views

Why is SSL broken for one domain on one computer?

I've been having a strange issue, where I cannot connect to https://www.humblebundle.com. Plain HTTP works fine, as does https://humblebundle.com. These all redirect to the above address. I haven't ...
0
votes
0answers
40 views

wget sometimes fails, curl succeeds

I am continuously downloading some packets via wget. Once in a while, the wget fails. I have used retries as 2 and timeout as 10 seconds. When the failure occurs, I try the same URL again, but with ...
0
votes
0answers
105 views

curl: (35) error:0200100D:system library:fopen:Permission denied

In continuation with this question... I get curl error as above only as an unprivileged user on my system. However, on searching I found the above link which asks me to check permissions for ...
1
vote
1answer
2k views

When using curl to http post a xml file to a url, how to set the parameter?

I want to use curl to http post a file to a url like: curl -d myfile.xml http://www.example.dom/post/file/here Can I set the parameter I want the file to be posted with? Like if it was a ...
0
votes
0answers
30 views

Gzipped file arrives unzipped

I've recently set up an ArchLinux system at work and added the ArchHaskell repo. This is far from the first time I do this. I have a number of systems where it's worked just fine, but this last time ...
2
votes
0answers
335 views

loop curl could not resolve host

I've had working script, which suddenly doesn't works. It contains something like this: while read url; do curl $url done < links links file: http://duckduckgo.com http://google.com And I ...
1
vote
1answer
86 views

posting data to a web server using curl

I am trying to post data to a web sever using curl -d and curl -X POST. The command is getting succeeded but nothing is there in the file. Tried the following: [root@oooatis santoshi]# curl ...
5
votes
2answers
4k views

POSTing a file's contents with CURL

(The following is backstory, you can jump down to "Question:" if you'd like) There's a webpage for one of my courses that accepts input text (expected to be Python code) and then gives some tokenized ...
1
vote
0answers
30 views

SOAP-request realization in DOS 6.22 16-bit

I have a task to develop some application providing SOAP-requests realization for DOS. I have already developed a similar application under Linux, using C++/STL and curl and openssl libraries. Is ...