curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

learn more… | top users | synonyms

2
votes
0answers
71 views

Posting XML wrapped in SOAP posted using Curl results in invalid XML character was found exceptions

Sending an XML file using curl results in: Invalid XML character (Unicode : 0x<integer>) Attempt to solve the issue According to this SO answer the issue will be solved if the XML version is ...
2
votes
0answers
72 views

Why doesn’t curl install and run on my 64-bit Windows 8 system but the 32-bit version works fine?

I almost gave up installing cURL on my 64-bit Windows 8 system. I tried almost every single .zip, .exe, etc… on this site, but none of them worked. I got this message every single time: The ...
2
votes
0answers
530 views

Mac OS X Yosemite and Client SSL Certificates

Ever since I upgraded from Mavericks to Yosemite, my SSL Client Certificates have stopped working in certain places. They still work in web browsers and in wget, but they have stopped working in curl ...
2
votes
0answers
25 views

How to add a 'greek' character in the path using cURL?

I have a Makefile where one of many tasks is to upload a file using cURL, one of these files, has a greek character in the name and when I try to upload using cURL, I receive this error: curl: (43) A ...
2
votes
0answers
273 views

pipe unlimited curl stdout into chunked files

I've got an HTTP-endpoint that serves an unlimited stream of events. Now I'd like to record that stream using curl, but splitting the recorded files at the same time - preferably based on the line ...
2
votes
0answers
441 views

loop curl could not resolve host

I've had working script, which suddenly doesn't works. It contains something like this: while read url; do curl $url done < links links file: http://duckduckgo.com http://google.com And I ...
2
votes
0answers
161 views

Curl --insecure error in Cygwin (works in Linux)

Curl is returning an error in Cygwin. How do I eliminate this error? curl --insecure -X POST -d '<run><log ...
2
votes
0answers
605 views

Libcurl-devel on Mac OS X

I am trying to build an application that depends on libcurl version 7.21 or newer on Mac OS X 10.5.8. I tried downloading and installing the latest version from libcurl's website, but the application ...
2
votes
0answers
140 views

curl works but ping/urllib2 don't, in a virtual machine

I have a Crunchbang 10 VM running on VirtualBox on a Windows 7 Home host. I have a python script that uses urllib2 that was failing, and discovered that: ordinary browsing and curl work normally on ...
2
votes
0answers
373 views

PHP : curl is and Not working in ubuntu10.04 and Nginx

I am running Nginx server on ubuntu 10.04 I am using the php version 5.3.2 .I installed php5-curl using apt-get install php5-curl. Unfortunately the curl package is not displaying in phpinfo() . ...
2
votes
0answers
3k views

curl http_code of 000

I have a shell script that I use to monitor loading times and response codes on my live server cluster. It runs a total of 250 iterations every 5 minutes, distributed across 10 servers and 6 sites. It ...
2
votes
0answers
690 views

Restore default CA Certificates on Mac OSX 10.7

I've been screwing around with my Mac, trying to install self-signed certificate as trusted for our WAN site (for which we can't justify paying for a real signed certificate) I've broken something ...
1
vote
0answers
23 views

Run bash command from link in browser

Is there a way to run an arbitrary command on OSX by clicking a link in the browser? As you know, there are certain types of hyperlinks that launch certain applications with a specified action, for ...
1
vote
0answers
49 views

FTP: wildcard downloading

I am trying to download a file with name ending with *.csv The problem is complicated by the fact that this *.csv contains in directory of unknown name: eg. Sometimes it would be 2015->Date ...
1
vote
0answers
162 views

I destroyed my Mac's PHP setup: SSL certification fails

Long story short, I deleted the PHP symlink on my Mac, and replaced it with a symlink from XAMPP. Now it seems that there's a problem with my SSL configuration or what seems to me, a lack thereof. ...
1
vote
0answers
13 views

Sporadic loss of access to local server

For some reason, I lose access to a local server called lux-app04 seemingly at random, but only in some applications. As you can see in the image below, Postman (top) can connect to it, but curl ...
1
vote
0answers
30 views

Bug or syntax change on Debian's “curl” 7.36? Mess when trying to save sequential files with brackets/hash

(Perhaps specifically 7.36.0-1, which is shown as the most recent available on my package manager). I think there was such a bug some time ago, but perhaps it was back in curl 7.33, I can't ...
1
vote
0answers
43 views

SOAP-request realization in DOS 6.22 16-bit

I have a task to develop some application providing SOAP-requests realization for DOS. I have already developed a similar application under Linux, using C++/STL and curl and openssl libraries. Is ...
1
vote
0answers
69 views

How do I log in to “The Cloud” wifi hotspots using curl?

In England at least, there's this accursèd thing called 'The Cloud', which increasingly provides all public wifi hotspots. Has anyone already knocked up a curl command/bash script/etc to log in to it ...
1
vote
0answers
183 views

Curl not working on OS X

I recently upgraded XCode and while I'm not sure if that caused the problem, I can't curl out of my computer anymore. This seems to break rvm and homebrew but git still works. I upgraded curl and ...
1
vote
0answers
136 views

Permissions tar extraction to nfs share from a Perl script

As part of an installation procedure of a piece of software, I use: curl -s <url-to-targz> | tar -p -x -z -C / inside a Perl script (I use qx($command) or system($command), either will ...
1
vote
0answers
129 views

No output returned when curl ing any URL in Red Hat 6 but the same url works in lynx browser

I am trying to install some packages in Python using easy install. But i get a 'Download Error' for any package i try to install. So i tried to test if internet is accessible at all from the machine ...
1
vote
0answers
183 views

the right options to traverse/download the pages/directories of a subdomain

Let's suppose exist a site with the following directories (subdomain) index.php |-sub1 |-index.php |-sub1sub1 |-index.php |-other.php |-sub1sub1sub1 |-sub2 |-index.php |- ...
1
vote
0answers
130 views

Download web server structure with empty files

I want to make a mirror of a Web server, but downloading the actual files will take too long. So I thought of having just the directory and file structure, and when I need the actual contents of the ...
1
vote
0answers
597 views

VirtualBox Ubuntu guest on OS X Lion host: Curl won't work

I'm trying to install some gems on an Ubuntu VM on OS X Lion using VirtualBox. I've narrowed my problem down to curl which is not responding at all. It seems to be going through some proxy local host ...
1
vote
0answers
205 views

how to use to proxy in the intranet?

i have an intranet site which is inside only our company and feeds information. i download an weather API from http://www.foreca.com/Philippines/ and hook to my site. the API has a search engine and ...
0
votes
0answers
21 views

curl could not open remote file permission denied using sftp

I'm trying to download a file from a new enduser sftp using existing code that works for other end user sftps, using curl. This is my basic command: curl -o [internalFileLocation] -u [user:pw] ...
0
votes
0answers
42 views

Why do wget and curl fail to download page source?

Via a shell script, I would like to download the source for a web page with air quality data on aqicn.org. Here is the URL for the page with Beijing air quality data: http://aqicn.org/city/beijing/m/ ...
0
votes
0answers
31 views

Pipe remote jpg webcam image to ffmpeg as video

I have a cheap ip webcam. All it provides is a single http url to a static jpg file. Such as http:///image.jpg. Repeatedly requesting the same url will provide subsequent frames from the ip camera. ...
0
votes
0answers
19 views

Return response body with curl always, but if non 2XX, don't exit with 0

How can I have curl print the response body, but if the http status code is not 2XX don't exit with a success 0 status? Using the flag --fail does not work, because it does NOT print the response ...
0
votes
0answers
191 views

How to use .pfx in certificate store in CURL for Windows 7

I want to use cURL to access a remote server, and I need to identify myself using a private key or the remote server gives a 401 "Unauthorized". I'm on Windows 7 (work machine, not my choice) and my ...
0
votes
0answers
13 views

Curl should be quit but it returns ever something

I tried to login to a website using curl in a bash-script. It is possible to login to the site quiently using this: curl -d "username=$username&passwd=$passwd" -c $cookiefile ...
0
votes
0answers
20 views

How to check what kind of files web page consists

Is there a way to check what files web page consists. For example I want to download .txt files from the web page, but I dont want all .txt files, some of them, and before I want to check are there ...
0
votes
0answers
42 views

Need help constructing cURL config file

I have a (rather long) cURL command that I'm currently running as follows: curl.exe -U : --proxy-ntlm --proxy myproxyserver --cookie-jar cookies.txt -H "Accept-Encoding: gzip,deflate,sdch" -H ...
0
votes
0answers
56 views

Downloading file from (your download will start shortly) page

How can i download a file with curl (or any other alternative) that make user wait until download start for example enter link description here i tried curl -O -J -L ...
0
votes
0answers
180 views

Why is cURL slower than wget

Test page: https://www.beobank.be/nl/Home.aspx This is the result using wget (or a real browser): # time wget https://www.beobank.be/nl/Home.aspx -O /dev/null --2015-01-26 12:05:46-- ...
0
votes
0answers
141 views

nginx not serving php files with curl in fedora 21

phpinfo and php with echo are working fine but with curl gives 403 error. error in chrome: http://localhost/send3.php Failed to load resource: the server responded with a status of 403 (Forbidden) ...
0
votes
0answers
33 views

Prevent WAMP from loading external requests

I need to prevent wamp from loading external links in order to have a better performance I'm using PrestaShop and sometimes it looks for updates and currency rates etc which slows down loading the ...
0
votes
0answers
113 views

Cannot curl webserver from outside network

I have a webserver running on one of my home computers. I am able to access it within my network, on another computer, with curl localWebserverIP:8888. However, I am having issues accessing it from ...
0
votes
0answers
30 views

Send and receive file in curl

I have a remote server running and i want to send a text file to that server. I have this script to upload the file: curl -F 'txtfile=@sometxtfile.txt''http://www.example.com/transfers' My ...
0
votes
0answers
87 views

Posting XML through cURL using --data-binary

I have this really typical problem. I have an XML file that I have to post to a server. I was told by the network engineer of that site to use the cURL function. The function that he provided to me ...
0
votes
0answers
140 views

Download file vis cURL, but not with Wget

I have a link I'm trying to download. Before, we could download with either Wget or cURL because the website (which runs under Tomcat) didn't require a user name or password in order to download. ...
0
votes
0answers
20 views

How to Download HTML Pages of a WebSite, Based on a Time Stamp?

I know this might be a repeated question, and I'm sorry for that, but I failed to find any answer for my problem . I Just want to download the Pages html files, without any other contents, and (If ...
0
votes
0answers
32 views

Curl to update dyndns record for *.domain.com

I use curl to update my dns whenever my ip changes and it works as expected. url = domain.com user = username pass = password ext = 123.123.123.123 curl -s --ssl --user "$user:$pass" ...
0
votes
0answers
15 views

upload Multiple xml on https form

I have a annoying problem, I must send daily +-100 xml files over a https,an upload form without a layout and can't see which files are on the server. Synch isnt allowed. I've tried everything, the ...
0
votes
0answers
117 views

How to emulate a cookie-based browser with curl?

The title tells pretty much everything. I need curl to both GET and POST as a web browser while accepting cookies.
0
votes
0answers
160 views

How to set curl -o to any desired location in AppleScript?

I have a basic question about curl -o. I just want to make a short AppleScript. does shell script "curl -f 'http://www.SOMEWEBSIT.COM/ANYIMAGE.jpg' -o ~/Desktop/ANYIMAGE.jpg" tell application ...
0
votes
0answers
80 views

curl to resume dropped file copy

I refer to an older question in the forum: Question asked by Simon Fox My laptop froze up in the middle of a (large) file copy from my desktop (over a simple LAN). The copy operation was about ...
0
votes
0answers
217 views

SSL certificate error attempting to download Homebrew?

I've been trying to download and install Homebrew for my Mac (OS 10.9.4) using the install script on the home page, but the download fails with a SSL certificate error (see log below). I understand ...
0
votes
0answers
45 views

How can I get all urls of pattern x from a paged list of search results?

I'm using Windows 7 SP1, and I'm willing to use powershell or wget or whatever will work. I downloaded powershell today (ps 4) and I've got some scripts working, but I'm having trouble with this one. ...