curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).
0
votes
1answer
22 views
Can't copy website with curl
I want to get all the images from a website behind our company firewall, similar to what was asked here. I can access the site from Firefox on OS-X, but when I try to use curl I get:
You ...
1
vote
1answer
18 views
Do curl and wget open gzipped files automatically?
I made two http calls to the same gzipped resource from two different machines - RHEL and OSX.
curl http://example.com/file.gz
The first call returned an expected binary output:
/�IQ���}
The ...
0
votes
0answers
10 views
Curl ignores the -r switch when -C is present
I wanted to download a part of a file. (Let's say http://mysite.com/myfile.zip)
So I used this command:
curl -r 200000-400000 -O http://mysite.com/myfile.zip
Unfortunately my Internet ...
0
votes
0answers
16 views
Specifying minor TLS version when using curl
Is there a way to specify curl to use a specific TLS version? Like 1.1 or 1.2? I can see only sslv3 and tlsv1 options in command help. I took latest src and compiled it with openssl 1.0.1e. Still dont ...
1
vote
0answers
25 views
Permissions tar extraction to nfs share from a Perl script
As part of an installation procedure of a piece of software, I use:
curl -s <url-to-targz> | tar -p -x -z -C /
inside a Perl script (I use qx($command) or system($command), either will ...
0
votes
1answer
46 views
Curl Returns “Connection Refused” when trying to access localhost
I am running Xampp (Apache, Mysql and PHP) on my Windows Vista computer. I have curl installed on my machine. When I try to curl my localhost in the command prompt, I get the following:
curl -v -i ...
0
votes
1answer
30 views
Login webpage using wget
I have problems with logging in to this webpage using wget:
http://dealers.volare-kinderfietsen.nl/index.php?dispatch=auth.login_form
Normally this is no problem for me. I just want to store the ...
0
votes
0answers
23 views
curl_easy_perform API does not return
I use simplessl.c to check 2-way SSL with self signed certs. I passed all the certs paths like CA,client. When I ran the application on linux x86 it worked well.But when i ran it on ARM board,the ...
1
vote
1answer
60 views
cURL SFTP upload speed only 50% compared to command line SFTP
I need to use cURL to upload some files to an SFTP server, it has to be using cURL because I'll be later using cURL_multi etc to transfer files simultaneously (unless anyone knows a command line ...
1
vote
2answers
51 views
I am not able access certain website [closed]
I am trying to access www.psychologytoday.com and it fails every time. I tried proxysites and still but every time connection got refused. I've checked Google cached page of the same. Only a few ...
2
votes
0answers
38 views
Curl --insecure error in Cygwin (works in Linux)
curl is returning an error in cygwin. how do i eliminate this error?
curl --insecure -X POST -d '<run><log ...
-1
votes
1answer
63 views
How to add self signed certificate to certificate bundle?
How to add self signed certificate to certificate bundle so that the Curl http client can verify the self signed certificate as valid one?
0
votes
0answers
18 views
How can i automate attaching log files in SBM serena business manager SCR tickets
I have to automate the following task.
Using a script, I want to automatically attach a file to SBM Serena Business Manager's SCR ticket's ATTACHMENT section --or update other infomation in SCR like ...
0
votes
1answer
131 views
Upload folder with cURL and FTP using Batch file on Windows?
I am trying to upload a whole folder, including it's sub-folders and files to a folder on my server from a Windows batch (.bat) file.
Below is the command I have for the Upload part...
curl -T ...
0
votes
1answer
32 views
Upload a file with a comma in its name with curl
How can I upload a file named yes, this filename has a comma.txt with the cli curl?
You would normally do this to upload a file with curl:
curl --progress-bar -F "fileUpload=@filename.txt"
However ...
0
votes
1answer
49 views
Can I make cURL fail with an exitCode different than 0 if the HTTP status code is not 200?
I was always assuming that when curl got an HTTP 500 response it was returning an exit code that meant failure (!= 0), but that seems to be not the case.
Is there a way I can I make cURL fail with an ...
-1
votes
1answer
51 views
cURL for Mac OS X Lion
I am looking for cURL for Mac OS X 10. I have found versions that go up to OS X 8 (Link), but no later. Is there a version for OS X 10 (Mac OS X Lion 10.7.5 (11G63)) or another tool?
0
votes
3answers
88 views
Batch - Get the url of to a file from html document
I want to use curl to download the latest version of this file. The site has a robots.txt, however, which is what I think is stopping me from just using curl -L -z WorldGuard.zip ...
0
votes
1answer
69 views
Why doesn't my script work?
The script I am using is
FOR /F "tokens=91 delims=<>" %%v IN ('curl http://ci.onarandombox.com/job/Multiverse-Core/lastStableBuild/api/xml') DO ECHO %%v
What I want it to do is search the output ...
0
votes
0answers
41 views
cURL wont download for me?
OS X 10.8.3, from a terminal I am executing:
$ curl -OCv http://<URL>/<file>.dmg
I get (for 2 seconds)
% Total % Received % Xferd Average Speed Time Time Time Current
...
0
votes
1answer
89 views
Download a file from the latest stable Jenkins build
Using a batch file and wget/curl, how can I download the Multiverse-Core-.jar from here? http://ci.onarandombox.com/job/Multiverse-Core/lastStableBuild/artifact/target/
I want to use the timestamping ...
1
vote
1answer
64 views
curl ifconfig.me and ifconfig showing different results
If I run curl ifconfig.me I get one IP, and if I run ifconfig, I get other IP's. Why is it so ?
0
votes
1answer
102 views
curl (48) An unknown option was passed in to libcurl, cannot install composer
I'm trying to install composer via cURL but I cannot find how to download the phar archive.
I've installed cURL from source activating in it's build ssl and ssh compatibility; I need composer to have ...
0
votes
1answer
22 views
cURL unable to interpret hostnames, proxy issue?
When using cURL from my ubuntu machine to merely GET from a remote machine, I seem unable to resolve the hostname and just get a Proxy Issue - The proxy has encountered an error (Error 21: Server ...
0
votes
0answers
24 views
Liveheader/Curl script for reconnecting Netgear WNR2000V1 router
I need a Liveheader/Curl script for reconnecting my Netgear WNR2000V1 router for a program called jDownloader. I've tried asking on the official forums, but I haven't gotten a useful reply. Can anyone ...
1
vote
2answers
68 views
How to stop cURL from writing over downloaded files
I'm using
$ xargs -n 1 curl -O < gwurls.txt
to grab a long list of files. Unfortunately, the site I'm grabbing from relies on the path to provide uniqueness, so -O doesn't know the difference ...
1
vote
1answer
161 views
How to split the HTTP error code from the contents in cURL?
Yes, this is related to Getting curl to output HTTP status code? but unfortunately not the same.
In a script I would like to run:
curl -qSfsw %{http_code} URL
where the -f option ensures that the ...
1
vote
0answers
209 views
Libcurl-devel on Mac OS X
I am trying to build an application that depends on libcurl version 7.21 or newer on Mac OS X 10.5.8. I tried downloading and installing the latest version from libcurl's website, but the application ...
2
votes
0answers
38 views
curl works but ping/urllib2 don't, in a virtual machine
I have a Crunchbang 10 VM running on VirtualBox on a Windows 7 Home host. I have a python script that uses urllib2 that was failing, and discovered that: ordinary browsing and curl work normally on ...
1
vote
1answer
62 views
Is it possible to send the output of -w and -o Curl streams to different files? How?
I'd like to run a curl command,
grep the output (response payload) for some keywords,
then also print some metrics via the -w option.
I think this would be easy to do if I could direct the -o ...
2
votes
0answers
72 views
PHP : curl is and Not working in ubuntu10.04 and Nginx
I am running Nginx server on ubuntu 10.04
I am using the php version 5.3.2 .I installed php5-curl using apt-get install php5-curl.
Unfortunately the curl package is not displaying in phpinfo() .
...
0
votes
1answer
42 views
Get Directory/file structure without payload
I need to recursively retreive the file/directory structure of an FTP server, getting only file names (without payload).
Can you help me how to do this (curl, wget, ...)?
The result should be the ...
0
votes
2answers
282 views
CURL Error version OPENSSL_1.0.1 'not found …'
I have the last few days, a concern with CURL. I get this error:
curl: / lib/i386-linux-gnu/libssl.so.1.0.0: version `OPENSSL_1.0.1 'not found (required by / usr/lib/i386-linux-gnu / libcurl.so.4)
...
0
votes
0answers
84 views
Why can't I proxy SSL connections in Charles under Linux (ubuntu)?
I want to proxy some API requests over SSL from a PHP application using Charles Proxy which should allow me to view unencrytped requests. I've done this on Windows before but on Linux, I'm seeing the ...
4
votes
1answer
111 views
Why does sudo not work with curl?
I ran a command to download something with curl and it threw a permission denied error. So I did sudo curl and I got the same error... Why is that?
I was able to run the install command without ...
0
votes
1answer
84 views
How to check for a value after curl or wget?
I need to curl/wget a page and make sure it returned a particular value (else return 1), something like this:
curl http://example.com/something/run | grep -e '^success!$' || return 1
Which flags ...
1
vote
1answer
319 views
POSTing a file's contents with CURL
(The following is backstory, you can jump down to "Question:" if you'd like)
There's a webpage for one of my courses that accepts input text (expected to be Python code) and then gives some tokenized ...
0
votes
0answers
24 views
Linux curl SHA 256
My openssl digest shows -sha256, but how can I tell curl to use it?
certs="--cacert Cert.pem"
options=" --? --remote-time --silent --show-error"
Help please?
2
votes
2answers
45 views
Use of curl command via HTTP
Using curl command, how to transfer a file from one location to other via HTTP request?
0
votes
1answer
101 views
piping output from curl to rpm2cpio
I download alot of srpms to rummage through, I used to go through a long winded approach,
root@server$ curl rpm -o file.rpm
root@server$ rpm2cpio file.rpm | cpio -id
but that leaves behind an ugly ...
0
votes
1answer
127 views
Downloading and extracting a .tar to a specific directory
I want to download a tar of a git repo and extract its contents to another folder.
The following line (broken up for clarity) works:
curl -L -0 nt-dotfiles.tar.gz ...
0
votes
4answers
92 views
Simple script parsing text, what is wrong here?
I'm a big user of https://www.grc.com/passwords.htm to get strong passwords. However, having to go to the site and manually copy the password every time gets old fast, so I decided to do a little ...
0
votes
0answers
267 views
Can anybody show me how to call from command line curl `POST` request with array for parameter? [closed]
Can anybody show me how to call from command line curl POST request with array for parameter ?
I am developing server app with Tornado/Python and need to get parameter like [value_1,value_2...]
0
votes
1answer
60 views
1
vote
0answers
56 views
No output returned when curl ing any URL in Red Hat 6 but the same url works in lynx browser
I am trying to install some packages in Python using easy install. But i get a 'Download Error' for any package i try to install. So i tried to test if internet is accessible at all from the machine ...
0
votes
2answers
196 views
cURL or xargs: show progress
I am using cURL to download many files and concatenate them to STDOUT. About 100,000 small files. I would like to see progress against the 100,000. Is this possible with curl or by using curl into ...
2
votes
1answer
126 views
Unable to resolve host using curl/wget while page loads in browser
The problem I am facing is that while I open a link in my browser it loads quickly but whenever I try using the link in terminal with
for e.g. curl -0 www.google.com or
wget ...
1
vote
0answers
52 views
the right options to traverse/download the pages/directories of a subdomain
Let's suppose exist a site with the following directories (subdomain)
index.php
|-sub1
|-index.php
|-sub1sub1
|-index.php
|-other.php
|-sub1sub1sub1
|-sub2
|-index.php
|- ...
0
votes
0answers
518 views
curl http_code of 000
I have a shell script that I use to monitor loading times and response codes on my live server cluster. It runs a total of 250 iterations every 5 minutes, distributed across 10 servers and 6 sites. It ...
1
vote
2answers
85 views
Curl Compressed Command not Recognized in Windows
I saw this post and successfully added curl to my Windows command prompt as instructed.
However, when I attempted to run curl --compressed, it says:
"the installed libcurl version doesn't ...
