Questions tagged [curl]
curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).
716
questions
0
votes
1
answer
182
views
Why is mutual auth working on openssl 1.1.0g but not openssl 1.1.1?
I'm making a HTTPS request using mutual authentication. Testing it with curl 7.58.0 using openssl 1.1.0g, it works fine. Upon upgrading to openssl 1.1.1 with the same curl version, the call stops ...
1
vote
1
answer
692
views
Different curl errors happen occasionally
I have a webserver running Centos7 which makes curl requests to other resources. With the rate 5-10 requests per second, everything works fine except I get different curl errors every 2-10 minutes. I ...
9
votes
2
answers
20k
views
cURL: multiple POST requests while reusing the TCP connection
If multiple URLs are passed to cURL, it reuses the TCP connection when possible.
For example:
curl -o 1.jpg http://example.com/1.jpg -o 2.jpg http://example.com/2.jpg
I need to do the same, but ...
0
votes
0
answers
252
views
CA signed certificate failed to verify
I have a signed CA certificate which I installed on my Apache webserver. The certificate is valid and is signed by internal CA.
I spun another Linux instance and tried curling the address but I am ...
0
votes
0
answers
870
views
I am using curl-logger with RestAssured and Java.I want to log curl requests to either text file or log file
I am getting this issue while generating curl commands on windows:
--user "ashish:a26B)n^A?"%"6Wf!AsJw,
!AsJw is creating problem. I'm adding the full request below:
curl "https://api2-preprod....
1
vote
1
answer
2k
views
Why can't cURL and wget connect to footpatrol.com
Every time I try to use either wget or cURL to connect it keeps on saying failed: Resource temporarily unavailable. for wget and curl: (7) Failed to connect to footpatrol.com port 443: Timed out for ...
0
votes
1
answer
188
views
how i can manually login to HG router using curl?
the problem that i tried the curl command from chrome network tab and it didn't work ! so i looked in the page html and found that it does this
1- Encrypt the password to sha256
2- then base64 ...
2
votes
1
answer
7k
views
How to curl a URL with space in Windows?
I’m using Windows 10 and curl 7.55.1 (Windows) libcurl/7.55.1 WinSSL.
I’m trying to download files from the ESA API using this curl command:
curl --ssl-no-revoke -u eduardojsilvajr \
https://...
15
votes
5
answers
131k
views
How to make a Curl POST call in Windows?
I am trying to issue the following command under Windows 10:
D:\>curl -i -X POST -H "Content-Type:application/json" -d '{ "firstName" : "Frodo", "lastName" : "Baggins" }' http://localhost:8080/...
0
votes
0
answers
5k
views
Intermittent SEC_E_INVALID_TOKEN (0x80090308) when performing SSH requests
I'm currently working with a client (a government institution) to automate some data gathering, and I've written some python scripts to gather data from a REST API. The client is behind a corporate ...
1
vote
0
answers
143
views
Calling webservices using Powershell
I am using the following code to perform a function using web services from a running application. I am using a Linux client. Below is a part of the script that I need to convert to a Powershell ...
0
votes
1
answer
545
views
Prevent curl from removing "../" from queried URL?
Prevent wget or curl from removing "../" from queried URL?
The following wget query using ../ to directory traverse:
wget http://192.168.0.24:7002/../../../../../mydir/myfile.txt
results in the ...
3
votes
1
answer
2k
views
Bulk SFTP download of files specified by URL preserving directories
I have a list of several hundred files I need to pull via SFTP. They are located in various directories and I need them to be in the same directory setup on my local machine. It is important the files ...
0
votes
1
answer
596
views
php-apache curl returns (7) Failed to connect to 10.96.128.220 port 80: No route to host
I have 3 kube services (PHP-apache) that I am trying to curl but it always returns the same error:
curl: (7) Failed to connect to 10.96.128.220 port 80: No route to host
Does anyone have any idea of ...
7
votes
1
answer
6k
views
Apache proxy throws error connecting to a third party
Connection to a certain thirdparty service via PHP Curl throws this error:
CURL error: Received HTTP code 403 from proxy after CONNECT
The Apache error log on the proxy throws this:
Connect to ...
0
votes
0
answers
792
views
Download file using wget from particular address
I want to download this file from "http://dl.ariamovie.host/dl5/user2/amir3/Serial/iZombie/S01/480p/iZombie%20S01%20E01.480p.AriaMovie.mkv" using wget or curl.
I tried using:
wget -c "http://dl....
0
votes
2
answers
3k
views
How to login to website and auto-refresh page every X seconds from terminal?
I am trying to login to a particular website, then proceed to a particular page on that website and auto-refresh every X seconds.
Here's what I have so I can login:
curl --data "Username=xx&...
0
votes
1
answer
193
views
Bash Command to Download Specific Line ONLY of Github Script
Searching for this answer has failed me, perhaps because I'm not asking for it in the right way.
I'm basically looking to use something (wget or curl for example) to retrieve the 2nd line of a text ...
3
votes
0
answers
2k
views
how do I install curl from source, including updating the libcurl version?
I am working on a distro of linux that doesn't have the version of curl I need supported via apt-get. The latest I can get through apt-get is 7.52.1 and I want the latest (7.65.1). So, I've followed ...
0
votes
1
answer
2k
views
how can i use curl to login into non digest login sites?
the router login page
i have tried
curl http://admin:admin@...*/
but it doesn't work
0
votes
1
answer
819
views
why i can't login to my router using curl -d option?
the curl command that is used to login
curl "http://192.168.1.1/" -H "Connection: keep-alive" -H "Cache-Control: max-age=0" -H "Origin: http://192.168.1.1" -H "Upgrade-Insecure-Requests: 1" -H "DNT: ...
0
votes
1
answer
851
views
piping curl to tar crashes, while wget to tar is ok
When I pipe curl to tar for large files I occasionally encounter errors:
jeremyr@w6:~/pelias_metal/whosonfirst$ curl -s https://dist.whosonfirst.org/bundles/whosonfirst-data-postalcode-jp-latest.tar....
1
vote
4
answers
37k
views
Upload folder with cURL and FTP using Batch file on Windows?
I am trying to upload a whole folder, including it's sub-folders and files to a folder on my server from a Windows batch (.bat) file.
Below is the command I have for the Upload part...
curl -T E:\...
0
votes
0
answers
703
views
How to enable my upload form and php file for my apache server?
Im trying to upload files to my apache server over http with curl.
I have a simple upload.php file in the root directory of my server and also a "submit" page on my server that is just a simple ...
7
votes
1
answer
2k
views
pipe unlimited curl stdout into chunked files
I've got an HTTP-endpoint that serves an unlimited stream of events.
Now I'd like to record that stream using curl, but splitting the recorded files at the same time - preferably based on the line ...
3
votes
3
answers
1k
views
Use of curl command via HTTP
Using curl command, how to transfer a file from one location to other via HTTP request?
1
vote
1
answer
266
views
How do I use a hexadecimal range when downloading multiple files in Curl?
I know that I can download a sequence of files using decimal numbers in curl:
curl site.com/file[000-100].jpg -o "file#.jpg"
But I need to download a hexadecimal series of files named file0x000 to ...
5
votes
4
answers
7k
views
Is there a linux filter which converts html to simple and pretty formatted text?
I would like to filter html response coming from cURL output. Which filter should I apply?
Viewing html content with Midnight Commander is no problem, it shows them as pretty formatted plain text, so ...
1
vote
2
answers
3k
views
downloading multiple files using curl, curl repeats address in download
I am running the command
curl -O "http://www.*site*.com/[1-9].png"
but the download is failing.
- the output is as follows
[1/10]: http://www.*site*.com/1http://w --> 1.png
% Total % ...
16
votes
2
answers
98k
views
How to get and use certificates with curl
Entering the following command
curl -k [email protected]:password https://www.example.com
Returns the following error
<HTML><HEAD><meta http-equiv="content-type" content="text/html;...
0
votes
0
answers
330
views
Pipe netcat response to php post form
I'm trying to get a one-line command that pipes all messages on a port to a php script. I can't use a netcat proxy, as the receiving end is webserver-only.
Basically, I have the idea of doing ...
1
vote
1
answer
2k
views
Invoking wget from java (runtime.exec) hangs and limits the download to a specific file size (while same with curl does not)
Issue details
I am trying to invoke wget from java to download a file but I keep hitting a weird issue where the file size will be capped.
For example, when issuing "wget https://speed.hetzner.de/...
1
vote
0
answers
29
views
I want to push either a TSV file or JSON up to a Google Sheet
I have several large files of key/value pairs delimited by an equal sign ("="). One file is the master file. For each file, I want to populate columns A, B, and C as follows:
A: The unique key for ...
0
votes
1
answer
16k
views
Sending HTTP request via command line and curl
I am running a cloud server on a raspberry pi (raspian) and like to tell my host the ip adress. To this end, the provider of my URL provides an API which works by sending:
https://<provider_url>...
-1
votes
2
answers
5k
views
How to use,run cURL tool with Android Studio on windows environment? [duplicate]
What is better way to use cURL tool with Android Studio 1.1.x on Windows? because there is no proper information in official site for client tools on windows environment.
I tried to download from ...
1
vote
1
answer
3k
views
How can I sort this JSON data?
How can I sort this JSON data?
Hello,
I am curling a web service and I get this output as JSON using curl and jq. How can I sort the list by percentage, ascending or descending?
{
"result": {
"...
0
votes
3
answers
3k
views
I've downloaded file through curl in mac OS but now i can't locate its location in my system
command i've used ->
curl link... | bash
I've downloaded file from GitHub through curl in macOS but now I can't locate its location in my system though I can access it.
I don't want it in my ...
5
votes
0
answers
3k
views
Why dosen't curl seem to work behind a proxy?
When using curl behind a proxy,
curl -O -fsSL https://storage.googleapis.com/tensorflow-serving-apt/tensorflow-serving.release.pub.gpg -v -k -x http://xxx.xxx.xxx.xxx:8080
I've got an error as ...
3
votes
0
answers
6k
views
How to use .pfx in certificate store in CURL for Windows 7
I want to use cURL to access a remote server, and I need to identify myself using a private key or the remote server gives a 401 "Unauthorized".
I'm on Windows 7 (work machine, not my choice) and my ...
0
votes
0
answers
2k
views
Different response between curl and openssl s_client
I'm having a headache with some results.
Running the following command results in an HTTP 200 response:
$ curl -v -L www.example.com >/dev/null
while running this, and using the exact headers ...
0
votes
1
answer
684
views
How to integrate cURL on my public_html?
I do have this folder structure for my website:
\index.html
\php\some-php-files.php
\js\some-js-files.js
What I want to do is, I want to use a cURL command, which I usually use it on the terminal/...
7
votes
2
answers
10k
views
curlftpfs doesn't work for a username with a "@"
My hosting company makes all my usernames with a "@" in them.
curlftpfs user="[email protected]:pass" ftp://ftp.domain.com/ ~/domain/
For some reason I get in response
Error connecting to ftp: ...
0
votes
0
answers
799
views
wget/curl do not write to file until download is completed
I am trying to run wget/curl every few seconds to cache a HTTP file that is constantly changing (dynamically generated file, different on each HTTP request).
origin fetch is a bit slow (~10s) and ...
1
vote
1
answer
4k
views
How to recursively upload a directory which has directories and files to a server through HTTPS using curl command?
This is the command I am using:
curl --insecure -i https://XX.XXX.XXX.XX/project/conatinername/foldertobeuploaded/${file}.html -X PUT -H "Content-Type: text/html charset=UTF-8; -H "Content-Length:0" -...
0
votes
0
answers
133
views
How to find bottleneck for parallel curl command?
I got curl runing like this:
parallel -j0 curl -x 10.9.8.4:8080 --retry 1 --connect-timeout 3 -I https://{} --output {}
which results in 1000 parallel jobs. I've already incereased ulimit -n to 4096 ...
0
votes
1
answer
114
views
Different download tools result in different MP3 checksums [closed]
I wrote some code for downloading podcasts and noticed that the checksums of files I downloaded with it didn't match those of files downloaded using other methods.
Initially I thought there was a bug ...
1
vote
1
answer
10k
views
curl to download file located at github
I would like to donwload openjdk11 using cURL from github but the download stops just after few seconds, this is what I tried:
curl -o openjdk11.tar.gz https://github.com/AdoptOpenJDK/openjdk11-...
0
votes
1
answer
115
views
Windows 10: associate a command to "all" files
In windows machines, I need add a "right mouse" option to "all" data files (in concrete, all image formats and text files with extension .txt or .html, but add it to all files is also acceptable ).
...
-1
votes
2
answers
2k
views
Curl command what do I make wrong? [closed]
I get:
root@dm820:~# ExecStart=/usr/bin/curl'https://dynupdate.no-ip.com/nic/update' --header "Authorization: Basic <$xxxx:$xxx>" -d 'hostname=<hostname>.xxxx.ddns.net'
-sh: --header: ...
0
votes
1
answer
1k
views
Create a crontab script with curl
Trying to set a cronjob to use with curl.
Want to update IP on noip.com.
The command below gets the IP from noip.com but does not update it with my servers ip.
I mean: when the IP is not updated then ...