Questions tagged [curl]
curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).
716
questions
0
votes
0
answers
2k
views
Powershell equivalent to curl --resolve
I need to use powershell to check the https response code of a call where the DNS entry isn't setup or points at an IP that cannot be reached. The command is run on the same server as the IIS hosting ...
- 101
0
votes
2
answers
535
views
windows command line utility to download from both http:// and file:// with progress
is there a windows command line utility that supports downloading from both http:// and file:// with progress?
already tried:
powershell Invoke-WebRequest : not working on windows 7
powershell (New-...
- 131
0
votes
1
answer
2k
views
How to deal with curl error 2 caused by "Failed getting banner"?
I have four Raspberry Pies all running curl 7.64.0. Each Pi uploads a webcam image to the same host every two minutes. That's 30 images per hour for four Pies. This is all done with simple bash shell ...
- 111
1
vote
1
answer
1k
views
Curl fetches Plain Text Shell Script, but Browser Pulls HTML
I was considering installing Deno, and the installation guide instructs to issue this command for Mac/Linux Shell:
curl -fsSL https://deno.land/x/install/install.sh | sh
Being careful not to blindly ...
- 131
5
votes
1
answer
5k
views
Download and extract archive using PowerShell
Using PowerShell 5.1, how can I download a tar.xz archive and extract it without writing it to disk first?
All these attempts:
Invoke-WebRequest https://www.examle.com/archive.tar.xz -...
- 217
6
votes
3
answers
3k
views
How to curl case-insensitive
If I use this link to install docker-compose, I get Not Found error:
[root@hostname ~]# curl -L "https://github.com/docker/compose/releases/download/2.9.0/docker-compose-$(uname -s)-$(uname -m)&...
- 3,244
0
votes
0
answers
74
views
Curl falls back to tlsV1
we have a serious issue with Curl falling back to tlsv1 even though it forced to use v1.3
curl -vvv --tlsv1.3 --tls-max 1.3 --resolve <domain>:443
i tried 6 times to reach the dst and one ...
- 6,295
2
votes
2
answers
16k
views
How to recover from curl: (56) Send failure: Connection was reset?
I am using curl on Windows to download large files. However, the network connection is at times reset, and so I want to restart the download but unsure what parameters I should use.
I have tried
curl....
- 111
4
votes
1
answer
4k
views
How to dowload files with original timestamp?
Many web sites ask us to login before downloading real contents files, and restrict us to download files from it with a cli program such as wget or curl.
So we must download files with a browser, ...
- 481k
0
votes
1
answer
2k
views
-P option on wget does not work on windows 11
If I run:
!wget -P ./arcface_model https://github.com/neuralchen/SimSwap/releases/download/1.0/arcface_checkpoint.tar
from my jupyter notebook on windows11 It does not recognize !wget, even though ...
- 481k
1
vote
1
answer
731
views
Download from a redirect using wget or curl
I want to download something from https://www.articy.com/en/downloads/server/. The link I have to click to download the file is https://www.articy.com/download/articyserver3.
I tried using curl -OJL ...
- 250
2
votes
1
answer
915
views
curl over HTTPS
I've just setup a website/webserver, and just got it verified by ZeroSSL, but when i try and run curl or wget over it, it errors. I could bypass this by running wget --no-check-certificate or curl -k ...
- 454k
-1
votes
1
answer
41
views
How to download part of JavaScript code
I am looking at this website with a public table with some information I am interested in. I can download the info saving the page through Firefox, but it will take too much time to save all tables (I ...
- 20.3k
0
votes
2
answers
242
views
PolarProxy generates a SAN cert generating a curl error
I ran curl 7.58.0 (see version in attached pic) with -v and got a result indicating the CN=example.com in the cert was OK, but that curl couldn’t find a matching subjectAltName. Is there a switch or ...
- 116
1
vote
0
answers
6k
views
"failed to receive handshake, SSL/TLS connection failed" only when trying to access T-Mobile.com
I have 2 phones, 2 tablets, and 2 laptops can log into my account at T-Mobile with no issues.
My main PC, (Alienware R11 running Win11) cannot access my T-Mobile account. It gets an error when trying ...
- 11
3
votes
0
answers
444
views
How to install curl in Ubuntu when apt-get doesn't do it right on Ubuntu 16.04.4 LTS?
My curl on Ubuntu 16.04.4 LTS isn't working (it says there's a certificate problem on any https website, but my OS certificates are fine... I can access the same sites just fine in a browser. Even ...
- 55.6k
1
vote
0
answers
2k
views
curl command fails inside docker containers
I am trying to run curl command to upload a file to destination B inside docker containers but getting the following error message. When I run the same exact command outside the containers on the host ...
- 2,788
0
votes
0
answers
1k
views
curl to get a file with correct name when redirected
Following up on How to wget a file with correct name when redirected?
in which the answer says,
You can achieve the same automated behavior with curl, using,
curl -JLO ...
However, I found it not ...
- 8,681
0
votes
1
answer
1k
views
Anaconda overwrites curl
I have homebrew and tried to do
brew install curl
to update it to the latest version.
However, curl --version was still returning an old version. When I did which curl it returned
/anaconda3/bin/curl ...
- 101
1
vote
1
answer
391
views
What's the curl's unit means when download a file?
When I use curl testing a file download traffic rate:
curl -vo 1 'https://demo.com/apk/202112/008/93cd5df7dbf9385f6a12c720c8c5b360.apk'
I get:
{ [data not shown]
2 1771M 2 50.5M 0 0 ...
- 454k
0
votes
1
answer
1k
views
curl error 77 when non-root user
On RHEL if I run curl as a regular user I get an error:
> curl -Sv https://example.com
* About to connect() to example.com port 443 (#0)
* Trying 93.184.216.34...
* Connected to example.com (93....
- 322
1
vote
1
answer
1k
views
I want to download a 1.2 GB file, but the transfer always fails at 1.08 GB. Is it possible to download the file in two pieces?
I can download 1.08 GB of the file without any difficulty, but the download invariably fails at that point. I am fairly sure this is because nginx writes temp files to disk before sending them to the ...
- 1,977
1
vote
1
answer
4k
views
Failed to run curl 7.83.0 on alpine
I'm trying to install curl in 7.83 on an alpine environment but it fails to run the command and give me the following error
Error relocating /usr/bin/curl: curl_easy_nextheader: symbol not found
Error ...
- 46
0
votes
0
answers
1k
views
how to stream a large directory to a HTTP server via CURL put?
I have a large directory that I want to upload to a remote server using only tar and curl. I don't need any compression as the directory already contains compressed data.
here is the command I am ...
- 101
1
vote
2
answers
6k
views
Can I output `curl` response while also checking for presence of ERROR string?
I have a command I am running with curl. The curl command always resolves successfully even when the server response includes the string ERROR somewhere.
Can I somehow detect this response with some ...
- 74.3k
13
votes
3
answers
29k
views
Site displays with Curl but not within the browser
I've set up a dev-enviroment on Debian 7 and installed the following services:
Apache
Bind9
I have one site that is reachable through "asix.debian.local". I've set up the zone and added NS and A ...
- 211
0
votes
1
answer
114
views
cURL shows information that I don't wanna see
today I was trying to add some wttr.in commands with curl to my powershell terminal profile. But when I just run the "curl wttr.in/Kayseri?format=3" it shows these informations that I don't ...
- 958
1
vote
0
answers
1k
views
Nginx as forward proxy and authentication
I want to set up an environment where I would have a simple implication that will be accessible through a forward proxy using for both the proxy and the app nginx.
Both of my nginx are docker ...
0
votes
2
answers
1k
views
How to conditionally add flags to curl?
I'm trying to conditionally add a header to a curl command.
This is my initial attempt:
# Set Auth Header
if [ $IS_PUBLIC == 0 ]; then
AUTH_HEADER="-H 'authorization: Bearer $TOKEN'"
fi
# ...
- 34.8k
7
votes
2
answers
27k
views
Send TCP packets with Curl
Background :
I want to have computers communicate to each other so I used to use Dropbox for syncing them. I used one program to echo information in a text file, then the other computer would have an ...
- 111
0
votes
0
answers
255
views
Curl and etc. HTTP requests not working when I connected to vpn
Please tell me how to solve next problem: Curl and etc. HTTP requests not working when I connected to vpn. I get a simple error - "could not resolve host". But when i disconnect from vpn ...
- 1
-6
votes
1
answer
202
views
How to: Download Driver
I would like to download this package
3.16 - 5.14 drivers/staging/rtl8188eu/os_dep/usb_intf.c CONFIG_R8188EU CONFIG_STAGING 2357:010c *
From here: https://linux-hardware.org/?id=usb:2357-...
- 3,244
0
votes
0
answers
1k
views
Difference between scp and sftp within curl
I have encountered a serious problem with curl.
I want to copy a file from a raspberry on a remote server working under Windows 10. RSA key is installed on the server, everything is working ...
- 101
3
votes
2
answers
14k
views
What's the exit code for "curl -I" when not HTTP 200?
I want to check what HTTP status code is returned for an HTTP(S) URL. I don't care about content, so I just request head with
curl -I $url
or
curl --head $url
But what's the exit code I should ...
- 105
-1
votes
1
answer
390
views
Run curl with another user in CMD
Here's my question: When i start CMD locally as a current user and run following command:
curl "https://desktop.docker.com/win/main/amd64/Docker%20Desktop%20Installer.exe?utm_source=docker&...
- 359
0
votes
1
answer
1k
views
Can curl decompress a local file it already downloaded?
I tried downloading the source code of a web page using curl. The resulting file appears to contain "random" characters; in fact it is a compressed version of the html code. I know that ...
- 133
6
votes
1
answer
5k
views
cURL example for accessing authenticated Kraken API
I've been trying to implement a client for Kraken private API (https://www.kraken.com/help/api) and because I've been running into some issues with that, I've been trying to access that same API with ...
CommunityBot
- 1
0
votes
0
answers
93
views
Curl Commands parallel on two seperate shells
I am testing the download speed of a website with curl and want to run one with TCP and the other with UDP on two different VM´s. But I want to measure both of them at the same time so that I know how ...
cody
1
vote
1
answer
1k
views
Curl with GSS-API on Alpine Docker
I am trying to get curl installed in a Dockerfile with the GSS-API, SPNEGO, or GSS-Negotiate features installed so I can use the --negotiate flag. How can I configure curl to be installed with that ...
- 21
1
vote
1
answer
5k
views
curl command is unable to upload files with unicode characters
I'm trying to upload a file to a FTP site but it looks like when the file name has unicode characters curl is unable to upload it.
curl -u %username%:%password% -T "LENOVO - São Paulo.txt" ...
- 4,420
1
vote
0
answers
14k
views
Why this error tryng to cURL an API? OpenSSL SSL_connect: Connection reset by peer in connection to
I am going crazy with the following problem. Some times ago I was able to retrieve data from some API using the following cURL command involving the use of an SSL certificate, but now I am obtaining ...
- 7,161
0
votes
1
answer
2k
views
TLS1.2 still used despite forcing use of TLS1.0
I have a customer who is trying to connect to my company's FTP server and we have asked him to force the use of TLS1.0, which he has done through a curl request (curl version : 7.29.0). However, ...
- 9,175
-3
votes
1
answer
4k
views
How to upload every file in directory to server with curl
I have a local folder called dist and I would like to upload the files in that folder to my server - but I don't want to upload the folder - only it's contents
find dist -type f -exec curl -u username@...
- 3,244
2
votes
1
answer
6k
views
How to detect in Bash when Curl fails downloading non-existent file?
I'm using curl to download a zip file. curl is called from a bash script:
curl --user joedoe http://1.2.3.4/files/joedoe.zip -o /tmp/downloaded.zip
I'd like to detect when the target zip file does ...
- 74.3k
0
votes
1
answer
561
views
openssl s_client allows connection while curl does not
grief@rocket:/$ curl https://wrong.host.badssl.com
curl: (60) SSL: no alternative certificate subject name matches target host name 'wrong.host.badssl.com'
More details here: https://curl.se/docs/...
- 186
0
votes
1
answer
3k
views
Download blocked in Firefox, Chrome and Edge. "Couldn't download - network issue"
I'm running into a problem on Windows 10 where URLs of a certain type can't be downloaded in Firefox, Chrome or Edge. The URLs look like "http://localhost:8080/6/58/37.pbf".
Using Curl (on ...
- 18.7k
0
votes
1
answer
738
views
Bash script using Curl to output http status code fails with "could not resolve host"
I'm new to bash scripting and I keep getting "could not resolve host" when running the following script. I know it must be a slash or comma, but I have tried everything and can't figure it ...
- 352
1
vote
0
answers
573
views
Is it possible to download an MKV file starting from half-way over HTTP?
I have an MKV video file that I need to download starting form half-way through. The video encoded as h264, the audio is encoded as AAC.
Normally HTTP downloads sequentially so if your download speed ...
- 431
0
votes
1
answer
198
views
Break curl range download on fail (empty file downloaded)
I found today I can download multiple files in a range using curl and this is great.
$ curl -O "http://example.com/[001-100].png" (https://everything.curl.dev/cmdline/globbing)
Also I found ...
- 101
7
votes
2
answers
772
views
Firebug and cURL
I have been using Firebug and cURL for quite a while.
Firebug is amazing to capture HTTPS POST request as opposed to a network analyser as it is aware of SSL/TLS negotiation. And cURL is amazing to ...
- 643