Questions tagged [curl]

curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

Filter by
Sorted by
Tagged with
0 votes
0 answers
181 views

HTTP requests from Linux server CLI to a website with dynamic content that requires Webdriver (JS emulation)?

Are there any simple solutions to making GET or POST requests from a CLI on a linux server to dynamically generated websites that require JavaScript to run in order to return HTML? I know that ...
miran80's user avatar
  • 237
0 votes
0 answers
132 views

Automatic captive portal detection is problematic because some networks redirect outbound traffic and others block DNS requests entirely

I am trying to automate captive portal detection on an IoT device. My basic understanding of a typical captive portal is that it checks a device's MAC address on connection, and if the device's user ...
Eamon Donovan's user avatar
0 votes
1 answer
971 views

curl command showing connection timed out but the url is accessible in browser

I am executing curl command curl --output --url https://100.64.0.6 but the result shows that there is no transfer of data curl --url https://100.64.0.6 shows Connection timed out but the url is ...
Sailee Das's user avatar
0 votes
1 answer
110 views

From a webapp I can't connect to my own url

I have what looks like a network issue. Indeed, when I go on my webapp and I try to do the following curl command here's the answer to it: Whereas if I do the same command from somewhere else, I don'...
Thomabig's user avatar
2 votes
0 answers
811 views

curl with ssh -R proxy

I'm on Windows A and I have a Linux server B. I have a proxy (Clash) on A, curl -x localhost:7890 www.google.com works well. I want to let B curl www.google.com through the proxy on A. Here is my ...
Hesc's user avatar
  • 21
0 votes
0 answers
600 views

FTP upload begins and then drops abruptly

I am running the following curl command to upload files using git-bash from two Windows 10 machines (Client A and Client B) to a Windows Server (Server X). curl --continue-at - \ -T /path/to/...
Sanjid's user avatar
  • 1
1 vote
1 answer
1k views

Curl with GSS-API on Alpine Docker

I am trying to get curl installed in a Dockerfile with the GSS-API, SPNEGO, or GSS-Negotiate features installed so I can use the --negotiate flag. How can I configure curl to be installed with that ...
Alex W's user avatar
  • 1,976
0 votes
0 answers
210 views

Determine what is causing suspicious request by curl.exe to a remote ip address

I am using windows firewall control (Binisoft/malwarebytes). The profile is set to block all network requests unless explicitly allowed. In the firewall connections log I recently noticed the curl.exe ...
nooberson's user avatar
0 votes
1 answer
1k views

how to get value after colon with sed

I have these: variable="call_type: I alert_id: 2334 server: serverA run_as: sub_ap: FRUIT...." I need only one command to get value of the variables. I try with these: callType=$(echo $...
user650034's user avatar
1 vote
0 answers
174 views

SSL_ERROR_SYSCALL on one particular wifi on windows

When I try to connect my windows 10 pc to my wifi and make a curl request I get the following error - curl -iv 'https://www.google.com/' \ * Trying 142.250.182.196:443...="99", "...
tusharmath's user avatar
1 vote
2 answers
6k views

How to download a single file from local BitBucket server using cURL or wget, not cloning the repo

I am trying to download a single file from BitBucket on the linux server. I do have access to the repositories when I try to access it from the web, so it is not permissions issue I used to be able ...
adbdkb's user avatar
  • 131
1 vote
1 answer
6k views

Setting variable inside curl JSON request with single quotes in bash

I have the following simple function, script and I would like to set variable $1 or anyother one inside the following: curl --request POST \ --url 'https://api.securitytrails.com/v1/domains/list?...
Osama Hamad's user avatar
0 votes
1 answer
322 views

no outside internet access from machine

Running multiple ubuntu machines. everytime I curl something I get a curl(6) could not resolve host: www.google.com nslookup gives me a time out apt-get update fails with error: Temporary failure ...
Cliff Ribeiro's user avatar
3 votes
2 answers
11k views

request mysql with curl

I have a mysql running. I can access it with mysql -h 127.0.0.1 -u root -P 8009 -p (password requested) Now I want to make requests with curl : curl 127.0.0.1:8009 ???? I need to pass the password ...
Laurent Claessens's user avatar
2 votes
2 answers
16k views

How to recover from curl: (56) Send failure: Connection was reset?

I am using curl on Windows to download large files. However, the network connection is at times reset, and so I want to restart the download but unsure what parameters I should use. I have tried curl....
Sha's user avatar
  • 311
0 votes
1 answer
115 views

cURL error 60 in Symfonycasts tutorial

In Symfonycasts "API Platform: Serious RESTful APIs" Chapter 6 there is the cURL command curl -X GET "https://localhost:8000/api" -H "accept: application/ld+json". ...
geoB's user avatar
  • 166
0 votes
1 answer
11k views

error in zsh with curl?

I want to run a curl command in zsh. curl -X GET "https://api.cloudflare.com/client/v4/zones/<ZONE>" \ -H "Content-Type:application/json" \ -H "Authorization: Bearer &...
A.Dumas's user avatar
  • 263
1 vote
1 answer
1k views

cURL - use specific response header as part of the filename

I am using this bash command to write the json http response body into a file: curl -s "http://some.domain.com/getSomeJson" | jq . | tee someJson.json; But what I really want is something ...
kiltek's user avatar
  • 141
8 votes
2 answers
4k views

git on Debian 10 backports throws fatal: unable to access 'https://github.com/user/repo.git': Failed sending HTTP2 data

As of yesterday, after updating my Debian 10+bpo system, whenever I try git clone, git fetch, or any other git operation that relies on network, I get fatal: unable to access 'https://domain.example/...
programagor's user avatar
1 vote
1 answer
3k views

Homebrew cannot download from homebrew.bintray.com, gives a curl error: "no alternative certificate subject name matches target host name"

When I try to install or upgrade any package hosted on homebrew.bintray.com, I get the following error: curl: (60) SSL: no alternative certificate subject name matches target host name 'homebrew....
PlatyPrograms's user avatar
0 votes
1 answer
253 views

How to point R to the correct version of curl when upgrading nfrom R 3.6 to R 4.0?

Full disclosure, I have already posted this same question on SO, but on advice am trying this forum instead! I originally posted this issue several months ago in RStudio Community which helped narrow ...
rachelette's user avatar
1 vote
2 answers
5k views

Unable to curl anything on my Mac curl: (7) Couldn't connect to server

All of the sudden I can't curl or run brew at all. I don't have any proxies enabled and I'm just running my personal mac on my home network. How can I debug/fix this issue? scutil -r google.com ...
Ryan's user avatar
  • 111
3 votes
1 answer
1k views

curl: continue and remote-header-name cannot be used together?

I am using curl with both -C - and --remote-name --remote-header-name. If the file exists, I get an error that the existing file cannot be overwritten. Is there a way to work around this? I think this ...
Benjamin Marwell's user avatar
0 votes
1 answer
568 views

Find availible API endpoints, given root access to webserver

I have root access to a web/application server, which is located on my local LAN. I can see some API endpoints via logging on the server and hit them via curl. I would like to know all available ...
Your_Structures_Fine's user avatar
0 votes
2 answers
1k views

Download multiple pdf files by using cmd (Windows Command Prompt)

I'm looking for a way to download multiple pdf by using a "single" command in cmd (e.g. from here). So far I learned how to download a single file by using: curl URL -o name.pdf EDIT: I'd ...
Gennaro Arguzzi's user avatar
2 votes
1 answer
2k views

Using CURL to send multipart/alternative email WITH encoder=quoted-printable. How?

Below is an example of how I currently send a multipart/alternative with CURL. I write this email in a text editor, save it to a file and use CURL to send the whole thing. To: "John Connor" &...
suchislife's user avatar
1 vote
0 answers
222 views

Chrome cant find domain, curl can find domain

I am trying to make a request to a server in chrome. I keep getting a 404 error whenever I attempt to connect. When I use curl (which on Windows is an alias for Invoke-WebRequest) I correctly get a ...
Austin's user avatar
  • 111
0 votes
1 answer
1k views

Curl - Couldn't resolve host on Ubuntu for Windows 10 but works on windows 10

I run a bash shell on Ubuntu from Windows 10. I was recently provisioned a new laptop and now find that I am unable to retrieve URL's with curl. However curl works when run directly on windows shell ...
Ihe Onwuka's user avatar
0 votes
3 answers
2k views

Downloading videos from Youtube doesn't work via `curl`

I have opened and downloaded via curl some mp4 file from Youtube via F12 hotkey (i.e. from developer menu) and have saved it into J.mp4 but it cannot be replayed. Someone knows Why ? It writes ...
user2925716's user avatar
0 votes
3 answers
4k views

CURL name of the source file = name of the target file

I want to download a lot of files which have all similar names: xxx/1.jpg, xxx/2.jpg, xxx/3.jpg, and so on to C:/Brawa/. So I write: CURL https://example/xxx/[1-3].jpg -o C:/Brawa/#1.jpg Now I want ...
user1264405's user avatar
0 votes
1 answer
624 views

PR_CONNECT_RESET_ERROR upon visiting addons.mozilla.org

Mozilla Firefox 84.0.2, Windows 10 No add-ons/extensions. Also happens on Microsoft Edge. Output of curl -vvvvv https://addons.mozilla.org/ : * Trying 44.239.254.46... * TCP_NODELAY set * Connected ...
gps's user avatar
  • 1
1 vote
2 answers
183 views

Get latest winrar installer with cURL

I'm tryng to always download the latest version of WinRAR in my language from the official site with cURL but can't figure out how the redirect link works. The site https://www.win-rar.com/...
klaatu_nikto's user avatar
0 votes
1 answer
1k views

What are the dedicated command line options for `curl -X`?

In my curl man pages: -X, --request (...) Normally you don't need this option. All sorts of GET, HEAD, POST and PUT requests are rather invoked by using dedicated command line options. What are the ...
Raf's user avatar
  • 191
1 vote
2 answers
1k views

How to download a zip file using the command line

I would like to download a heavy compressed zip file from either dropbox or the UCF-Crime video dataset. The dataset's website points out these two links to get the dataset from : https://www.dropbox....
YellowishLight's user avatar
0 votes
1 answer
1k views

How to curl data from website hosted by host from ssh client?

I didn't found an answer to my question and hope it's not an duplicate. I'm hosting a website on my windows host on localhost:23456. From my host PC I can curl data using: curl localhost:23456/topic1 ...
nail's user avatar
  • 101
1 vote
1 answer
455 views

GNU Parallel usage - how get currently passed string to parallel?

I am using GNU parallel and want to understand - how can I get the individual string passed to each parallel command? As an example, GNU Parallel documentation shows how to move files from the current ...
Invisible999's user avatar
1 vote
1 answer
2k views

A site getting 'too many redirects' response on curl but works fine in a browser (chrome)

I have a case when a URL opens fine in a browser but generates 'too many redirects' in curl. As an example below, a request using curl from my WSL2 instance which was taken from a bash script: curl -...
Invisible999's user avatar
0 votes
1 answer
663 views

Issue parsing variable into curl to send JSON to splunk

I have a simple script here that I intend to run periodically: statsout=`docker stats --no-stream --format "{{json .}}"` while read line ; do echo "$line" curl -k &...
Shiunbird's user avatar
5 votes
3 answers
2k views

How to get weather via cmd in Windows 8.1 using cURL?

How do I get weather results using cURL, assigning a variable to it for later use? Something like: # This doesn't work and is only a reference for what I want: set mytemperature= curl www.yahoo.com/...
batchcoding____s's user avatar
1 vote
1 answer
3k views

How to display curl's individual Exit Status from multiple requests?

My question is simple - is there a way to display curl's individual Exit Status for each URL when curl is doing multiple requests? Let's imagine that I need to check sites a.com, b.com, c.com and see ...
Invisible999's user avatar
3 votes
1 answer
4k views

Docker containers facing curl: (60) SSL certificate error after using WSL2

I haven't had any problem before using the WSL2 based engine in Windows 10 Pro. when I have changed, not just the time is always set to Greenwich (when I create a new container) but also even if I set ...
Nathan Drake's user avatar
4 votes
1 answer
30k views

Replace server address by IP in curl

I mean to use the IP instead of the server name, to directly curl a file from http://.... I am under Msys2, Win 10 (that's why post here and not in askubuntu, e.g.), but I guess it would be be the ...
sancho.s ReinstateMonicaCellio's user avatar
1 vote
1 answer
5k views

TLS options for curl/wget

Is it possible to configure curl and/or wget to reject a DH key-exchange of less than or equal to 1024 bits. As a functional test, using curl/wget on https://dh1024.badssl.com/ should fail. I was ...
Matthew Cooper's user avatar
0 votes
0 answers
141 views

Is it possible to send an email on remote (offline) machine through ssh?

I am monitoring some machines that aren't connected to the internet and can only be reached through a VPN. I currently connect to the VPN, and then use puTTY to ssh into the machines. I have a script ...
jcnoe's user avatar
  • 9
0 votes
0 answers
252 views

EXE downloaded using cURL does not execute

I have trying to write a script that install Docker Desktop along with other software. Whenever I download Docker Desktop through cURL, and try to execute the program, Windows Pops Up with This App ...
Antonios P.'s user avatar
1 vote
0 answers
3k views

Resume file download with `Invoke-WebRequest` (like `curl -C -`)

I am converting some bash downloader scripts to PowerShell, and I am using Invoke-WebRequest instead of curl to eliminate external dependencies (so curl for Windows is not an option). Most curl ...
Kartik Soneji's user avatar
0 votes
1 answer
1k views

How would I use Curl to download only URLs in a specific directory when using macOS?

This applies to https://www.gocaravanning.com/caravan-specs/Swift-Caravan-Data.html; I want to download all the years' linked to and only those pages. I know curl -O downloads the files. Would the ...
avenas8808's user avatar
0 votes
1 answer
149 views

How to download this kind of embedded video?

I wanted to download this video, i tried chrome dev-tool to isolate the url. Then searched it; but it showed me this why i cant download this video? is there any alternate method?
AL vees's user avatar
0 votes
1 answer
911 views

How do I download and extract a tar in one command, while extracting only a single file to a specific location?

I'm trying to accomplish what it says in the title ... but for the life of me I can't figure out the magic invocation. The LLVM archive I am downloading contains the path clang+llvm-10.0.0-x86_64-...
oarfish's user avatar
  • 796
8 votes
2 answers
31k views

How do I send a digest auth request using curl?

While searching for a guide I found this example on Wikipedia GET /dir/index.html HTTP/1.0 Host: localhost Authorization: Digest username="Mufasa", realm="[email protected]", ...
mina nageh's user avatar

1 2
3
4 5
15