Questions tagged [curl]

curl is a data transfer utility used for a multitude of network=related applications (such as scraping data).

Filter by
Sorted by
Tagged with
0 votes
1 answer
182 views

Why is mutual auth working on openssl 1.1.0g but not openssl 1.1.1?

I'm making a HTTPS request using mutual authentication. Testing it with curl 7.58.0 using openssl 1.1.0g, it works fine. Upon upgrading to openssl 1.1.1 with the same curl version, the call stops ...
1 vote
1 answer
692 views

Different curl errors happen occasionally

I have a webserver running Centos7 which makes curl requests to other resources. With the rate 5-10 requests per second, everything works fine except I get different curl errors every 2-10 minutes. I ...
9 votes
2 answers
20k views

cURL: multiple POST requests while reusing the TCP connection

If multiple URLs are passed to cURL, it reuses the TCP connection when possible. For example: curl -o 1.jpg http://example.com/1.jpg -o 2.jpg http://example.com/2.jpg I need to do the same, but ...
0 votes
0 answers
252 views

CA signed certificate failed to verify

I have a signed CA certificate which I installed on my Apache webserver. The certificate is valid and is signed by internal CA. I spun another Linux instance and tried curling the address but I am ...
0 votes
0 answers
870 views

I am using curl-logger with RestAssured and Java.I want to log curl requests to either text file or log file

I am getting this issue while generating curl commands on windows: --user "ashish:a26B)n^A?"%"6Wf!AsJw, !AsJw is creating problem. I'm adding the full request below: curl "https://api2-preprod....
1 vote
1 answer
2k views

Why can't cURL and wget connect to footpatrol.com

Every time I try to use either wget or cURL to connect it keeps on saying failed: Resource temporarily unavailable. for wget and curl: (7) Failed to connect to footpatrol.com port 443: Timed out for ...
0 votes
1 answer
188 views

how i can manually login to HG router using curl?

the problem that i tried the curl command from chrome network tab and it didn't work ! so i looked in the page html and found that it does this 1- Encrypt the password to sha256 2- then base64 ...
2 votes
1 answer
7k views

How to curl a URL with space in Windows?

I’m using Windows 10 and curl 7.55.1 (Windows) libcurl/7.55.1 WinSSL. I’m trying to download files from the ESA API using this curl command: curl --ssl-no-revoke -u eduardojsilvajr \ https://...
15 votes
5 answers
131k views

How to make a Curl POST call in Windows?

I am trying to issue the following command under Windows 10: D:\>curl -i -X POST -H "Content-Type:application/json" -d '{ "firstName" : "Frodo", "lastName" : "Baggins" }' http://localhost:8080/...
0 votes
0 answers
5k views

Intermittent SEC_E_INVALID_TOKEN (0x80090308) when performing SSH requests

I'm currently working with a client (a government institution) to automate some data gathering, and I've written some python scripts to gather data from a REST API. The client is behind a corporate ...
1 vote
0 answers
143 views

Calling webservices using Powershell

I am using the following code to perform a function using web services from a running application. I am using a Linux client. Below is a part of the script that I need to convert to a Powershell ...
0 votes
1 answer
545 views

Prevent curl from removing "../" from queried URL?

Prevent wget or curl from removing "../" from queried URL? The following wget query using ../ to directory traverse: wget http://192.168.0.24:7002/../../../../../mydir/myfile.txt results in the ...
3 votes
1 answer
2k views

Bulk SFTP download of files specified by URL preserving directories

I have a list of several hundred files I need to pull via SFTP. They are located in various directories and I need them to be in the same directory setup on my local machine. It is important the files ...
0 votes
1 answer
596 views

php-apache curl returns (7) Failed to connect to 10.96.128.220 port 80: No route to host

I have 3 kube services (PHP-apache) that I am trying to curl but it always returns the same error: curl: (7) Failed to connect to 10.96.128.220 port 80: No route to host Does anyone have any idea of ...
7 votes
1 answer
6k views

Apache proxy throws error connecting to a third party

Connection to a certain thirdparty service via PHP Curl throws this error: CURL error: Received HTTP code 403 from proxy after CONNECT The Apache error log on the proxy throws this: Connect to ...
0 votes
0 answers
792 views

Download file using wget from particular address

I want to download this file from "http://dl.ariamovie.host/dl5/user2/amir3/Serial/iZombie/S01/480p/iZombie%20S01%20E01.480p.AriaMovie.mkv" using wget or curl. I tried using: wget -c "http://dl....
0 votes
2 answers
3k views

How to login to website and auto-refresh page every X seconds from terminal?

I am trying to login to a particular website, then proceed to a particular page on that website and auto-refresh every X seconds. Here's what I have so I can login: curl --data "Username=xx&...
0 votes
1 answer
193 views

Bash Command to Download Specific Line ONLY of Github Script

Searching for this answer has failed me, perhaps because I'm not asking for it in the right way. I'm basically looking to use something (wget or curl for example) to retrieve the 2nd line of a text ...
3 votes
0 answers
2k views

how do I install curl from source, including updating the libcurl version?

I am working on a distro of linux that doesn't have the version of curl I need supported via apt-get. The latest I can get through apt-get is 7.52.1 and I want the latest (7.65.1). So, I've followed ...
0 votes
1 answer
2k views

how can i use curl to login into non digest login sites?

the router login page i have tried curl http://admin:admin@...*/ but it doesn't work
0 votes
1 answer
819 views

why i can't login to my router using curl -d option?

the curl command that is used to login curl "http://192.168.1.1/" -H "Connection: keep-alive" -H "Cache-Control: max-age=0" -H "Origin: http://192.168.1.1" -H "Upgrade-Insecure-Requests: 1" -H "DNT: ...
0 votes
1 answer
851 views

piping curl to tar crashes, while wget to tar is ok

When I pipe curl to tar for large files I occasionally encounter errors: jeremyr@w6:~/pelias_metal/whosonfirst$ curl -s https://dist.whosonfirst.org/bundles/whosonfirst-data-postalcode-jp-latest.tar....
1 vote
4 answers
37k views

Upload folder with cURL and FTP using Batch file on Windows?

I am trying to upload a whole folder, including it's sub-folders and files to a folder on my server from a Windows batch (.bat) file. Below is the command I have for the Upload part... curl -T E:\...
0 votes
0 answers
703 views

How to enable my upload form and php file for my apache server?

Im trying to upload files to my apache server over http with curl. I have a simple upload.php file in the root directory of my server and also a "submit" page on my server that is just a simple ...
7 votes
1 answer
2k views

pipe unlimited curl stdout into chunked files

I've got an HTTP-endpoint that serves an unlimited stream of events. Now I'd like to record that stream using curl, but splitting the recorded files at the same time - preferably based on the line ...
3 votes
3 answers
1k views

Use of curl command via HTTP

Using curl command, how to transfer a file from one location to other via HTTP request?
1 vote
1 answer
266 views

How do I use a hexadecimal range when downloading multiple files in Curl?

I know that I can download a sequence of files using decimal numbers in curl: curl site.com/file[000-100].jpg -o "file#.jpg" But I need to download a hexadecimal series of files named file0x000 to ...
5 votes
4 answers
7k views

Is there a linux filter which converts html to simple and pretty formatted text?

I would like to filter html response coming from cURL output. Which filter should I apply? Viewing html content with Midnight Commander is no problem, it shows them as pretty formatted plain text, so ...
1 vote
2 answers
3k views

downloading multiple files using curl, curl repeats address in download

I am running the command curl -O "http://www.*site*.com/[1-9].png" but the download is failing. - the output is as follows [1/10]: http://www.*site*.com/1http://w --> 1.png % Total % ...
16 votes
2 answers
98k views

How to get and use certificates with curl

Entering the following command curl -k [email protected]:password https://www.example.com Returns the following error <HTML><HEAD><meta http-equiv="content-type" content="text/html;...
0 votes
0 answers
330 views

Pipe netcat response to php post form

I'm trying to get a one-line command that pipes all messages on a port to a php script. I can't use a netcat proxy, as the receiving end is webserver-only. Basically, I have the idea of doing ...
1 vote
1 answer
2k views

Invoking wget from java (runtime.exec) hangs and limits the download to a specific file size (while same with curl does not)

Issue details I am trying to invoke wget from java to download a file but I keep hitting a weird issue where the file size will be capped. For example, when issuing "wget https://speed.hetzner.de/...
1 vote
0 answers
29 views

I want to push either a TSV file or JSON up to a Google Sheet

I have several large files of key/value pairs delimited by an equal sign ("="). One file is the master file. For each file, I want to populate columns A, B, and C as follows: A: The unique key for ...
0 votes
1 answer
16k views

Sending HTTP request via command line and curl

I am running a cloud server on a raspberry pi (raspian) and like to tell my host the ip adress. To this end, the provider of my URL provides an API which works by sending: https://<provider_url>...
-1 votes
2 answers
5k views

How to use,run cURL tool with Android Studio on windows environment? [duplicate]

What is better way to use cURL tool with Android Studio 1.1.x on Windows? because there is no proper information in official site for client tools on windows environment. I tried to download from ...
1 vote
1 answer
3k views

How can I sort this JSON data?

How can I sort this JSON data? Hello, I am curling a web service and I get this output as JSON using curl and jq. How can I sort the list by percentage, ascending or descending? { "result": { "...
0 votes
3 answers
3k views

I've downloaded file through curl in mac OS but now i can't locate its location in my system

command i've used -> curl link... | bash I've downloaded file from GitHub through curl in macOS but now I can't locate its location in my system though I can access it. I don't want it in my ...
5 votes
0 answers
3k views

Why dosen't curl seem to work behind a proxy?

When using curl behind a proxy, curl -O -fsSL https://storage.googleapis.com/tensorflow-serving-apt/tensorflow-serving.release.pub.gpg -v -k -x http://xxx.xxx.xxx.xxx:8080 I've got an error as ...
3 votes
0 answers
6k views

How to use .pfx in certificate store in CURL for Windows 7

I want to use cURL to access a remote server, and I need to identify myself using a private key or the remote server gives a 401 "Unauthorized". I'm on Windows 7 (work machine, not my choice) and my ...
0 votes
0 answers
2k views

Different response between curl and openssl s_client

I'm having a headache with some results. Running the following command results in an HTTP 200 response: $ curl -v -L www.example.com >/dev/null while running this, and using the exact headers ...
0 votes
1 answer
684 views

How to integrate cURL on my public_html?

I do have this folder structure for my website: \index.html \php\some-php-files.php \js\some-js-files.js What I want to do is, I want to use a cURL command, which I usually use it on the terminal/...
7 votes
2 answers
10k views

curlftpfs doesn't work for a username with a "@"

My hosting company makes all my usernames with a "@" in them. curlftpfs user="[email protected]:pass" ftp://ftp.domain.com/ ~/domain/ For some reason I get in response Error connecting to ftp: ...
0 votes
0 answers
799 views

wget/curl do not write to file until download is completed

I am trying to run wget/curl every few seconds to cache a HTTP file that is constantly changing (dynamically generated file, different on each HTTP request). origin fetch is a bit slow (~10s) and ...
1 vote
1 answer
4k views

How to recursively upload a directory which has directories and files to a server through HTTPS using curl command?

This is the command I am using: curl --insecure -i https://XX.XXX.XXX.XX/project/conatinername/foldertobeuploaded/${file}.html -X PUT -H "Content-Type: text/html charset=UTF-8; -H "Content-Length:0" -...
0 votes
0 answers
133 views

How to find bottleneck for parallel curl command?

I got curl runing like this: parallel -j0 curl -x 10.9.8.4:8080 --retry 1 --connect-timeout 3 -I https://{} --output {} which results in 1000 parallel jobs. I've already incereased ulimit -n to 4096 ...
0 votes
1 answer
114 views

Different download tools result in different MP3 checksums [closed]

I wrote some code for downloading podcasts and noticed that the checksums of files I downloaded with it didn't match those of files downloaded using other methods. Initially I thought there was a bug ...
1 vote
1 answer
10k views

curl to download file located at github

I would like to donwload openjdk11 using cURL from github but the download stops just after few seconds, this is what I tried: curl -o openjdk11.tar.gz https://github.com/AdoptOpenJDK/openjdk11-...
0 votes
1 answer
115 views

Windows 10: associate a command to "all" files

In windows machines, I need add a "right mouse" option to "all" data files (in concrete, all image formats and text files with extension .txt or .html, but add it to all files is also acceptable ). ...
-1 votes
2 answers
2k views

Curl command what do I make wrong? [closed]

I get: root@dm820:~# ExecStart=/usr/bin/curl'https://dynupdate.no-ip.com/nic/update' --header "Authorization: Basic <$xxxx:$xxx>" -d 'hostname=<hostname>.xxxx.ddns.net' -sh: --header: ...
0 votes
1 answer
1k views

Create a crontab script with curl

Trying to set a cronjob to use with curl. Want to update IP on noip.com. The command below gets the IP from noip.com but does not update it with my servers ip. I mean: when the IP is not updated then ...

1
5 6
7
8 9
15