Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am using curl through Cygwin on Windows 7 to download content from Apache Solr in CSV format. This is my command which is running in a for loop

curl -o ret-key-data-$i.csv $URL

As the content is very large, I am downloading 100k rows at a time. The file size is approx. 4mb each. However, if I increase the row count to 1 million, curl is not writing any content to disk.

What other option do I have to set to ensure curl can handle larger content?

EDIT: The command gives no error. It does not hang. It waits for a period of time and ends successfully but generates a zero kb file. Looks like the network is timing out.

share|improve this question
Please be more specific as to what happens. How is it "not writing any content"? Does the command wait forever and there is no output file, or an empty one? Do you see any messages output to terminal? – slhck May 12 '14 at 5:52
could the web server be timing out and severing the connection? – rob May 12 '14 at 8:05

You must log in to answer this question.

Browse other questions tagged .