Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I am using curl through Cygwin on Windows 7 to download content from Apache Solr in CSV format. This is my command which is running in a for loop

curl -o ret-key-data-$i.csv $URL

As the content is very large, I am downloading 100k rows at a time. The file size is approx. 4mb each. However, if I increase the row count to 1 million, curl is not writing any content to disk.

What other option do I have to set to ensure curl can handle larger content?

EDIT: The command gives no error. It does not hang. It waits for a period of time and ends successfully but generates a zero kb file. Looks like the network is timing out.

share|improve this question
    
Please be more specific as to what happens. How is it "not writing any content"? Does the command wait forever and there is no output file, or an empty one? Do you see any messages output to terminal? –  slhck May 12 at 5:52
    
could the web server be timing out and severing the connection? –  rob May 12 at 8:05

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.