I am using curl through Cygwin on Windows 7 to download content from Apache Solr in CSV format. This is my command which is running in a for loop
curl -o ret-key-data-$i.csv $URL
As the content is very large, I am downloading 100k rows at a time. The file size is approx. 4mb each. However, if I increase the row count to 1 million, curl is not writing any content to disk.
What other option do I have to set to ensure curl can handle larger content?
EDIT: The command gives no error. It does not hang. It waits for a period of time and ends successfully but generates a zero kb file. Looks like the network is timing out.