In linux tcsh, if I am creating a log file like:
CMD > cmd.log
How can I make the write buffer, which caches the data before sending it to disk, be larger than the default? How can I buffer more write data going to
cmd.log and decrease the frequency of writes to that file handle?
EDIT: I still haven't figured out how to do this, but we found the issue with our system. Someone was thrashing an NFS disk filer with multiple write of the same data. They weren't even using the local disks to incrementally generate the file and then copying the results to NFS.
Also, you can use
CMD_BLAH | gzip --stdout > log.gz
Which will do some caching in main memory as well as reducing the final output file size ( usually).