We have a data file from a client which is 1,443,777,659 bytes in size.
Sorted output has lines missing and is only 1,269,801,985 bytes in size.
Sample command: sort -k 1,10 -T . -s -i file_to_sort.txt -o out.txt
We've tried on 32-bit Win 7 and XP systems.
We've tried the supplied sort.exe that comes with windows, as well as binaries from UnxUtils and Gnu coreutils.
None give an error, however all result in the exact same output size. I've tried another freeware utility that works but is much slower.
I believe this may be due to a 32-bit limitation, however the file size doesn't seem near any of the usual suspects, and these programs work by writing and merging together smaller files, none of which approach 2 GB in size.
Any tips on how to get to the bottom of this? Thanks.