Does anyone know of tool for Windows (or ideally platform independent) that is capable of syncing directories on two machines that contain several hundred of thousands of files in a fast manner? Fast meaning a few seconds / under a minute in case of only changes in a few hundred files and a few MB have occurred.
The ones I tried are fast with regard that they use the obvious minimal approach (check file mod date and only copy based on this), but even this takes 20 or more minutes with my current directories, even when only about 500 files and maybe 50 MB of data have changed.
Is there a tool that employs some clever scheme to do it faster? Some ideas that come to mind is the use of the MFT on NTFS file systems (or the equivalent on other FS), monitoring of file accesses in the background and thus having always an up to date list of changed files, etc.