So I want to copy a 97,9GB folder to another folder and started with a high transfer rate and an estimated time of about 30 minutes. As the fdsr continues to copy the transfer rate goes down. Its at about 5Mb/Sec now and the estimated time raised to 5 Hours. The Rate is still dropping (while I wrote this its at 4,3Mb/s already) how can I avoid this and copy the folder at a consistent high transfer rate? I am using ubuntu
In general, it is much faster to copy larger files than many smaller files. When transferring a single large file, your copy time is dominated by transfer speed. When copying many small files, your time is dominated by file creation.
You could probably speed things up by tarring up your source folder and transferring the tar file, but note if you have 500,000 files to transfer, you'll have to pay the cost of all that metadata creation sooner or later.
You may also find different file systems are more or less costly. https://unix.stackexchange.com/questions/28756/what-is-the-most-high-performance-linux-filesystem-for-storing-a-lot-of-small-fi is quite old now, but includes a comparison. Additionally, you may choose different mount options for your filesystem, as some of these can make a significant difference. For example, on ext4, you may wish to investigate