Rate of Copying a Large File to a USB drive decreases as file size increases

Question

I am using a 1.5TB Seagate USB Drive, formatted with NTFS, attached to a Linux Computer.

I am copying a 70GB File to the drive.

I have noticed that the file size of the copy has started increasing at a lower rate.

At the beginning, the file was growing at approximately 19MB/s

Now, with the destination file size at 60GB, the rate of growth is about 5MB/s

What are the factors that could contribute to this?

Answer 1

My guess is it's the cache (or buffer if you prefer).

The first chunk of data is written very fast into the cache (to be written to disk at leasure). The cache fills up, and so the transfer rate drops down to the actual transfer rate to the disk (as data is written to the disk from the cache space becomes available in the cache)

The gradual decrease in speed you see may be the average speed over the entire transfer. The longer the transfer goes on the higher the percentage of the transfer is at the lower actual speed, and so the lower the average transfer rate gets.

They say a picture paints 1,000 words, so here is one.

The blue line is the actual transfer rate, the red one the average since the start. (These are only example figures I made up from my head).

Answer 2

Hum, difficult to say.

Other operation on the source and/or dest, fragmented disk space on one or the other. Does it behave exactly the same way for each copy?

Answer 3

This is an issue I have seen with the way all the new green and low power drives like to park their heads every so often.