0

Last year I bought a computer, for around $1,800, so it is relatively high-end. When I first got it I was particularly pleased at how quick it dealt with large MySQL queries, imports and exports. But somewhere along the way something has gone wrong and I am not sure how to diagnose the problem.

Any job that involves processing large amounts of data, e.g. gzipping file c. 1GB+, UPDATEs on large MySQL tables etc. have become very slow. I just performed an intensive alter statement on a 240,000,000 row table on a remote server, which is lower spec. This took about 10 minutes. However, performing the same query on a 167,000,000 row table on my computer went fine until it hit 860MB. Now it is only writing about 1MB every 15 seconds.

Does anyone have any advice as to debugging what the issue is?

I am using LinuxMint (based on Ubuntu 12.04.) The home partition is encrypted, which really slows down gzip. I have noticed the swap is barely used, but am not sure if that is because there is more than enough RAM. The filesystem is ext4. The MySQL server is on a separate hard drive, but it was fine when I first installed it. Other than the above issues, there are no other problems with it.

I am going to install a fresh Ubuntu on the 4th hard drive to see if that is any different.

Improve this question
3
  • 2
    First step would be to try and determine what's limiting . . . disk, cpu, memory, etc. From the limited information you've provided, my guess would be disk . . . maybe fragmentation/low free disk space (even ext4 can get fragmented, and low free space will contribute to fragmentation for ext4)
    – ernie
    May 30, 2014 at 20:37
  • Is there any way you can tell how a disk is fragmented?
    – Kohjah Breese
    May 30, 2014 at 20:40
  • 2
    perhaps it goes slow after 860mb because thats when the cache runs out? or it starts missing cache hits and has to do disk access?
    – Jason Lewis
    May 30, 2014 at 22:43

0

Reset to default

You must log in to answer this question.

Browse other questions tagged .