23

I've had HDDs years ago that used to fail and Windows would warn me that HDD has serious problem and gave me time to do something about it, because otherwise after I reboot, it wasn't guaranteed for HDD to work again. That's like 10+ years ago.

I've had an SSD for the past 6+ years and I've been using it nonstop. It's a 256 GB SSD and I've written over 170 terabytes on it so far. In Windows disk and drives settings, I see it has still 54% of its lifetime remaining, which is amazing.

I want to know how reliable is this life time number exactly? I know that Windows setting uses S.M.A.R.T data to estimate the remaining life time, but are SSDs like HDDs and do they fail all of sudden just because of a bad sector or something like that? Or do they degrade over time gradually? I check that remaining life time every few months and it does go down 1% some times.

What to do about a critical warning for a storage device

Enter image description here

Enter image description here

More details for my SSD:

Enter image description here

TBW for my SSD is 160 TB, but I've already written 170 TB and SMART shows 54% life time remaining. it's been almost always running at ~50.C temp.

XPG SX8000 PCIe Gen3x4 M.2 2280 Solid State Drive

1

7 Answers 7

31

You can never know when one specific drive is going to fail, or whether it will fail slowly enough to rescue data from, or fail suddenly and catastrophically.

SMART is a set of 'guesswork' algorithms, in effect. It can be a reliable predictor of slow decline, but it can never predict sudden total failure.

You always need a backup in place, and you need to periodically test it works. Waiting for the warning is just not reliable. This becomes even more important if a drive is encrypted, as any fail may take down the encryption keys, meaning the data is lost immediately & totally.

My oldest SSD is now about 10 years old. It still shows '100% health' when I look at the figures. I have two independent apps which background check the SMART data every few hours.
So far, so good.
My in-house backup runs every hour, my off-site overnight each night. I also make periodic direct clones.
One day the drive will fail. At that point I will order a new one & be back up & running, with no more than an hour's work lost, within half an hour of the new drive arriving.

I once had, due to total coincidence, two boot drives on two machines fail inside a few months. Both drives were relatively new, both from reliable manufacturers.
Nothing was lost in either case.

13
  • 7
    It's never 100% predictable. The two drives I lost were both only about a year old. Both were reputable makes. Both died suddenly & totally. MTTF [mean time to failure] is also just an average. One will die the first day, another will run a decade or more, but the majority will be around the predicted time, in a bell-curve. So yes, it's prefectly possible that a 54% drive can fail tomorrow.
    – Tetsujin
    Jan 22, 2023 at 12:19
  • 2
    @Tetsujin It's not a bell curve, it's a constantly decreasing curve. That's why the MTTF has been abandonned and replaced by the AFR (annual failure rate) by most of the vendors, because MTTF is not really pertinent for the actual failure curves.
    – PierU
    Jan 22, 2023 at 13:43
  • 3
    @Tetsujin " if you do it that way, the last drive lives forever" --> nope. The last drive has still 1% chance of failure every year. The resulting life expectancy is finite, not infinite. That said, the constant AFR model is in practice valid only during a few years, and after that it tends to increase.
    – PierU
    Jan 22, 2023 at 20:42
  • 2
    @James_pic You're correct, at least for HDDs, and this is confirmed by extensive studies made on thousands of drives by companies like Backblaze (who operate data centers for online baclup/storage). But for some reason drives vendors rate their drives in terms of constant AFR.
    – PierU
    Jan 23, 2023 at 19:20
  • 2
    @Tetsujin I think there's some misunderstanding on both sides here. PierU's saying that, if you take AFR at face value, you get exponential decay. Even though a model based purely on AFR would predict a decade-old drive to have the same odds of failing this year as a brand new one, since some have already failed over that decade, a plurality of drives fail during the first year (despite this being very rare). I think PierU is saying that this exponential decay model is standard among manufacturers, (1/2) Jan 24, 2023 at 4:32
22

SSD wear-out is mainly due to the cumulative amount of data written on it. So the vendors use accelerated tests and statistical models to quantify how much written data a particular model can stand, and they rate this model in terms of TBW (TeraBytes Written). The SMART "remaining lifetime" is based on it: if you have written 170TB and have 54% remaining, your drive is probably given around 370TBW.

What happens when the drive reaches the given TBW and the remaining lifetime is 0%? Nothing... The TBW is just a statistical value, say "After TBW, 99% of the drives are still operating correctly" (I don't know if it's 99%, 90%, 99.9%, but this is idea, with a given threshold): so it's perfectly possible that your particular lasts twice the given TBW (and it's also perfectly possible that it fails after half the TBW).

There are other SMART attributes that can better help predicting a failure such as the read error rate, the pending sectors count, the reallocated sectors count... When one of them starts increasing, you should worry about the drive. Note that one bad sector in itself, or even a few bad sectors, is not enough to say that the drive will fail soon.

And still, a SSD can also fail at any moment, without any warning, with all the SMART attributes that were OK. But it's not different from any electronic or mechanical product.

1
  • 4
    TBW is about a specific failure mode: individual memory cells no longer reliably storing data. When the lifetime remaining hits 0, that means the manufacturer is no longer guaranteeing that written data will be readable. Other failure modes are independent of TBW.
    – Mark
    Jan 24, 2023 at 1:02
9

but are SSDs like HDDs and do they fail all of sudden just because of a bad sector or something like that? or do they degrade over time gradually?

They most certainly degrade over time which has to do with a finite amount of program / erase cycles, which is basically what the remaining life time related attributes are trying to measure. The controller will try to make this wear happen evenly over the NAND.

It is also known that for example the ability of cells to retain 'data' decreases as amount of p/e cycles for those cell increases. IOW, the SSD closer to it's predicted EOL is not the same SSD it was as when you purchased it. So while these cells can still be programmed, they're in a worse shape than they once were.

As a result the SSD needs to do more maintenance, itself contributing to wear: This decreased data retention ability is countered by for example periodically refreshing data by the SSD (patrolling), which involves reading the data and writing it to a different location, so this process itself is also contributing to an increase in p/e cycles.

But SSD's can and will certainly also fail all of a sudden due to for example firmware bugs, firmware corruption, cosmic rays, sudden loss of power, physical trauma, wear of SMD components and whatnot.

The recovery rate for SSD by data recovery labs is considerably lower than that of conventional HDD's, so keeping backups is perhaps even more important (it's important anyway, but you get the point).

With regards to this particular case, the health score as displayed by the SMART tool is based on the 05 attribute:

enter image description here

54% is based on a single RAW value, attribute 05 'percentage used', 0x2E (46 decimal) - this value increases as situation deteriorates). Reserved spare capacity is still 100% available (0x64) - This value drops as situation deteriorates.

TBW for my SSD is 160 TB, but I've already written 170 TB and SMART shows 54% life time remaining.

It's not uncommon for SSD manufacturers to change specs and switch components.

7
  • This decreased ability is countered by for example periodically refreshing data, which involves reading the data and writing it to a different location – This is actually done automatically by the flash controller. It's called static wear leveling.
    – forest
    Jan 22, 2023 at 22:21
  • No wear leveling is not what I'm referring to. I am referring toe decreased data retention capability and measures to counter this. Jan 22, 2023 at 22:27
  • You're thinking of dynamic wear leveling. Static wear leveling is a little different and is the process where data that has been "resting" for a long time gets read and written to a new area. It increases data retention capacity (as well as reducing wear).
    – forest
    Jan 22, 2023 at 22:28
  • Ehm, no I think I am not. Wear leveling is about what goes where, I am referring to refreshing data that is at risk due to read/write disturb and charge leakage. Jan 22, 2023 at 22:53
  • But you're describing a process where the flash controller periodically moves data that has been sitting a long time, right?
    – forest
    Jan 22, 2023 at 22:55
4

are SSDs like HDDs and do they fail all of sudden just because of a bad sector or something like that? or do they degrade over time gradually?

I wouldn't say it is (always) that way round. A HDD often makes uncommon noise before it fails and you may even be able to still read it as long as it runs when it fails (do not turn it off then!). When I had a SSD failing, it was completely unavailable from one second to the next and the PC doesn’t recognize it as a drive at all since then.

As always, different people have different experiences and everyone has one manufacturer that works well for them and one they wouldn't buy again. But it seems that SSD controllers rather shut off everything when HDD controllers seem to try the best (or are unable to detect if it is a final failure or still only a upcoming one).

With modern wear leveling, SSDs should know faulty cells early, as they can notice when a cell doesn't work when they write to another cell when wear leveling and they usually have more spare sectors than HDDs. Of course, this does depend on the model and the firmware, too.

Estimates like "x TB to go" or "54% lifetime left" are just estimates. You may get a new drive on warranty as long as smart still reports lifetime left, but that won't help to get lost data back. Make backups, get new drives from time to time and make sure to monitor other smart values that may hint at a degrading drive.

1
  • Two SSDs of the same age in a RAID 1 will have approximately the same number of blocks written and the same age. If they are the same model, they may still fail at the same time. For example, there were models with a firmware bug that failed after 40,000 hours of use. This applies not only to SSDs, but also to HDDs; if you have two of the same model, they may have the same faults. Especially if they are from the same batch in production.
    – allo
    Jan 26, 2023 at 18:51
1

Every major SSD made in the last decade has spare capacity. The exact amount varies, but's it's roughly 10% when the drive is new. This is necessary because writing to an SSD is destructive. The SSD directs your writes to the spare capacity, and then puts the overwritten parts back into the spare capacity. Wear levelling ensures that all parts of an SSD are equally written. If a write does fail, because a sector has gone bad, it's taken out of the spare capacity, and the write is retried on another spare sector.

This means that the SSD can compare the spare capacity with the bad sector list. If your SSD runs out of spare blocks, it can't write new data anymore. So this ratio is a simple and effective measure of expected lifetime.

But there are other parts of the SSD that can also fail, and these cannot be reliably measured. So this spare capacity-based lifetime is no excuse to skip making backups.

1
  • While it's correct to say that a SSD has a spare capacity, it's incorrect to present it as a special area in the SSD. It's just that the reported capacity, as seen by the OS, is lower than the actual capacity of the drive: the difference is the spare capacity. In particular, the SSD doesn't "direct your writes to the spare capacity", it just writes anywhere on the SSD (chosing free blocks and according to wear-levelling algorithm). Last, the remaining lifetime attribute is not based at all on the spare capacity left.
    – PierU
    Jan 23, 2023 at 21:51
0

Most SSD failures are firmware issues, which in most cases can be addressed in-situ. Some manufacturers are much better than others at releasing updated firmware; this is one factor I take into account when selecting SSD SKUs. I have encountered multiple situations where an SSD firmware update fixed latency, reliability, and even endurance burn issues.

A drive's self-reported binary health status doesn't mean much. I have not often seen an unhealthy status when the drive was in fact okay, but a number of times I've seen drives with salient issues that nonetheless reported overall healthy. This underscores the need to look at specific attributes.

At least some SSDs report estimated lifetime based on experienced vs rated PE cycles. Others may extrapolate based on spare blocks used vs remaining. Note that some drives report lifetime remaining while others report lifetime used. I once received a smartmontools drive.db entry for a drive from the manufacturer that had this polarity wrong -- I submitted a corrected revision upstream.

Some drives, including Intel / Solidigm enterprise SKUs, have a timed workload feature. One can zero a counter and let the drive take real-world workload, then after a day or three one can query the drive for extrapolated lifetime. This can be more accurate than relying on calculations over TBW and numbers from tools like iostat or iotop. One reason for this is that (quality) SSD firmware will try to coalesce smaller writes so that it can write whole NAND pages, instead of write amplification via RMW cycles when sub-IU writes are issued. Another is that writes may be misaligned wrt NAND page boundaries, much like the traditional desirability of aligning Unix/Linux HDD partition boundaries. Some drives report writes to the drive separately from writes to NAND; this can help show how much write amp is going on.

Some SSD SKUs do actually go read-only when the rated PE cycles and/or TBW are reached, but my sense is that there is an industry trend toward not doing this. Quality / enterprise SKU TBW / DWPD are typically fairly conservative. A drive on average may be able to significantly surpass the rating, but a population of drives will experience an increasing incidence of failures past the rating.

1
  • 2
    Is this from chatGPT ?
    – Toto
    Oct 17, 2023 at 15:22
-2

SMART was almost useless for HDDs mainly because it could not take into account most failure modes and the processes leading to them.

It did report some potentially useful data (hours powered on, number of power-on cycles, number of bad sectors and a bunch of other numbers that could be used for some basic predictions, but the model parameters varied between models and sometimes even between batches of disks.

For SSDs, it did not improve much.

The volume of the data written is the most important number for an SSD and in theory one can compare it to the promises in the datasheet but, again, some disks go well after 10 times the rated write volume and other die beforehand.


In short, use reputable brands, use RAID, use UPS, make backups and hope for the best.

2
  • 9
    SMART is very useful for HDDs. Just because it can't detect all failure modes doesn't mean that it's not quite good at detecting many of them, especially when failure is imminent.
    – forest
    Jan 23, 2023 at 6:50
  • 1
    Google's hard-drive study found that SMART could be used to predict about 50% of all hard drive failures with a low rate of false positives, or about 64% with a substantially higher rate of false positives.
    – Mark
    Jan 25, 2023 at 0:20

You must log in to answer this question.