Unpowered SSDs in Your Drawer Are Slowly Losing Data (xda-developers.com) 79
An anonymous reader shares a report: Solid-state drives sitting unpowered in drawers or storage can lose data over time because voltage gradually leaks from their NAND flash cells, and consumer-grade drives using QLC NAND retain data for about a year while TLC NAND lasts up to three years without power. More expensive MLC and SLC NAND can hold data for five and ten years respectively. The voltage loss can result in missing data or completely unusable drives.
Hard drives remain more resistant to power loss despite their susceptibility to bit rot. Most users relying on SSDs for primary storage in regularly powered computers face little risk since drives typically stay unpowered for only a few months at most. The concern mainly affects creative professionals and researchers who need long-term archival storage.
Hard drives remain more resistant to power loss despite their susceptibility to bit rot. Most users relying on SSDs for primary storage in regularly powered computers face little risk since drives typically stay unpowered for only a few months at most. The concern mainly affects creative professionals and researchers who need long-term archival storage.
Not really new information... (Score:5, Informative)
But if you want to use NVMe bars as long-term storage, you'll need to setup some rack where they can be powered occasionally - and depending on their own intelligence to test-read and re-write their content, you might also need to actually re-write their content intentionally.
Re: Not really new information... (Score:5, Informative)
I put mine into a machine once a year and dd the entire disk to /dev/null. So far, so good.
Re: Not really new information... (Score:5, Funny)
So far, so good.
Just wait until you accidentally dd /dev/null to the entire disk.
(Good thing that wouldn't actually work, until our AI overlords can correct "/dev/null" to "/dev/zero")
Re: Not really new information... (Score:5, Funny)
Just wait until you accidentally dd /dev/null to the entire disk.
Say, that's a great idea! I've been storing stuff in /dev/null for decades. It never once occurred to me to back it up, and I'll bet there's all sorts of neat stuff in it that I've forgotten about.
Re: (Score:2)
Seriously? Why not run extended SMART tests? It cycles through all the active areas *AND* gets and stores valuable diagnostic information and spits out a lovely report at the end of it.
Your comment sounds like the kind of person who threw away the manual to their car and simply changes oil every 6 months hoping for the best.
Re: Not really new information... (Score:2)
Are there tools that work on all drives? My understanding is none of the SMART tools for Linux are reliable on all drives. They might report the wrong metrics. My approach doesn't rely on reporting metrics, but on the drive automatically moving data that's on failing cells.
Re: (Score:2)
I have never once come across a drive HDD or SSD that doesn't correctly respond to "smartctl -t long". Some drives may not respond with diagnostic data as expected because this is a vendor specific dataset without a standard implementation, but all drives ship with some mechanism for quick and extended tests, and they all respond to the same SMART command.
That being said, your past experience may not be relevant here. Unlike HDDs, SSD controllers are actually governed by a standard of what SMART metrics to
Re: (Score:3)
Re:Not really new information... (Score:5, Informative)
Is that longevity of MO-disks partly based on how they were just built differently (less dense) back then?
No, the more dense MO-disks are just as reliable. The important point is that MO-media are far enough below their Curie-temperature at usual ambient conditions that they are "magnetically hard", so even sizable magnetic fields would not damage the information on the media. This is unlike the classic magnetic media, which is relatively easy to erase with modest magnetic fields. Would be interesting to know if modern "heat assisted magnetic recording" hard drives are of similar resilience while at ambient temperature.
Re: (Score:2)
Re:Not really new information... (Score:5, Interesting)
I continue to use burned DVDs for backing up the critical stuff. Not perfect, of course, but not electromechanically-failure prone like a hard disk drive, not "terms of service" failure prone like cloud storage, and not "the charge magically held in the gate leaked away" failure prone. I have optical discs over 25 years old which are still perfectly readable.
DVD-R? DVD+R? DVD+RW? Single or dual layer? Gold metallic layer? Silver metallic layer? How are they stored?
Depending on how you answer those questions, your 25 year-old media may be past due and you've just gotten lucky, may be just entering the timeframe where it may die, or may have decades of reliable life left.
DVD-R single layer disks with a gold metallic layer are good for 50-100 years. Other recordable DVD options are less durable, some as little as 5-10 years.
Re: (Score:2)
Re: (Score:1)
I do the same, two copies on different burners with different software to different brands of media. Problem is the media is getting really hard to find, the few remaining types out there are branded but made God-knows-where under who-knows-what conditions.
And unless your on desktop, there are only some Japanese market laptops (h/t to /. for that?) that come with DVD drives. Yes you still could use a external one via USB or whatever but they stopped putting them in about half a decade ago on new machines in lots of other markets. That being said I have used old DVD's from the library and they work great 10+ years latter depending on what I am watching.
How do you handle the different burners, brands of media if your only making two copies, do you do off
Re: (Score:2)
Re: (Score:1)
Re: (Score:2)
Would be interesting to know if modern "heat assisted magnetic recording" hard drives are of similar resilience while at ambient temperature.
I'm guessing the answer is yes. The need for heat assistance implies high coercivity at anything close to room temperature. HAMR write temperatures go beyond 400C, far above room temperatures.
Re:Not really new information... (Score:5, Informative)
What's changed is that in the early days flash memory was one bit per cell. Now most consumer grade stuff is multi level, so instead of a single threshold voltage that separates a 1 from a 0, there are multiple thresholds that each represent a different binary code.
SSDs sometimes have to re-read blocks with different voltage thresholds to get good data, and make use of error correction on top.
Presumably age related degradation is worse for multi-level flash.
Re: (Score:3)
SSDs sometimes have to re-read blocks with different voltage thresholds to get good data, and make use of error correction on top.
NAND-style Flash pretty much REQUIRES a SECDED scheme as even simple reads can corrupt the storage over time. You're pretty much guaranteed a bit-flip at some point. But modern NAND controllers pretty much handle the correction and re-write "behind the scenes" by copying the whole block somewhere else (after correction) and re-mapping.
Re: Not really new information... (Score:2)
Depending on the need, archival quality Blu-ray Discs are not bad either. As to the material, it is not much unlike writing modern stone tablets.
Everything dies eventually (Score:1)
Unpowered flash memory self-erases. Magnetic media demagnetizes and corrupts. Optical media has a reflective layer that corrodes causing bit-rot. Paper decomposes and ink fades. If you want information to last, carve it in stone and bury it in the desert.
Re: (Score:3)
If you want information to last, carve it in stone and bury it in the desert.
Or pay some celebrity to throw a hissy fit in public about _that_information_ being exposed, and use the Streisand effect to have the information stored, forever, in an almost uncountable number of copies.
Re: Everything dies eventually (Score:2)
Re: Everything dies eventually (Score:3, Funny)
Only wimps use tape backup: real men just upload their important stuff on ftp, and let the rest of the world mirror it ;)
Linus Torvalds
Torvalds, Linus (1996-07-20). Message. linux-kernel mailing list. IU. Retrieved on 2014-04-26. - 1995-99
Re: (Score:2)
Data tapes from the 1960s are still readable if they were stored properly. Finding working 7 track drives are a different matter.
Re: (Score:2)
Paper tapes from the 1750s [wikipedia.org] are still readable if they were stored properly. Finding looms from that era are a different matter (but you could make a modern reproduction).
*some data tapes from the 1960s (Score:1)
Re: (Score:2)
M-Disc is built with the intention of lasting a thousand years. The data layer is a stone-like material.
SSDs.... in a drawer? (Score:3)
Good grief, friend, who sets your HW budget?
Re: (Score:1)
"The concern mainly affects creative professionals and researchers who need long-term archival storage"
Who's paying these researchers? And why would they ever think SSD is "archival" ???
Re: (Score:2)
Re: SSDs.... in a drawer? (Score:2)
I have got about 6 unused SSDs in a drawer. Low capacity, from 64GB to 128GB. Some are 15 years old now. I use them fairly rarely, to do things like write new OS boot images. I don't store data long term on them. But they all still work - no write or read errors. SMART data looks fine, too.
Data Retention and Wear (Score:3)
As the SSD wears, the retention goes down. Years ago, a tech magazine (remember those) did a torture test on an old MLC Samsung 3D SSDs. It was healthy with no errors at well over 10X the rated endurance. Unfortunately, the data retention was measured in days. This is why it is so important to watch SMART for wear and replace drives that are worn out. They might still seem error free, but they are not really storage at some point.
Other factors are temperature (cooler is better). Some have mentioned radiation, which probably is an issue if you are putting these in aircraft. Bottom line, if you really want the data to survive, replicate and keep it moving with good data integrity checks.
Just power? (Score:2)
Re: (Score:2)
Re: Just power? (Score:1)
Re: (Score:2)
Re: (Score:2)
This charge leakage also happens when it's powered, but much slower.
Spare parts (Score:2)
I just hope the firmware is stored on SLC because it sure likely isn't stored on a ROM chip. I have several SSDs that have been powered off for more than a year but with no data on them. They are used spares and have no data, but I don't want them to just stop working.
Re: (Score:2)
Can one recharge them? (Score:5, Insightful)
Does one need to rewrite all cells to "recharge" them or is it enough to connect the SSD for a day, a week, or another timespan?
Re: (Score:2)
Good question, I wanted to ask the same... and this being Slashdot, I am hoping for a nice trustworthy answer :)
Re: (Score:2)
Re: (Score:2)
The question is, if I put my old SSD into an USB enclosure, for how long do I need to connect it every few months to be sure the data is safe?
One could probably try to determine a minimum amount of time based on flash speed, but how fast does the controller work? Does it work when the SSD is idle but in principle powered, or does it only do it between real writes? Are the writes about the speed of the interface (for example SATA) or can one expect them to be faster because the flash itself is faster?
Without
Re:Can one recharge them? (Score:5, Interesting)
The cells must be erased and rewritten, as no-one has (yet) made a NAND cell with refresh functionality similar to that of DRAM.
Powering on an SSD will cause the controller to start managing the flash memory. Or not, as the case may be, if the controller is simple and cheap. More expensive controllers do indeed move data around to avoid data loss, but in doing so they consume valuable write cycles.
In other words, plugging a USB stick into a charger will certainly not do you any good, but powering on a high-end SSD might.
DO. NOT. TRUST. FLASH. MEMORY. WITH. YOUR. DATA.
(See also: BIOS chips that suddenly fail, seemingly for no reason, bricking devices like motherboards and controllers.)
Re: (Score:2)
SSDs do automatic scrubbing, i.e. a sort-of self-refresh when powered. They do it only for cells that have gotten weak. No idea how long that takes though.
You should be able for force a full test cycle by either reading the full SSD or by running a long SMART self-test.
Re: (Score:2)
SMART long is a good idea. I guess many SSD manufacturers consider checking if a block is weak a good thing to check during a SMART test as well.
On the other hand, isn't a SMART test defined to do only read operations?
Re: (Score:2)
SMART tests are not really defined. But reading a cell should automatically trigger a refresh if the read was weak or did require ECC. This is not a visible "write", more like housekeeping.
Re: (Score:3)
Normally SSDs do data cleanup utilities when idle so simply having it powered on would do the job. But if you want to do this as periodic maintenance then use the time to do something useful, run an extended SMART diagnostics. It's guaranteed to touch the entire drive and spit out a nice report at the end of it.
Re: (Score:2)
A read is supposed to be fine. At read time the firmware *should* rewrite the cell if the read is weak.
The firmware also *should* go out and patrol the cells when idle and it has power.
you can dd if=/dev/sdX of=/dev/null bs=2M once a year if your firmware behaves.
If your drive is offline you could
dd if=/dev/sdX of=/dev/sdX bs=2M iflag=fullblock conv=sync,noerror status=progress
to be sure, though write endurance is finite.
If you're running zfs you can 'zpool scrub poolname' to force validation of all the wri
Re: (Score:2)
I don't think write endurance is a problem for desktop-use drives of this decade. Most of them are specified to have TBW that you will never achieve, and especially not if its a drive that is most the time unpowered.
Re: (Score:2)
In my case, only a complete refresh worked. It's not like SSDs have some kind of internal clock to keep track of when cells were last refreshed (assuming the drive even does its own maintenance, which it clearly did not).
Continuously powered, but several years old. [ninechime.com]
After a refresh. [ninechime.com]
Notice how temps went down a lot after the refresh, too. Clearly, the drive was struggling a lot to read cells.
Re: (Score:2)
I think btrfs has a mode to completely rewrite data, which may come in handy. I am not sure if this really rewrites all metadata, though. What does it help to have all file data, when the metadata is missing.
Re: (Score:1)
Re: (Score:2)
I'd think that plugging a USB drive into a USB charger would not do much at all. Any smart drive would not power on if the data pins are dead, will it?
Data in your drawers (Score:2)
Gives a whole new meaning to "use it or lose it".
traditional ways (Score:2)
I was waiting to see a post along the lines of
" I do a full-disk byte dump and print it out. Then all I have to do is scan the paper copy back in later."
Re: (Score:2)
Not a good idea, but you could try paper tape.
Re: (Score:2)
Depending on the data, that is a perfectly valid approach. Example: Root CA secret key. Make sure to use pigmented, non-acidic ink or laser.
What about CDR? (Score:2)
I have a bunch of old data stored on Kodak Gold CDRs from the 1990s. Kodak claimed 100 year archive life -- although I guess this was just a "best guess" based on accelerated aging tests.
Perhaps I should check them and make sure that bit-rot hasn't set in.
Otherwise I don't bother with backups, they're far too stressful. I mean... if you're backing stuff up you've got to choose the right media, keep a copy off-site and have a restore strategy in place. If you don't backup then none of this is a worry an
Re: (Score:2)
I always thought most CD-Rs have a pretty short shelf life. And recordable DVDs too. Thy use ink that changes color when the laser heats it to store data instead of a pit, and that ink degrades.
Re: (Score:2)
It depends on the quality of the dye layer, the quality of the coating and other factors. For DVD recordables, same thing. The exception is DVD-RAM which use phase-change and can theoretically be archive-grade. But everything has to work for that. I tried with some and apparently disk and drive need to be matched for it to work well. At the time I tried, there were no current drives and disks with that information available.
Re: (Score:3)
Have you tried to read any of those old CDRs back? I tried reading some 20 year old CDRs and got a 100% failure rate. Not premium CDRs, not stored in a sealed environment, but reasonably environmentally controlled (60-95 deg F, humidity 20-50%- no rapid changes in either).
Re: (Score:2)
Probably low-stability dye. CD-R can be made very cheaply.
Re: (Score:2)
It is a matter of luck. Better not depend on them. Some DVD-RAM were archive grade, but only when written with the right drives.
HTWingNut (Score:2)
HTWingNut on YouTube has been running a long-term experiment to answer this question. The sample size is small but it's pretty interesting:
https://www.youtube.com/watch?... [youtube.com]
Re: (Score:2)
My sample size was small (just a couple), but it decided me not to trust SSDs for backup even though everyone on Slashdot said I should trust them. What I'm afraid is that portable USB drives will start being main with SSDs rather than spinning rust without bothering to tell me.
Re: (Score:3)
SSDs work for backup with a level of redundancy. Like the tires on a car, they can get worn. They also can degrade just with time. Copy, verify the copy, store the copies separately. I think the tests done confirm that they wear.
I trust capacitors over spinning rust because I'm better at limiting electrical damage than mechanical. It is unrealistic to assume you can eliminate failures- you can only reduce their likelihood.
Re: (Score:2)
No. These tests confirm that SSDs need to do data scrubbing to be reliable and hence need to have power for longer-term storage. The wear is a secondary effect.
Re: (Score:2)
My sample size was small (just a couple), but it decided me not to trust SSDs for backup even though everyone on Slashdot said I should trust them.
I most certainly never said such a stupid thing. SSDs are NOT long-term storage and neither are USB-sticks.
Re: (Score:2)
I'm not saying any particular person said that, and the question to Slashdot was asked over 2 decades ago. But I was assured that SSDs were "now reliable as an archival store", despite my informal test failure. (I had backed up something to them, and stuck them in a drawer for perhaps a year. They became unreadable.)
Re: (Score:2)
I do not doubt that. We have some large-ego-small-insight "tech" people here, same as any tech forum. These then state total insightless nonsense with confidence. People like that are unable to tell when to fact-check, but have total confidence in their knowledge. And they are always around in some form.
Come to think of it, modern LLM communication is modelled on these idiots, because they can convince people. People like that also do well in sales, religion and politics.
Funny thing: I was asked about the s
Flash and DRAM are kinda the same tech (Score:2)
Flash and DRAM are both ways of storing/reading back charge on a capacitor. If you don't read and rewrite, the charge dissipates. DRAM can be written more often, Flash lasts a longer time. If you don't periodically read and rewrite, the data stored on either goes away.
Yes, so? (Score:2)
Anybody that did minimal research has known that for ages. SSDs do and need to do scrubbing, i.e. data refresh and for that they need to have power. If you want longer-term unpowered storage, use HDDs (but better stay away from the SMR trash). For long term storage use archive-grade tape or paper. Or stone tablets if it is low volume.