My father told me he wanted to make USB flash drives of all the scanned and digitized family photos and other assorted letters and mementos. He planned to distribute them to all family members hoping that at least one set would survive. When I explained that they ought to be recipes to new media every N number of years or risk deteriorating or becoming unreadable (like a floppy disk when you have no floppy drive), he was genuinely shocked. He lost interest in the project that he’d thought was so bullet proof.

30 points

To me, this is just another story of the music industry’s technical incompetence.

Even in the 1990s, everyone would have known that hard drives were not a long-term archival storage solution. This is like crumpling up a piece of paper, tossing it in the corner, then being upset decades later when your “archival solution” had issues.

permalink
report
reply
8 points

I’m sure they considered anyone telling them they needed to spend money to be a pain in the ass the same way companies don’t follow the recommendations of their IT departments.

permalink
report
parent
reply
4 points

The problem isn’t even the hard drives, it’s how they are managing them. There’s not many digital data storage solutions around that you can dump into a closet for a few decades and then still read.

You have to regularly test your hard drives, so that when one fails you can take your other copy of the data and put it on a new drive.

permalink
report
parent
reply
14 points

The piece of paper is basically much more likely to survive in a corner barring a fire. I have crumpled pieces of paper from 20 years ago. My PATA hard drive… I don’t even have a computer with that connector

permalink
report
parent
reply
7 points

A bunch of paper tossed into a corner could get wet, mouldy, get munched on by rats, etc. But, I know what you mean. Spinning plates full of magnetized bits with a connector technology that only lasts a decade at most is hardly going to be reliable, even if stored under ideal conditions.

permalink
report
parent
reply
5 points

Not to mention bit rot

permalink
report
parent
reply
15 points

I got four HDDs, some are almost 10 years old. They work great but I know that won’t be for forever.

permalink
report
reply
5 points

I have probably lost lots of pictures die to head crash. WD especially

permalink
report
parent
reply
5 points

I only lost two HDDs in my life. Both in 2009. And yes, they were WDs

permalink
report
parent
reply
4 points

The only one that didn’t die because of my own fault (two externals and a laptop one sigh), was one of the infamous IBM/Hitachi Deathstars.

permalink
report
parent
reply
7 points

My system is to duplicate to fresh media once in a while. It’s more hands on, but it’s the only option I have. My NAS will be cloned to new drives in the next few years.

permalink
report
reply
2 points

That’s the way to do it. Just keep bringing data forward even for media that sits in a drawer.

permalink
report
parent
reply
2 points

You might want to look at snapraid. I’ve recently overhauled my own NAS and love it. It is snapshot based (so not perfect safety) but it is highly configurable and provides parity and scrubbing for corruption even with a JBOD array.

permalink
report
parent
reply
1 point

I’ll check that out. Thanks.

permalink
report
parent
reply
77 points

This is where “piracy” is actually the industry’s saving grace. Decades or centuries later, will record labels exist and be well-managed (and flush with cash) enough to preserve archival copies of their artists catalogs? Probably not.

Will obscure weirdos exist all around the world on Usenet, IRC, or seeding torrents? Possibly.

permalink
report
reply
27 points

What is really being discussed here is archiving of master recordings and session files. The publically avaliable releases themselves aren’t really in jeopardy. Orthough piracy probably does provide an extra layer of security to more obscure releases.

permalink
report
parent
reply
2 points

Oh, fuck. Prince’s Vault… God I hope the estate has a plan to preserve all of that…

permalink
report
parent
reply
16 points

I thought I read somewhere that when they were making one of the Toy Story movies, there was some catastrophic data loss that nearly tanked the whole production. But then one of the animators came back from maternity and said wait, I think I have most of it synced to my home server? And the next thing you know, John Lasseter himself is barrelling down the highway to her place and it turned out yeah, she did have it.

permalink
report
parent
reply
4 points

The value of distributed redundancy

permalink
report
parent
reply
24 points

Many films and tv programs survive only thanks to a total stranger keeping their own copy. For a long term survival of any media it has to be copied and distributed far and wide.

permalink
report
parent
reply
72 points
*

There is no “write and forget” solution. There never has been.

Do you think we have ORIGINALS or Greek or roman written texts? No, we have only those that have been copied over and over in the course of the centuries. Historians knows too well. And 90% of anything ever written by humans in all history has been lost, all that was written on more durable media than ours.

The future will hold only those memories of us that our descendants will take the time to copy over and over. Nothing that we will do today to preserve our media will last 1000 years in any case.

(Will we as a specie survive 1000 more years?)

Still, it our duty to preserve for the future as much as we can. If today’s historians are any guide, the most important bits will be those less valuable today: the ones nobody will care to actually preserve.

Citing Alessandro Barbero, a top notch Italian current historian, he would kill no know what a common passant had for breakfast in the tenth century. We know nothing about that, while we know a tiny little more about kings.

permalink
report
reply
6 points

Do you think we have ORIGINALS or Greek or roman written texts?

We do have originals of some much older texts, though (cuneiform on clay that was fired after impression seems to be a pretty good archival medium, overall). We’d probably have a lot more original Greek and Roman documents if they hadn’t been destroyed in wars and other disasters, or recycled for various purposes. There’s a big survival rate difference between documents that receive basic care throughout their lives—no rough handling handling, minimal direct sunlight exposure, and some degree of temperature and humidity control in the storage area—and those left to fend for themselves. That’s why old documents in surprisingly good condition sometimes turn up in caves, which tend to have constant temperature and humidity levels.

(But, yeah, current electronic media doesn’t have much chance, with select optical disk media stored under carefully chosen conditions offering the best chance for your files being retrievable decades later, if you can find a drive to read them on.)

permalink
report
parent
reply
6 points

BRB, etching all my MP3s into clay tablets

permalink
report
parent
reply
2 points

Yeah, I was going to say that we know that Ea-nasir’s copper was shitty.

Obviously not everything from 1750 BC survived, but we do know that certain mediums are more likely to stand the test of time than others. Something physical with the writing carved in? That will probably last. Something with pigment on vellum, that won’t be quite as good, but you can store a lot more information per kg. Something involving bits? That won’t last even a quarter century. Something involving bits stored using magnetism and retrieved using mechanical motion? Good luck keeping that for even a decade.

But, the thing we’ve shown will 100% stand the test of time is keeping the information flowing, though at the cost of some degradation. In the past, this was one generation telling stories to the next. When that happens, not only does the information get passed on, the language used is subtly updated in time with the evolution of the language. You don’t need to learn Akkadian cuneiform to read it, it’s available in whatever the modern language is. Similarly, if digital files keep getting passed around, it doesn’t matter if the original came on a floppy disk, and floppy disk readers are now gone. The file exists, stored in whatever medium is current. But, you get degradation with this process too. Music might be turned into mp3s with some data getting lost. Photos might be resized, cropped, recompressed, etc.

If I wanted something to be preserved exactly as-is for centuries, I’d carve it into a non-precious metal (so nobody melted it down). If I wanted something to be easily accessible for centuries, I’d try to share it as widely as possible to keep it “in motion” and in a format that was constantly up to date.

permalink
report
parent
reply
5 points

clay that was fired after impression

New record format just dropped.

permalink
report
parent
reply
4 points

Citing Alessandro Barbero

Updoot just for this

permalink
report
parent
reply
3 points

But we do have originals of many other texts. Like vast, vast amounts of cuneiform texts because they were usually pressed into a clay tablet and then baked.

All but four Mayan paper codices were burned, but the Mayans loved carving their stories into rocks and making those rocks part of their cities’ architecture, so we still have a lot of their textual information. Same with the Egyptians- they wrote a lot on papyrus, and most of that is lost, but they also carved and painted all over tombs.

The secret is not to keep copying the texts. That introduces errors and those errors can compound. The secret is to preserve the texts in a medium which will only degrade over exceptionally long periods of time (compared to a human life, anyway).

If you had a device which could carve stored data into stone and make it retrievable again, you could potentially preserve that data for thousands of years.

permalink
report
parent
reply
7 points

There is: mdiscs. Allegedly 1000 years durability even in Blu-ray format. Should be good enough for most important things. The best tapes AFAIK 30- 100 years

permalink
report
parent
reply
1 point

DNA storage.

permalink
report
parent
reply
6 points

Problem is how to read the disk, especially after generations. Will they retain the knowledge to build and operate a device for this?

permalink
report
parent
reply
3 points

I wish there was a cheap and millennia-long lasting microfilm you could transfer books to. A projector is a pretty simple device to operate. Hmm that reminds me of “Last Words (2020)”.

permalink
report
parent
reply
4 points

Simple, we wrrie down the information on how to read the discs!

permalink
report
parent
reply
6 points

That’s always problem for any type of media. Including the tape which keep changing generations and only few recent are supported for reading. I still have blue ray reader / writer though

permalink
report
parent
reply
15 points

Do you think we have ORIGINALS or Greek or roman written texts?

In some cases we do. For example, the documents at Pompeii, those at Qumran, and other rare instances where documents have been preserved from the time they’re written. It’s also true that we have far more copies than originals, and that we’ve lost most of the works of many ancient authors.

permalink
report
parent
reply
3 points

Sad little human. I have written my treatises into the warp and weft of reality itself. I have twisted my curiosity into the folds of your DNA and stamped my waxing madness into the ragged edges of the telomeres that mark your days as numbered. I have made of the stars a celestial QR code that burns across the skies of every planet, that burns across the eyes of every ape who stares into the night and asks “why?”. I announced The Work with a bang of gas and light and awe and set time itself into motion so my scripture could expand eternally into the infinite, benighted expanse.

permalink
report
parent
reply
3 points

Is this from something?

permalink
report
parent
reply
1 point

Sounds like an HFY prompt

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 18K

    Monthly active users

  • 11K

    Posts

  • 517K

    Comments