Who needs human when you have AI :p

You are viewing a single thread.
View all comments View context
2 points

If we assume LLMs are as revolutionary as you are suggesting, then how is model collapse an easy problem to solve? Google is a relic of the past, the internet is filled with AI generated content; then where will the training data come from? We can’t replace human generated content with AI generated content without an inevitable model collapse.

Oh and btw, good luck with differentiating between human generated and AI generated. Already, social media sites are being cluttered with AI generated content, Amazon book publishing being cluttered with shit tier LLM generated “books” (cheap immitations), and if academia goes this way, and entertainment as many speculate, there’s hardly anything left.

permalink
report
parent
reply
-1 points

Oh and btw, good luck with differentiating between human generated and AI generated.

One easy way to do this is to check if it was generated before 2023. Not so much AI-generated content from before then.

Amazon book publishing being cluttered with shit tier LLM generated “books”

So filter the books based on how “shit tier” they are.

In the end, what’s needed to train AIs is good content. If some of that good content is itself AI-generated, who cares? You need to be selective in how you pick training material anyway.

permalink
report
parent
reply
1 point

LLMs need updated training data to stay relevant.

And how exactly are you going to curate high quality data when it’s in the orders of tb’s or even petabytes?

permalink
report
parent
reply
0 points

LLMs need updated training data to stay relevant.

Yes. So add relevant new data along with the older stuff. The problem is not that AI-generated content is magically “poison” somehow. Model collapse happens when you lose rare data from repeated generations of training data generated by AIs.

A simple way to imagine it is training an AI by showing it random coloured marbles out of a bucket and then asking it to fill the next AI’s bucket with new marbles to train on. If there’s just one single blue marble in the first bucket then it’s easily possible that the AI will fail to put a blue marble in the second bucket, after which there will never be a blue marble again if that’s all that subsequent AIs have to train off of. But if each time you train a new AI you reuse half the marbles from the first bucket again, you can have that blue marble show back up again in future AIs.

permalink
report
parent
reply

Science Fiction

!sciencefiction@lemmy.world

Create post

Welcome to /c/ScienceFiction

December book club canceled. Short stories instead!

We are a community for discussing all things Science Fiction. We want this to be a place for members to discuss and share everything they love about Science Fiction, whether that be books, movies, TV shows and more. Please feel free to take part and help our community grow.

  1. Be civil: disagreements happen, but that doesn’t provide the right to personally insult others.
  2. Posts or comments that are homophobic, transphobic, racist, sexist, ableist, or advocating violence will be removed.
  3. Spam, self promotion, trolling, and bots are not allowed
  4. Put (Spoilers) in the title of your post if you anticipate spoilers.
  5. Please use spoiler tags whenever commenting a spoiler in a non-spoiler thread.

Lemmy World Rules

Community stats

  • 817

    Monthly active users

  • 335

    Posts

  • 8.1K

    Comments

Community moderators