Data poisoning: how artists are sabotaging AI to take revenge on image generators::As AI developers indiscriminately suck up online content to train their models, artists are seeking ways to fight back.

68 points

This system runs on the assumption that A) massive generalized scraping is still required B) You maintain the metadata of the original image C) No transformation has occurred to the poisoned picture prior to training(Stable diffusion is 512x512). Nowhere in the linked paper did they say they had conditioned the poisoned data to conform to the data set. This appears to be a case of fighting the last war.

permalink
report
reply
16 points

It is likely a typo, but “last AI war” sounds ominous 😅

permalink
report
parent
reply
61 points

Takes image, applies antialiasing and resize

Oh, look at that, defeated by the completely normal process of preparing the image for training

permalink
report
reply
40 points

Unfortunately for them there’s a lot of jobs dedicated to cleaning data so I’m not sure if this would even be effective. Plus there’s an overwhelming amount of data that isn’t “poisoned” so it would just get drowned out if never caught

permalink
report
reply
29 points

Imagine if writers did the same things by writing gibberish.

At some point, it becomes pretty easy to devalue that content and create other systems to filter it.

permalink
report
reply
9 points

if writers did the same things by writing gibberish.

Aka, “X”

permalink
report
parent
reply
2 points

I mean isn’t that eventually going to happen? Isn’t ai going to eventually learn and get trained from ai datasets and small issues will start to propagate exponentially?

I just assume we have a clean dataset preai and messy gross dataset post ai… If it keeps learning from the latter dataset it will just get worse and worse, no?

permalink
report
parent
reply
3 points

Not really. It’s like with humans. Without the occasional reality checks it gets weird, but what people chose to upload is a reality check.

The pre-AI web was far from pristine, no matter how you define that. AI may improve matters by increasing the average quality.

permalink
report
parent
reply
2 points
*
Deleted by creator
permalink
report
parent
reply
28 points

nightshade and glaze never worked. its scam lol

permalink
report
reply
12 points

Shhhhh.

Let them keep doing the modern equivalent of “I do not consent for my MySpace profile to be used for anything” disclaimers.

It keeps them busy on meaningless crap that isn’t actually doing anything but makes them feel better.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 18K

    Monthly active users

  • 12K

    Posts

  • 527K

    Comments