An Asian MIT student asked AI to turn an image of her into a professional headshot. It made her white with lighter skin and blue eyes.::Rona Wang, a 24-year-old MIT student, was experimenting with the AI image creator Playground AI to create a professional LinkedIn photo.

You are viewing a single thread.
View all comments
197 points

Look, I hate racism and inherent bias toward white people but this is just ignorance of the tech. Willfully or otherwise it’s still misleading clickbait. Upload a picture of an anonymous white chick and ask the same thing. It’s going go to make a similar image of another white chick. To get it to reliably recreate your facial features it needs to be trained on your face. It works for celebrities for this reason not a random “Asian MIT student” This kind of shit sets us back and makes us look reactionary.

permalink
report
reply
150 points
*

It’s less a reflection on the tech, and more a reflection on the culture that generated the content that trained the tech.

Wang told The Globe that she was worried about the consequences in a more serious situation, like if a company used AI to select the most “professional” candidate for the job and it picked white-looking people.

This is a real potential issue, not just “clickbait”.

permalink
report
parent
reply
34 points

If companies go pick the most professional applicant by their photo that is a reason for concern, but it has little to do with the image training data of AI.

permalink
report
parent
reply
5 points

Especially ones that are still heavily in development

permalink
report
parent
reply
1 point
Removed by mod
permalink
report
parent
reply
28 points

A company using a photo to choose a candidate is really concerning regardless if they use AI to do it.

permalink
report
parent
reply
20 points
*

Some people (especially in business) seem to think that adding AI to a workflow will make obviously bad ideas somehow magically work. Dispelling that notion is why articles like this are important.

(Actually, I suspect they know they’re still bad ideas, but delegating the decisions to an AI lets the humans involved avoid personal blame.)

permalink
report
parent
reply
3 points

Hiring practices are broken from its very basics. The vast majority of businesses consistently discriminate against people who deviate from the norm in presentation, even if the candidate meets the technical requirements or would otherwise be productive, which results in millions of people who are capable of contributing to society being pushed aside.

permalink
report
parent
reply
8 points
*

Again, that’s not really the case.

I have Asian friends that have used these tools and generated headshots that were fine. Just because this one Asian used a model that wasn’t trained for her demographic doesn’t make it a reflection of anything other than the fact that she doesn’t understand how MML models work.

The worst thing that happened when my friends used it were results with too many fingers or multiple sets of teeth 🤣

permalink
report
parent
reply
2 points

No company would use ML to classify who’s the most professional looking candidate.

  1. Anyone with any ML experience at all knows how ridiculous this concept is. Who’s going to go out there and create a dataset matching “proffesional looking scores” to headshots?
  2. The amount of bad press and ridicule this would attract isn’t worth it to any company.
permalink
report
parent
reply
7 points

Companies already use resume scanners that have been found to bias against black sounding names. They’re designed to feedback loop successful candidates, and guess what shit the ML learned real quick?

permalink
report
parent
reply
36 points
Removed by mod
permalink
report
parent
reply
-14 points
Removed by mod
permalink
report
parent
reply
24 points
*
Removed by mod
permalink
report
parent
reply
10 points
*
Removed by mod
permalink
report
parent
reply
2 points
Removed by mod
permalink
report
parent
reply
1 point
Removed by mod
permalink
report
parent
reply
20 points

It still perfectly and visibly demonstrates the big point of criticism in AI: The tendencies the the training material inhibits.

permalink
report
parent
reply
10 points

The AI might associate lighter skin with white person facial structure. That kind of correlation would need to be specifically accounted for I’d think, because even with some examples of lighter skinned Asians, the majority of photos of people with light skin will have white person facial structure.

Plus it’s becoming more and more apparent that AIs just aren’t that good at what they do in general at this point. Yes, they can produce some pretty interesting things, but they seem to be the exception rather than the norm, and in hindsight, a lot of my being impressed with results I’ve seen so far is that it’s some kind of algorithm that is producing that in the first place when the algorithm itself isn’t directly related to the output but is a few steps back from that.

I bet for the instances where it does produce good results, it’s still actually doing something simpler than what it looks like it’s doing.

permalink
report
parent
reply
8 points

This is like a demonstration of lack of self awareness

permalink
report
parent
reply
3 points

Yup

permalink
report
parent
reply
2 points

Almost like we’re looking for things to get mad about.

Also what are these 50 people downvoting you for? Too much nuance I suppose.

permalink
report
parent
reply
-8 points

You said yourself you hate inherent bias yet attempt to justify the result by saying if used again it’s just going to produce another white face.

that’s the problem

It’s a racial bias baked into these AIs based on their training models.

permalink
report
parent
reply
20 points

I doubt it is concious racial bias, it’s most likely that the training data is made up of mostly white people and labeled poorly.

permalink
report
parent
reply
4 points

I also wouldn’t say it was conscious bias either. I don’t think it’s intentionally developed in that way.

The fact still remains though whether conscious or unconscious, it’s potentially harmful to people of other races. Sure it’s an issue with just graphic generation now. What about when it’s used to identify criminals? When it’s used to filter between potential job candidates?

The possibilities are virtually endless, but if we don’t start pointing out and addressing any type of bias, it’s only going to get worse.

permalink
report
parent
reply
14 points

They aren’t justifying anything, they literally said it was about the training data.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 17K

    Monthly active users

  • 12K

    Posts

  • 554K

    Comments