109 points
*
Deleted by creator
permalink
report
reply
26 points

A traditional outfit

How traditional? How statistically relevant is it? Most Indians i know do not wear turbans at all.

If these stats are trustworthy (and i think they are), the only Indians that wear turbans are Sikhs (1.7%) and Muslims (14.2%). I’d say 15.9% is not statistically significant.

permalink
report
parent
reply
56 points
*

I think you’re looking at it wrong. The prompt is to make an image of someone who is recognizable as Indian. The turban is indicative clothing of that heritage and therefore will cause the subject to be more recognizable as Indian to someone else. The current rate at which Indian people wear turbans isn’t necessarily the correct statistic to look at.

What do you picture when you think, a guy from Texas? Are they wearing a hat? What kind? What percentage of Texans actually wear that specific hat that you might be thinking of?

permalink
report
parent
reply
-13 points

A surprising number of Texans wear cowboy and trucker hats (both stereotypical). A surprising number of Indians don’t wear turbans since it’s by far a minority.

permalink
report
parent
reply
31 points

I think the idea is that it’s what makes a person “an Indian” and not something else.

Only a minority of Indians wear turbans, but more Indians than other people wear turbans. So if someone’s wearing a turban, then that person is probably Indian.

I’m not saying that’s true necessarily (though it may be), but that’s how the AI interprets it…or how pictures get tagged.

It’s like with Canadians and maple leaves. Most Canadians aren’t wearing maple leaf stuff, but I wouldn’t be surprised if an AI added maple leaves to an image of “a Canadian”.

permalink
report
parent
reply
1 point
Deleted by creator
permalink
report
parent
reply
22 points

Imagine a German man from Bavaria… You just thought of a man wearing Lederhosen and holding a beer, didn’t you? Would you be surprised if I told you that they usually don’t look like that outside of a festival?

permalink
report
parent
reply
-2 points

I don’t picture real life people as though they were caricatures.

permalink
report
parent
reply
7 points
*
Deleted by creator
permalink
report
parent
reply
3 points

A traditional dress is not a religious dress,

Point taken.

On a footnote: why should the concept of a traditional dress be offensive?

Ain’t to me, couldn’t care less. I was just trying to point out that most Indians do not seem to wear turbans (and based my reasoning on the religions dress alone).

permalink
report
parent
reply
3 points

What’s the data that the model is being fed? What percentage of imaging featuring Indian men are tagged as such? What percentage of imaging featuring men wearing Turbans are tagged as Indian Men? Are there any images featuring Pakistan men wearing Turbans? Even if only a minority of Indian feature Turbans, if that’s the only distinction between Indian and Pakistan men in the model data, the model will favor Turbans for Indian Men. That’s just a hypothetical explanation.

permalink
report
parent
reply
3 points

You don’t think nearly 1/6th is statistically significant? What’s the lower bound on significance as you see things?

To be clear, it’s obviously dumb for their generative system to be overrepresenting turbans like this, although it’s likely to be a bias in the inputs rather than something the system came up with itself, I just think that 5% is generally enough to be considered significant and calling three times that not significant confuses me.

permalink
report
parent
reply
9 points

5/6 not wearing them seems more statistically significant

permalink
report
parent
reply
9 points

You don’t think nearly 1/6th is statistically significant?

For statistics’ sake? Yes.

For the LLM bias? No.

permalink
report
parent
reply
2 points

Except if they trained it on something that has a large proportion of turban wearers. It is only as good as the data fed to it, so if there was a bias, it’ll show the bias. Yet another reason this really isn’t “AI”

permalink
report
parent
reply
3 points

By that logic americans should always be depicted in cowboy hats.

permalink
report
parent
reply
4 points

Put in western or Texas and that’s what you get, the west is a huge area even just of America but the word is linked to a lot of movie tropes and stuff so that’s what you get.

This is also only when the language is English, ask in urdu or Bengali and you get totally different results, in fact just use urdu instead of Indian and get less turbans or put in Punjabi and you’ll get more turbuns.

Or just put turban in the negatives if you want

permalink
report
parent
reply
4 points

I see you’ve watched anime featuring Americans.

permalink
report
parent
reply
3 points

Ask an AI for pictures of Texans and see how many cowboy hats it gives back to you.

permalink
report
parent
reply
0 points
*
Deleted by creator
permalink
report
parent
reply
1 point

It’s a traditional outfit of sikhs, not indians. Pick up a book

permalink
report
parent
reply
2 points
*
Deleted by creator
permalink
report
parent
reply
1 point

Pre-independence, most Indian males had some sort of headgear. E.g. look at any old photos of Bombay

permalink
report
parent
reply
0 points

Are we still in “pre independence”?

permalink
report
parent
reply
-1 points

You’re wrong.

permalink
report
parent
reply
75 points

Why would you ask a bot to generate a stereotypical image and then be surprised it generates a stereotypical image. If you give it a simplistic prompt it will come up with a simplistic response.

permalink
report
reply
-11 points

So the LLM answers what’s relevant according to stereotypes instead of what’s relevant… in reality?

permalink
report
parent
reply
21 points
*

It just means there’s a bias in the data that is probably being amplified during training.

It answers what’s relevant according to its training.

permalink
report
parent
reply
12 points

Please remember what the A in AI stands for.

permalink
report
parent
reply
36 points
*

Kinda makes sense though. I’d expect images where it’s actually labelled as “an Indian person” to actually over represent people wearing this kind of clothing. An image of an Indian person doing something mundane in more generic clothing is probably more often than not going to be labelled as “a person doing X” rather than “An Indian person doing X”. Not sure why these authors are so surprised by this

permalink
report
reply
2 points

Like most of my work’s processes… Shit goes in, shit comes out…

permalink
report
parent
reply
1 point

Yeah I bet if you searched desi it wouldn’t have this problem

permalink
report
parent
reply
33 points

Meanwhile on DALL-E…

permalink
report
reply
32 points

I’m just surprised there’s no windmill in either of them. Canals, bikes, tulips… Check check check.

permalink
report
parent
reply
19 points

Careful, the next generated image is gonna contain a windmill with clogs for blades

permalink
report
parent
reply
5 points

Well, they do run on air…

permalink
report
parent
reply
1 point

That looks just like the town Delft

permalink
report
parent
reply
32 points

That’s Sikh

permalink
report
reply
8 points

Indians can be Sikh, not all indians are Hindu

permalink
report
parent
reply
3 points

Yes but the gentlemen in the images are also sikhs

permalink
report
parent
reply
1 point

glances at the current policies of the Indian government

Well… for now, anyway.

permalink
report
parent
reply
8 points

Sikh pun

permalink
report
parent
reply
1 point

Not necessarily. Hindus and Muslims in India also wear them.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 18K

    Monthly active users

  • 12K

    Posts

  • 538K

    Comments