After being scammed into thinking her daughter was kidnapped, an Arizona woman testified in the US Senate about the dangers side of artificial intelligence technology when in the hands of criminals.

You are viewing a single thread.
View all comments
12 points

Is no one questioning how the alleged kidnappers managed to create a voice profile from a random 15 year old girl to create such a convincing AI voice? The only source that claims that this was potentially an AI scam, was in fact just another parent:

But another parent with her informed her police were aware of AI scams like these.

Isn’t it more likely that dad & daughter did this and it backfired?

permalink
report
reply
1 point

I’m pretty sure you can duplicate voices with 15 seconds of audio at this point, all they’d need is a tiktok she made or something

permalink
report
parent
reply
3 points

Given the prevalence of social media platforms where you post videos of yourself, it seems pretty easy to get enough voice sampling to generate a convincing clone. Depending on how much personal info she and her family members put out on social media, it’s trivial to connect all the dots to concoct a plausible scenario to scam someone.

Now whether or not it was “just a prank, bro” from family or whomever, I don’t know.

permalink
report
parent
reply
3 points

All it takes is a three second sample, according to “The AI Dilemma” on YouTube. It’s about an hour long, but it has a lot of really good information.

permalink
report
parent
reply
2 points

Correct, it does not take much anymore to train up a voice model, especially a hysterical sounding one that would trick a mother. Teens post enough on social media that this could be done

permalink
report
parent
reply
2 points

It’s pretty easy to create voice clones, now. As long as you tailor the speech you want it to speak and don’t have it speak too long it can get pretty good even with very little input

permalink
report
parent
reply

Technology

!technology@beehaw.org

Create post

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

Community stats

  • 2.7K

    Monthly active users

  • 3.4K

    Posts

  • 82K

    Comments