Uh there’s zero chance these big techs are selling voices like this. Also, this sounds very targeted and planned, so there must be more context to this. Also, why the hell are they on bluesky?
They’re on BlueSky because there are more people there that would actually believe this total load of bullshit. Plenty of scams that will claim to be vague family member (no names; just like “son” or “daughter,” “aunt” or “uncle”) but highly unlikely they’re getting an AI to mimic your voice. Just like vagueness of the family member they claim to be, the voices used may coincidentally sound similar.
All of these articles are making it up then? https://www.nytimes.com/2023/08/30/business/voice-deepfakes-bank-scams.html https://www.cnn.com/2023/04/29/us/ai-scam-calls-kidnapping-cec/index.html https://abcnews.go.com/Technology/experts-warn-rise-scammers-ai-mimic-voices-loved/story?id=100769857 https://finance.yahoo.com/news/ai-supercharges-voice-scams-making-it-easier-for-americans-to-fall-prey-143635279.html https://www.cbsnews.com/news/scammers-ai-mimic-voices-loved-ones-in-distress/
Oh they totally are. Maybe not this directly, but there is an awful depth to the data market. One company may be selling to the next and the next and you end up with companies just buying all the data they can to sell police surveillance software running off of fucking Candy Crush telemetry.
Bluesky is more usable than Mastodon purely because it doesn’t use a decentralized model. Sure it defeats the purpose, but on the plus side it removes some serious inconveniences that the true fediverse comes with, for example i’ve never been on Bluesky and found myself unable to upvote someone because i’ve accidentally left my instance.
Not sure I buy this tbh.
Yeah, unless this person runs a YouTube or podcast it seems implausible. What would you train a random AI on for the normal person?
I could see a situation where you hack a phone, get the contacts and call history, pick the 1st or 2nd most dialed number, have a bot call that person to get samples, then go back to the original phone and try this… I mean, eventually you’d get a hit?
Yeah, it has some sus vibes. I’m usually far too trusting, but here even my bullshit detectors rang
I don’t know, the “Spanish prisoner” is a scam that seems to be reinvented every few years every time we see a little bit of a change in technology. It wouldn’t take much to fake a person’s voice with a trained model, especially if that person has an online profile open to the public where they post content in their own voice.
The plot of the movie is very similar to the basic setup of a 419 scam, which was given the nickname “the Spanish prisoner”
I’m going to go ahead and check that out tonight. Looks like it has a great cast.
The only way to train an AI voice model is to have lots of samples. As scummy as they are, neither Microsoft nor Apple is selling your voice recordings with enough info to link them to you specifically. This person probably just forgot about an old social post where they talk for enough time for a model to be trained. Still super scary stuff.
True for creating voices at all, but that work has already been done.
Now we’re just taking these large AI’s trained to mimic voices and giving them a 30 second audio clip to tell them what to mimic. It can be done quickly and give convincing results especially when hidden by the phonecall quality.
I advise everyone to contact their loved ones and inform them of this possibility. I also advise having some codeword that would be used if there was an emergency and money needs to be sent.
For example is more than $100 is being asked for we have to share the code word or we should not transfer money.
Hey is me, your cousin. I’m kinda in a jam and need your help. The contractor cut me a huge check after the fire that took everything but the bank won’t cash it without proof. I just need $101 for proof and I can pay back immediately.
This is for real.
Thanks.
Donkeyballs
Hey its me your 2nd uncle
I need about $3.50 to pay for shipping on a package from a nigerian price who needed my help
I know we said over 100 for this but
Donkeyballs
Are we sure it’s AI?
I’ve heard of this scam happening maybe a decade ago with my extended family. The voice was a real person overseas with a lot of exp tricking grandparents. Scammers only had basic information.
They act as a freaked out kid and the victim gets roped in. They scam for thousands of dollars each time, even succeeding a few times a day would net a big profit. Also cell connections are low fidelity, I bet that aids their ability to trick the victim.
Yeah this happened to my grandparents, they just say “I sound like shit because I’ve been crying”
