42 points
*

I feel like the amount of training data required for these AIs serves as a pretty compelling argument as to why AI is clearly nowhere near human intelligence. It shouldn’t take thousands of human lifetimes of data to train an AI if it’s truly near human-level intelligence. In fact, I think it’s an argument for them not being intelligent whatsoever. With that much training data, everything that could be asked of them should be in the training data. And yet they still fail at any task not in their data.

Put simply; a human needs less than 1 lifetime of training data to be more intelligent than AI. If it hasn’t already solved it, I don’t think throwing more training data/compute at the problem will solve this.

permalink
report
reply
27 points

There is no “intelligence”, ai is a pr word. Just a language model that feeds on a lot of data.

permalink
report
parent
reply
7 points

Oh yeah we’re 100% agreed on that. I’m thinking of the AI evangelicals who will argue tooth and nail that LLMs have “emergent properties” of intelligence, and that it’s simply an issue of training data/compute power before we’ll get some digital god being. Unfortunately these people exist, and they’re depressingly common. They’ve definitely reduced in numbers since AI hype has died down though.

permalink
report
parent
reply
12 points

Humans have the advantage of billions of years of evolution.

permalink
report
parent
reply
-1 points

“ai” also has the advantage of billions of years of evolution.

permalink
report
parent
reply
4 points

We’re very proficient at walking, but somehow haven’t produced a walking home or anything like that.

It’s not very linear.

permalink
report
parent
reply
3 points

Definitely not the same thing. Just because you can make use of the end result of major efforts does not somehow magically give you access to all the knowledge from those major efforts.

You can use a smart phone easily, but that doesn’t mean you magically know how to make one.

permalink
report
parent
reply
5 points

You’ve had the entire history of evolution to get the instinct you have today.

Nature Vs Nurture is a huge ongoing debate.

Just because it takes longer to train doesn’t mean it’s not intelligent, kids develop slower than chimps.

Also intelligent doesn’t really mean anything, I personally think Intelligence is the ability to distillate unusable amounts of raw data and intuit a result beneficial to one’s self. But very few people agree with me.

permalink
report
parent
reply
0 points

I see intelligence as filling areas of concept space within an econiche in a way that proves functional for actions within that space. I think we are discovering more that “nature” has little commitment, and is just optimizing preparedness for expected levels of entropy within the functional eco-niche.

Most people haven’t even started paying attention to distributed systems building shared enactive models, but they are already capable of things that should be considered groundbreaking considering the time and finances of development.

That being said, localized narrow generative models are just building large individual models of predictive process that doesn’t by default actively update information.

People who attack AI for just being prediction machines really need to look into predictive processing, or learn how much we organics just guess and confabulate ontop of vestigial social priors.

But no, corpos are using it so computer bad human good, even though the main issue here is the humans that have unlimited power and are encouraged into bad actions due to flawed social posturing systems and the confabulating of wealth with competency.

permalink
report
parent
reply
4 points

A human lifetime worth of video is not anywhere close to equalling a human lifetime of actual corporeal existence, even in the perfect scenario where the AI is as capable as a human brain.

permalink
report
parent
reply
3 points

Strange to equate the other senses to performance in intellectual tasks but sure. Do you think feeding data from smells, touch, taste, etc. into an AI along with the video will suddenly make it intelligent? No, it will just make it more likely to guess what something smells like. I think it’s very clear that our current approach to AI is missing something much more fundamental to thought than that, it’s not just a dataset problem.

permalink
report
parent
reply
35 points

Humans don’t live that long. That’s only about 1.5 million 30 min videos, which isn’t a huge amount for a whole day’s worth of scraping.

permalink
report
reply
13 points

Yeah this is honestly an order of magnitude less that I would’ve thought

permalink
report
parent
reply
5 points

Maybe they’re running out

permalink
report
parent
reply
2 points

I would be lucky if I get to watch more than 10000 videos in my entire lifetime.

permalink
report
parent
reply
4 points

Bro you’re doing it with your eyes, right now!

permalink
report
parent
reply
2 points

That’s only about 1.5 million 30 min videos

aka 2 videos from Quinton Reviews

permalink
report
parent
reply
34 points

Properly following licensing, right?

permalink
report
reply
26 points

No, see, because it’s “learning like a human”, and everybody knows that you’re allowed to bypass any licensing for learning. /s

But seriously I don’t know how they make the jump to these conclusions either.

permalink
report
parent
reply
3 points
*

This is a massive strawman argument. No one is saying you shouldn’t have a license to view the content in order to train an AI on it. Most of the information used to train these models is publicly available and licensed for public viewing.

permalink
report
parent
reply
17 points

Just because something is available for public viewing does not mean it’s licensed for anything except personal use.

The strawman here is that since physical people benefit from personal use exceptions in the law, machine learning software should too. But why should they? Since when is a piece of software ran by a corporation equivalent to an individual person?

permalink
report
parent
reply
2 points

Information wants to be free.

permalink
report
parent
reply
1 point

I mean, i agree, but artists want to eat too.

permalink
report
parent
reply
27 points

instead of focusing on their products and improving them for everyone, some shitty ceo is pushing their shitty ai agenda down everyones throat.

permalink
report
reply
12 points

Well it sounds like they’re doing something to make their products better, you just disagree that it’s going to be successful.

permalink
report
parent
reply
-10 points

Nvidia’s biggest product is absolutely AI by a massive landslide, I’m pretty sure I read that the point of them downloading these videos and doing the training is to build a pipeline for their AI users to do the same with their own shit. (Can’t be bothered to double-check cuz I really don’t care)

So they aren’t downloading all this video to make a crazy AI model. They’re downloading all this video to make a tool for their AI customers to use, you may not agree but improving their product is exactly what they’re doing.

permalink
report
parent
reply
8 points

Can’t be bothered to double-check cuz I really don’t care

For FUCK SAKE, why do you even bother posting your garbage opinions then? and with such authority too!

permalink
report
parent
reply
0 points
*

¯\_(ツ)_/¯ great question

permalink
report
parent
reply
21 points
*

So they use VMs to simulate user accounts, in future this will be blocked and whatever new AI startup is there won’t have the option to do so. Competition blocked. Forever.

permalink
report
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 18K

    Monthly active users

  • 12K

    Posts

  • 553K

    Comments