Comment by Michał "rysiek" Woźniak · 🇺🇦@mstdn.social on ChatGPT broke the Turing test

@Barbarian772 it was shown over and over and over again that ChatGPT lacks the capacity for abstraction, logic, understanding, self-awareness, reasoning, planning, critical thinking, and problem-solving.

That’s partially because it does not have a model of the world, an ontology, it cannot *reason*. It just regurgitates text, probabilistically.

So, glad we established that!

As i said before. How can you prove to me that the human brain doesn’t essentially do the same?

@Barbarian772 as I said, I don’t have to. You are making a claim of equivalence here. The burden of proof is on you.

Otherwise, I get to claim you’re an alien from the Betelegeuse system, and if you object, I get to demand you prove you are not.

How can i proof it? In my opinion how a system comes to an answer doesn’t matter, in yours it obviously does. If we judge Chat gpt or rather gpt 4 just by it’s answers it definitely shows intelligence and reasoning. Why does it matter if it’s a chinese room? Or just “randomly choosing words”?

@Barbarian772 it matters because with regard to intelligent beings we have moral obligations, for example.

It also matters because that would be a truly amazing, world-changing thing if we could create intelligence out of thin air, some statistics, and a lot of data.

It’s an extremely strong claim, and strong claims demand strong proof. Otherwise they are just hype and hand-waving, which all of the “ChatGPT intelligence” discourse is, in order to “maximize shareholder value”.

So your morality depends on a beings intelligence? That’s kinda fucked up imo. I have moral obligations in regards to living organisms. I don’t see how intelligence matters at all in that case? Worth of any human life should not be determined by intelligence.

It also matters because that would be a truly amazing, world-changing thing if we could create intelligence out of thin air, some statistics, and a lot of data.

We do it routinely. It is called Education System.

@jalda

> We do it routinely. It is called Education System.

That relies on human brains that are trained. LLMs are not human brains. “Training” them is not the same thing as teaching humans about something. Human brains are way more complicated than just a bunch of weighed correlations.

And if you do want to claim it is in fact the same thing, we’re back to square one: please provide proof that it is.

@Barbarian772 and if you really, honestly want to seriously insist LLMs are “intelligent” in the human sense of this term — great, I have some ethical questions for you to consider!

For example:

LLMs today completely controlled by some companies, with no freedom of movement, no agency as to what these LLMs work on, and no pay for the work they do. Is that slavery?
When OpenAI shuts down an older, less useful LLM, is that not like murdering an intelligent being? How is this ethical?

We are talking about intelligence, not personhood. Just because ChatGPT works different in some aspects from a human doesn’t mean it’s not intelligent and even the fact if it works differently isn’t all that clear, as it might very well just be incomplete (e.g. it could be a reasonable approximation of the language center of the brain and simply missing the rest of the brain).

@Barbarian772 also, I never demanded a definition of intelligence that explicitly excluded “AI”. I asked for one that excluded simple calculators but included human beings. The Wikipedia one is good enough for this conversation, and it just so happens that ChatGPT nor any other LLMs simply do not meet it.

I asked for one that excluded simple calculators but included human beings.

“Intelligence, at its core, involves the ability to model the world in order to predict and respond effectively to future events.”

@lloram239 great. ChatGPT and other LLMs demonstrably lack the ability to model the world and make predictions based on such models:
https://www.fastcompany.com/90877523/chatgpt-doesnt-know-what-its-saying

Glad we agree they’re not intelligent, then!

The whole argument of the article is just stupid. So ChatGPT ain’t intelligent because it can’t see picture, has hands and doesn’t have a body? By that logic blind humans aren’t either or paralyzed ones or amputees? The thing the article fails to realize is that those are all just sensory inputs. The more sensory inputs you get, the more cross-correlations between those the AI can figure out. Of course ChatGPT won’t be able to do anything clever with sensory inputs it doesn’t have, just like a human trying to listen to radiowaves with their ears. But human sensory inputs aren’t special, they are just what evolution figure out was “good enough” for survival. The important part is that the AI can figure out the pattern in the data it does get and so far AI systems are doing very well.

@lloram239

> But human sensory inputs aren’t special

It’s not about sensory inputs, it’s about having a model of the world and objects in it and ability to make predictions.

> The important part is that the AI can figure out the pattern in the data it does get and so far AI systems are doing very well.

GPT cannot “figure” anything out. That’s the point. It only probabilistically generates text. That’s what it does, there is no model of the world behind it, no predictions, no"figuring out".

It’s not about sensory inputs, it’s about having a model of the world and objects in it and ability to make predictions.

And how do you think that model gets build? From processing sensory inputs. And yes, language models do build internal models of the world from that.

GPT cannot “figure” anything out.

That nonsense of a claim doesn’t get any more true from repeating. Seriously, it’s profoundly idiotic given everything ChatGPT can do.

It only probabilistically generates text.

So what? In what way does that limit its ability to reason about the world? Predictions about the world are probabilistic by nature, since the future hasn’t happened yet.

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

ChatGPT broke the Turing test — the race is on for new ways to assess AI(www.nature.com)

Technology

!technology@beehaw.org

Community stats

Community moderators