What if something like ChatGPT is trained on a dataset of your life and uses that to make the same decisions as you? It doesn’t have a mind, memories, emotions, or even a phenomenal experience of the world. It’s just a large language data set based on your life with algorithms to sort out decisions, it’s not even a person.
Is that you?
No, because not all my decisions are language-based. As gotchas go, this one’s particularly lazy.
I’m having a hard time imagining a decision that can’t be language based.
You come to a fork in the road and choose to go right. Obviously there was no language involved in that decision, but the decision can certainly be expressed with language and so a large language model can make a decision.
But I don’t make all my decisions linguistically. A model that did would never act as I do.