it constructs a concept in a more abstract way then progressively finds a way to put it into words; I know that arguably that’s what it’s doing currently,
Correct!
but the fact that it does it separately for each token means it’s not constructing any kind of abstraction
No!!! You simply cannot make judgements like this based on vague ideas like “autocomplete on steroids” or “stochastic parrot”, these were good for conceptualizing GPT-2, maybe. It’s actually very inefficient, but, by re-reading what it has previously written (plus one token) it’s actually acting sort of like an RNN. In fact we know theoretically that with simlified attention models the two architectures are mathematically equivalent.
Let me put it like this. Suppose you had the ability to summon a great novelist as they were at some particular point in their life, pull them from one exact moment in the past, and to do this as many times as you liked. You put a gun to their head, or perhaps offer them alcohol and cocaine, to start writing a novel. The moment they finish the first word, you shoot them in the head and summon the same version again. “Look I’ve got a great first word for a novel, and if you can turn it into a good paragraph I’ll give you this bottle of gin and a gram of cocaine!”. They think for a moment and begin to put down more words, but again you shoot them after word two. Rinse/repeat until a novel is formed. It takes a good while but eventually you’ve got yourself a first draft. You may also have them refine the novel using the same technique, also you may want to give them some of the drugs and alcohol before hand to improve their writing and allow them to put aside the fact that they’ve been summoned to the future by a sorcerer. Now I ask you, is there any theoretical reason why this novel wouldn’t be any good? Is the essence of it somehow different than any other novel, can we judge it as not being real art or creativity?
Now I ask you, is there any theoretical reason why this novel wouldn’t be any good? Is the essence of it somehow different than any other novel, can we judge it as not being real art or creativity?
Yes, it is not. You whipped up that fantastical paragraph with 99.99% fewer coal plants and a lifetime’s worth of creativity. that life was experienced not through meticulously analyzing each thought mathematically but with your body and mind together. More importantly, you’re typing that out because you believe in something which is a theoretical concept that the computer is incapable of analyzing.
be as debatey as you want. What I’m saying is not an entirely different argument. What I said is responding to your entire assertion. I’m not giving you credit for the thought experiment because it helps your argument, I’m trying to give you credit for it because it’s creative and beautiful.
