To be clear, I’m not talking about underlying mechanisms, either, but the approach to the task. A human writer, even one bad at writing and not understanding the topic, will approach the writing with a goal and write to that goal and topic. They can even research if they so choose, but even if they are just making things up, there is intent and context there.

You never made an experience of having to writer for a topic you genuinely don’t care about, where you just string along words, vaguely related to the topic to make specific word count? I’m not arguing that all human writing is like this - people are definitely capable of writing text with purpose and context, at least some. But that is not all human writing.

It literally just generates words that match certain patterns, with no actual purpose or goal.

And exactly that was my point, that humans often do the same. Not all the time. But it definitely happens, especially in professional writing where you maybe have to write about a topic you don’t understand or care about.

It can’t reason, it can’t research,

And again, there are tons of people out there that can’t do this things either. It’s like a very intelligent chimpanzee is smarter than a very dumb human. So are LLMs better at generating text than quite a lot of humans.