You are viewing a single thread.
View all comments 5 points
I think I kind of understand the term, but what does “hallucinations” in this context refer to? It seems like it might be fabricated unformation?
6 points
4 points
Not sure why someone downvoted you. That’s exactly what the term means in this context. It’s those confidently written answers that contain false or fabricated information.
0 points
And this seems like the biggest limitation for the LLM approach. The model just knows that a certain set of tokens tends to follow another set of tokens.
It has no understanding of what the tokens represent. So it does a great job of producing sentences that look meaningful, but any actual meaning in them is purely incidental.