No, I’m saying this already actually happened. Some lawyer or paralegal used ChatGPT for a court case, and it referenced non-existent cases.
They got off surprisingly easy for doing so, too: https://www.reuters.com/legal/new-york-lawyers-sanctioned-using-fake-chatgpt-cases-legal-brief-2023-06-22/. The $5k they were fined amounts to roughly 14 billable hours if they’re at the NY average of $357 an hour https://www.attorneyatwork.com/solo-and-small-firm-lawyer-hourly-rates/#h-the-top-10-states-for-lawyer-hourly-rates.