On: Legal models hallucinate in 1 out of 6 (or more) benchmarking queries

[elicksaur]

Let someone stake their license on LLMs giving legal advice.

We’ve seen this happen, and it seems to typically result in sanctions. Until that’s not the typical outcome, LLM performance is all just talk.