On: Google pulls AI model after senator says it fabricated assault allegation

[jqpabc123]

AI is going to be a lawyer's wet dream.

Imagine the ads on TV: "Has AI lied about you? Your case could be worth millions. Call now!"

[filoleg → jqpabc123]

And also (an incompetent and lazy) lawyer’s worst nightmare.

At least once a week, there is another US court case where the judge absolutely rips apart an attorney for AI-generated briefs and statements featuring made-up citations and nonexistent cases. I am not even following the topic closely, and yet I just encounter at least once a week.

Here are a couple most recent ones I spotted: Mezu v. Mezu (oct 29)[0], USA v. Glennie Antonio McGee (oct 10)[1].

0. https://acrobat.adobe.com/id/urn:aaid:sc:US:a948060e-23ed-41...

1. https://storage.courtlistener.com/recap/gov.uscourts.alsd.74...

[lesuorac → filoleg]

Meh, the lawyer got a scarlet letter. Wake me up when somebody gets disbarred.

[rchaud → jqpabc123]

Unlike medicine, AI isn't regulated, so lawyers won't have anything to go after.

[advisedwang → rchaud]

I think the parent post imagines defamation cases will be worthwhile. I'm sure there will be some, but an AI simply lying in a query doesn't = damages worth suing over.

[jqpabc123 → advisedwang]

It depends on who is the lie was about and what was said.

Simple example: A prospective employer refuses to hire you because of some blatant falsehood generated by an LLM.

[Handy-Man → jqpabc123]

I mean even lawyers are getting sanctioned for using them without verifying their outputs lol.

- https://www.msba.org/site/site/content/News-and-Publications...

- https://www.reuters.com/legal/government/judge-disqualifies-...

- https://calmatters.org/economy/technology/2025/09/chatgpt-la...

[ghjv → jqpabc123]

strange to talk about it in the future tense. it's here and yep, it's an object of fascination for the legal system