On: Irrelevant facts about cats added to math problems increase LLM errors by 300%

[lupusreal]

What you propose isn't a meaningful benchmark because these models already excell at spinning bullshit, they'd ace the benchmark every time.