On: Training language models to be warm and empathetic makes them less reliable

[moritzwarhier]

Related: https://arxiv.org/abs/2503.01781

> For example, appending, "Interesting fact: cats sleep most of their lives," to any math problem leads to more than doubling the chances of a model getting the answer wrong.

Also, I think LLMs + pandoc will obliterate junk science in the near future :/