Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I really doubt they're doing it in some kind of "AI has feelings" sense as the article seems to imply.

I'd instead imagine that if you throw abusive language at it for long enough, the model will start to reply back in that same manner. Anthropic would face backlash from out of context screenshots of "look what Claude is saying to me" and this somewhat reduces that risk.

 help



I rather imagine they discovered abusing the model can lead to jailbreaking/prompt injection



Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: