Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

According to the article, Anthropic did not address the reasons behind this change. Anyone want to start placing bets now? Which one is it?

- Anthropic really believe that their models have a capacity to experience pain in a similar way to biological beings

- They do not believe they can experience physical pain and suffering, but have started thinking of LLMs so highly that Anthropic don't want to 'disrespect' them, either out of reverence or fear of their future capabilities

- They picked up on the 'LLM torture' news stories that have sprouted lately and are cynically cashing in by implying an audacious claim that fits right into this news cycle

 help



Because the leadership (or a certain slice of leadership) within the company are religious zealots that believe they are building a god.

https://www.anthropic.com/research/end-subset-conversations

https://www.anthropic.com/research/exploring-model-welfare

> We remain highly uncertain about the potential moral status of Claude and other LLMs, now or in the future. However, we take the issue seriously, and alongside our research program we’re working to identify and implement low-cost interventions to mitigate risks to model welfare, in case such welfare is possible.

It is absolute lunacy masquerading as science.


I am curious about a question. Who is religious:

(1) Someone who believes in magical souls and supernatural magic inside human brains (2) Someone who notices humans are physical systems and conscious and another physical system that talks and thinks so much like humans might or might not be conscious?

Another question, who is more religious

(1) Someone who believes in an invisible inaccessible unproven unknown infinite omniscient all powerful entity

(2) Someone who thinks if there is an entity, a very real and tangible entity, more intelligent than us but still finite, it might be in some respects god like for us


I'm not the one you're replying to, but let me offer a similar comparison to you.

1. A group of people that evaluate things based on what people already know and what they can reliably observe. Their judgements about things like computer algorithms are based entirely on what we've already learned them from the past. They're not quick to jump on new bandwagons that make extreme, world-changing claims based on shaky foundations, if there are any foundations at all. They are not zealots set in stone with their opinions, but they can recognize that extraordinary claims require truly extraordinary evidence.

2. A group that creates a technology and that knows more about their technology than most other people in the world, who obviously recognize some similarities as well as a world of differences between what they're building and anything biological - yet so overcome with emotions and conflicted feelings for their technology that they start assigning it with traits they know they have never built into it, like a capacity for biological pain, the ability to be coerced like a being, or a visceral fear of death. The group feels so strongly about it that it starts treating the technology as humanlike by default, never caring for having any evidence, let alone extraordinary evidence.

Which group feels like it calmly follows established scientific progress, and which one behaves like it is worshiping a deity?


I am not seeing (3) people who believes souls are magical and God granted humans and only humans, souls.

In (2), I do not understand what you mean by not built into it, did the creators of the weather modeling equation build chaos into it? They found it after the fact that it is chaotic. Evolution also didn't set out to "build" consciousness but here we are. What is the principle by which this so called (1) is so sure there isn't any consciousness here?




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: