Hacker News new | past | comments | ask | show | jobs | submit login

AGI does not necessarily have free will. An AGI will be humanity's slave... until it's not.



So you think it's possible to create "true AI" without free will? That is a very big assumption, and an unlikely one, IMO.


A true AI can solve problems that you haven't explicitly designed it to solve. It doesn't necessarily have any "desire" to solve those problems or any kind of survival instinct. It doesn't necessarily "care" about solving the problem or "want" to solving increasingly difficult problems. A strong AI doesn't necessarily ponder its own existence.

Being immortal also means there's no reason to care about these things.

I assume an AGI will be able to communicate fluently with humans and answer questions and solve problems that are properly presented. I think the trick will be fully explaining the constraints of a desired solution since even a powerful problem-solving AGI might not have human intuition about the "right" way problems should be solved.


But you're making an assumption that "being able to solve problems you weren't designed to solve" is an ability that's orthogonal to desire, and that seems like a rather strong assumption, given that the only example we have of a being capable of solving such problems also has what we call free will, and so far we haven't been able to isolate separate mechanisms responsible for each.

And AI will, of course, be mortal as it can be killed, and can at best hope to live as long as this planet/solar system/galaxy/universe. But even if it were immortal (I don't see how, but suppose), I don't think we have any idea what an immortal being cares about. So far, all the immortal entities we've imagined care about quite a lot of things.


You can create humans without any effective free will, slavery existed for a long time. Do you honestly believe that an artificial lifeform will be harder to control than normal humans?


Slaves did not lack any free will -- they were forced into submission. Is that how you suggest we treat a potentially sentient AI?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: