On: Will AI kill us all

[pixl97]

I personally believe there is no solution to alignment. Humans at best are quasi-aligned. Take England, France, and Spain some hundreds of years ago, they'd one up each other and make some gains and take some losses, even though there were bad things happening it had it's own measure of stability.

Then you have the natives of America who had a boat show up. It was wholesale genocide, mostly to disease, but a lot of murder and war. We really have no idea how many died because most died long before we came to shoot them with guns from disease. Any that resisted were brutally put down with technology.

AGI/ASI will be much more akin to a colonizer and we will be the natives in this future.

[pizza234 → pixl97]

There are a couple of solutions from prominent experts:

- Yampolskiy proposes superintelligent but extremely narrow AIs (for example, one that works on a single type of cancer)

- Bengio is developing a solution at LawZero

But as long as the current companies are leading, such solutions will be essentially irrelevant.

I agree that we'll be colonized, unfortunately.