> But we've apparently solved alignment, so maybe it's OK.
Yeah and it is such an absurd point. You take a brief look at world right now and the history and you find ... constant fight over what exactly "the values" should be. There is no single human aligned answer to "what we should do". There is no way to align AI simultaneously with liberals, transhumanists, right wing, tech CEOs and all the world religions.
And there, I am even ignoring situations where interests of one group go against another group.
> There is no way to align AI simultaneously with liberals, transhumanists, right wing, tech CEOs and all the world religions.
Well, the real problem isn't about "humans aligning LLMs" it's about "LLMs aligning humans" according the values and desires of the LLM's masters - that kind of alignment is entirely possible, proven by history on the human side and by current LLMs on the technology side.
Yeah and it is such an absurd point. You take a brief look at world right now and the history and you find ... constant fight over what exactly "the values" should be. There is no single human aligned answer to "what we should do". There is no way to align AI simultaneously with liberals, transhumanists, right wing, tech CEOs and all the world religions.
And there, I am even ignoring situations where interests of one group go against another group.