> Even things that should be no-brainers like "should we preserve our habitat or burn it down for profit", or questions like "is it a good idea to have loads of deadly assault weapons just float around in our society", seem to be too hard for our species to resolve.
These are brain intensive questions because they require deep moral, political, economic and ecological context. It's very difficult to express such deep context to an AI agent with prompting, fine tuning or training. I suspect this deep context also makes it difficult to align humans on these issues with education, media or hacker news comments.
They really are not. Even rodents with brains the size of a peanut manage to not willfully destroy the environment they are living in, despite already having all the resources they need, out of sheer greed.
These are brain intensive questions because they require deep moral, political, economic and ecological context. It's very difficult to express such deep context to an AI agent with prompting, fine tuning or training. I suspect this deep context also makes it difficult to align humans on these issues with education, media or hacker news comments.