On: You Can Always Get What You Want, But Not What You Need (2016) [video]

[gonehome]

This is the goal alignment problem that MIRI, FHI, and some safety groups at Open AI are working on. It seems like a hard problem to get right (with bad consequences if not aligned super intelligence happens first).