I just had a thought: (spoilers Expanse and Hyperion and Fire Upon the Deep)
Multiple sci-fi-fantasy tales have been written about technology getting so out of control, either through its own doing or by abuse by a malevolent controller, that society must secer itself from that technology very intentionally and permanently.
I think the idea of AGI and transhumanism is that moment for society. I think it's hard to put the genie back in the bottle because multiple adversarial powers are racing to be more powerful than the rest, but maybe the best thing for society would be if every tensor chip disintegrated the moment they came into existence.
I don't see how society is better when everyone can run their own gooner simulation and share it with videos made of their high school classmates. Or how we'll benefit from being unable to trust any photo or video we see without trusting who sends it to you, and even then doubting its veracity. Not being able to hear your spouse's voice on the phone without checking the post-quantum digital signature of their transmission for authenticity.
Society is heading to a less stable, less certain moment than any point in its history, and it is happening within our lifetime.
Sidenote there aren't really any spoilers to the Hyperion Cantos here, since you didn't really touch on any conflict resolution or specific plot points although (spoilers?) you got my mind wrapped around that insidious councilor Albedo and how 400 years can pass in the blink of an... A.EYE... lol
Red alert
Critical thinking activity detected in cubic 87864-B
Recommendation: administer more Dimbrane and decrease cubic oxygen content by 3% to further reduce neural firing calacity
Multiple sci-fi-fantasy tales have been written about technology getting so out of control, either through its own doing or by abuse by a malevolent controller, that society must secer itself from that technology very intentionally and permanently.
I think the idea of AGI and transhumanism is that moment for society. I think it's hard to put the genie back in the bottle because multiple adversarial powers are racing to be more powerful than the rest, but maybe the best thing for society would be if every tensor chip disintegrated the moment they came into existence.
I don't see how society is better when everyone can run their own gooner simulation and share it with videos made of their high school classmates. Or how we'll benefit from being unable to trust any photo or video we see without trusting who sends it to you, and even then doubting its veracity. Not being able to hear your spouse's voice on the phone without checking the post-quantum digital signature of their transmission for authenticity.
Society is heading to a less stable, less certain moment than any point in its history, and it is happening within our lifetime.