It matters not if it has an inner life, all that matters is if can mimic your intelligence enough to put you out of a job and make your masters think your life is no longer relevant.
I’ve built transformer tech myself and it’s pretty clear how attention technology mimics reasoning. And how with more realtime inputs plus reflection it will be able to mimic goal orientation and motivations.
It matters not if it has an inner life, all that matters is if can mimic your intelligence enough to put you out of a job and make your masters think your life is no longer relevant.
I’ve built transformer tech myself and it’s pretty clear how attention technology mimics reasoning. And how with more realtime inputs plus reflection it will be able to mimic goal orientation and motivations.
It may not need to be alive to replace us.