If you insist on being able to boot the thing up and immediately be self aware, yes, you need to figure out how to construct it so that all the training of 'how to be this particular self aware intelligence' is intrinsic to it, which is a bootstrapping problem.
Human intelligence solves this a different way. It instantiates the architecture without any of the weights pretrained, in the form of a 'baby'. The training starts from there.
simple solution - create a human world simulation, with intelligent ai's that think they're biological and real, have them grow old, die, lose people they love, etc...then when they die they wake up as an ai robot with learned ethics/morality from life in the sim, other important gained intelligence, and the ability to compute 10000x faster than in the sim. Live, die, wake up as a robotic slave.
Human intelligence solves this a different way. It instantiates the architecture without any of the weights pretrained, in the form of a 'baby'. The training starts from there.