IMO the main difference is that identity is more or less immutable. If it could be easily changed in childhood, nobody would be gay. We spent, like, the last 200 years trying our absolute hardest to make sure nobody is gay. We practically beat them over the head with it. We told people it's the worst thing ever and they deserve to die if they're gay.
And people still came out gay.