Because we do known that men and women are neurologically different. There's a wealth of evidence suggesting so. And considering what we know about sexual dimorphism, this is completely unsurprising.
I was responding to a comment that said "My point here is that the difference between men and women on most metrics tends to be more heavily influenced by other external factors."
Given the topic, I took that as an argument that the neurological differences are not as pronounced as what is created by external factors, and I was responding to the lack of evidence provided for that view (which I interpret as the opposite of the view you suggested).
I actually lean towards your position, but I wasn't trying to express that as an argument (I'm unqualified to). I was just trying to point out what I saw as at best very loose reasoning (at least when provided without evidence).
