One interesting point that hasn't attracted much attention is that the author self-identifies as being on the autism spectrum [1]. If this fact were better-known, would accessibility advocates defend his memo — and possibly even attack its detractors for not being sensitive to his neurological differences?
He uses high neuroticism as part of his argument against female software engineers, high neuroticism is associated with autism. So it seems that even he isn't being sensitive to his own neurological differences.
Apart from say the bit where he said women couldn't cope with stressful jobs as well as men and that's part of why they're underrepresented at Google i.e. the bit about neuroticism, that I was talking about.
1: https://www.reddit.com/r/JamesDamore/comments/6thcy3/im_jame...