I've spent the morning digging into this, and find it frustratingly controversial (in the proper sense, of being murky and divisive). I admit I like the story of the defense you've sheared, that it was an aspect of the times, but can't deny the concerns raised by his relationship with Alice in particular (see their kisses, letters). My SO says there was a documentary which featured condemning letters from one of his yiuge girlfriend's nannies, but I haven't seen these, except perhaps in a passing mention of contemperary gossip. I do find it interesting to read mid-tentieth century psychoanalysis of his work, because it kind-of reads like the sensational speculatuon in online forum comments :p