I'm basically a lurker as well (< a dozen comments in 3 years probably), but despite the increased difficulty in identifying the best contributions to a discussion, I still overall feel I and the site both are better off without the comment scores visible. The quality of discussion has improved so drastically that I'm ok with the fact that it's harder for me to visually dissect the wheat from the chaff.
The site was better with scores 2 years ago than it is now, but given the options at present, I'd stick with pg's decision.
The site was better with scores 2 years ago than it is now, but given the options at present, I'd stick with pg's decision.