Not necessarily. While I'll agree with that the current score of the comment should have little to do with your vote, who said it is necessary for context. Consider this hypothetical comment:
"The backend code behind the current search functionality at google is absolutely horrible. The search ranking algorithm is pathetic to say the least."
Had this been said by an SEO guy or an employee of yahoo/bing, I'd have downvoted the comment. However, if it were a comment by Matt Cutts (http://news.ycombinator.com/user?id=Matt_Cutts), it presents itself in a whole different context. It's no longer a flamewar comment, but rather an admittance of areas where someone/something needs to improve.