That's because those rating systems naively apply the ratings across the entire population. The average of the star ratings should be weighted by the normalized dot product of each rater's style and your rating style, or the similarity between each rater and you. A 0-star rating from someone whose preferences are orthogonal to you should not influence the average rating you see.
