I've lived in a few places in Berlin over the years, I've never seen anything but nice clear water come out of the tap (whether at my place or friend's flats). Granted, it's hard water (lots of calcium) but other than that it's perfectly fine. Pipes as bad as you're describing definitely exist but I'd say they're the exception, not the rule.
I was in Berlin this summer for 2 months (Neukolln), in 3 different airbnbs and the water was not tasty, and was quite bitter. Very different compared to Swedish or Austrian or even Italian (florence) water.