If all masses were once lower, and had been constantly increasing, then those galaxies are now blue-shifted, and blue shifted is what we have come to think of as normal. But billions of years ago, when they were lighter, they were emitting photons that, to us now, in the present, seem red-shifted. They seem redshifted because they come from the past, when things were lighter.
