The downside of this is that it becomes self reinforcing. So people don't get to see what the wider society thinks. They only get to experience what like-minded people have to say. Despite the ugliness one is likely to come across, I think it's better for society if individuals get to experience the full spectrum of society. Else we're walling ourselves off.
If we are talking about current events or politics, that is a problem.
But I use reddit mostly to follow news about my favorite sports teams and a few of my hobbies. For that, I don't care what the rest of reddit is saying.
Groupthink takes hold on Reddit even without tailored sorting.
In fact, I suspect allowing more isolation between factions would allow for a diversity of opinions to brew in those pockets, with the good ideas inevitably metastasizing to the whole network.