That’s because unlike other political factions that treat politics as a team sport and prioritize group identity, libertarians tend to be free thinkers and have their own opinions and views.
I can predict virtually every single opinion a self-labeled "libertarian" has about the world.
Now granted, among the people who are actually free-thinkers and have their own opinions, you will find many libertarian-adjacent views, but I've found that those people do not refer to themselves as libertarians.