Most people don't give a single shit about your font choice unless it is egregiously unreadable, but the people who do care are especially strident about it.
I tend to prefer leaving it up to their browser default when possible, on the assumption that the few people who really care have customized their browser and don't want me to override it and nobody else will appreciate my refined sensibilities in font selection.