It's... complicated. What musicians can tolerate with practice and what will throw them off at first and muck them up is quite different. And there's the question of what you're playing - I can play slow stuff with terrible latency and it's fine, but start to play quick and you really feel it. It also depends on the instrument, it's a lot weirder playing something where the haptic feedback is off from what you expect on that instrument (or missing).
But in general, 20ms is considered the top end of fine. A good player can totally feel the difference between 10 and 20 though. Under 10 is not really an issue. After that, you have some stuff to get used to and while you might be able to jam, it's affecting you.
But in general, 20ms is considered the top end of fine. A good player can totally feel the difference between 10 and 20 though. Under 10 is not really an issue. After that, you have some stuff to get used to and while you might be able to jam, it's affecting you.